00000400:00080000:2.0F:1783444131.816272:0:83710:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1783444131.83313 00010000:02000000:3.0F:1783444131.816378:0:83313:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:06, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:3.0:1783444131.835225:0:83313:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac1c48003e10 00100000:10000000:3.0:1783444131.835242:0:83313:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0F:1783444131.837182:0:83299:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1783444131.837251:0:83299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83299:1870073575170176:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783444131.837322:0:83299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444131.837391:0:83299:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700480 going to sleep for 20 seconds 00000004:00080000:1.0F:1783444131.837563:0:83301:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1783444131.837592:0:83301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901851180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83301:1870073575170304:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783444131.837620:0:83301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444131.837920:0:83301:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016ea80 going to sleep for 20 seconds 00000100:00100000:2.0:1783444131.838079:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575170176 00000100:00100000:2.0:1783444131.838088:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575170176 00000100:00080000:1.0:1783444131.838159:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444131.838187:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575170304 00000100:00100000:3.0:1783444131.838191:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575170304 00000100:00100000:3.0:1783444131.838237:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5835 00000100:00100000:3.0:1783444131.838246:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:83299:x1870073575170176:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1783444131.838252:0:8420:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1783444131.838280:0:8420:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -529 00002000:02000040:3.0:1783444131.838285:0:8420:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:705) 00000100:00080000:1.0:1783444131.838469:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444131.838514:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5836 00000100:00100000:0.0:1783444131.838523:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:83301:x1870073575170304:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1783444131.838528:0:26204:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1783444131.838542:0:26204:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -31 00002000:02000040:0.0:1783444131.838546:0:26204:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:705) 00002000:00010000:3.0:1783444131.850233:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.850250:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.850269:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.850273:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.850280:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.850298:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.850309:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.850318:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.850364:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444131.851554:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.851564:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851578:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.851582:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.851586:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851597:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851605:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851611:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851631:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783444131.851687:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.851693:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851700:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.851714:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.851718:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851743:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851751:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851757:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851771:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783444131.851837:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.851842:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851851:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.851854:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.851857:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851865:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851873:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851885:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.851900:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783444131.851941:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.852067:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444131.852076:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852086:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.852091:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852111:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852140:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852147:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e3831222 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852172:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444131.852176:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852182:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.852193:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852201:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852225:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852233:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e3831229 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852246:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444131.852249:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852254:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444131.852450:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852472:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.852475:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.852480:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852490:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852499:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852507:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852518:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783444131.852568:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.852572:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852587:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.852590:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.852594:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852601:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852608:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852615:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852623:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783444131.852663:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.852668:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852675:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.852678:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.852682:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852690:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852708:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852715:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852723:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783444131.852753:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444131.852760:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.852767:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852773:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.852778:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.852823:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.852830:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3831230 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853426:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444131.853431:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853439:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.853443:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853459:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853473:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853481:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e3831237 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853494:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444131.853499:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853507:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.853511:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853531:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853543:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853550:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e383123e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853565:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444131.853568:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853574:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.853578:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853586:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853595:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853601:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3831245 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853626:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444131.853631:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853637:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.853640:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853648:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853658:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853666:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e383124c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.853676:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.853677:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.853679:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.853688:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.853707:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.853717:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.853825:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.853833:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.853845:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.853854:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.853862:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.853894:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444131.854497:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444131.854505:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444131.854516:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.854528:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.854531:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.854538:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854543:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.854551:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.854553:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854556:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854576:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.854580:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854590:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.854595:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831253 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854606:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.854625:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444131.854630:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854636:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444131.854637:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.854643:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.854651:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.854660:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.854676:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e383125a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444131.854688:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.854693:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.854695:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.854697:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.854705:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.854715:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.854716:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.854722:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854732:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854739:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854747:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854763:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444131.854820:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.854826:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854834:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.854836:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.854840:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854849:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854857:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854868:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854882:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444131.854890:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444131.854894:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854902:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444131.854905:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854912:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854923:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.854931:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000443af84/0x42cb6883e3831261 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855042:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444131.855048:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855055:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.855059:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855067:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855078:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855085:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831268 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855100:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855102:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855104:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444131.855166:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444131.855172:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855180:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:2.0:1783444131.855183:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.855187:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855196:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855206:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855214:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855222:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855240:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444131.855277:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444131.855281:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855289:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:2.0:1783444131.855292:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444131.855296:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855304:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855312:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855331:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855344:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444131.855351:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444131.855354:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855361:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.855365:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855373:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855384:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855391:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce2bf87a/0x42cb6883e383126f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.855400:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444131.855407:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855408:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855411:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855414:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.855421:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.855424:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.855433:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.855447:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.855465:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b77da470/0x42cb6883e3831276 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444131.855470:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.855482:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855485:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.855485:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.855496:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855497:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:2.0:1783444131.855501:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444131.855505:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855515:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855523:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855531:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855549:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444131.855586:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444131.855592:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855599:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:2.0:1783444131.855602:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444131.855606:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855613:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855628:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855635:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855648:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444131.855654:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444131.855658:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855665:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fe00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.855669:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855676:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855687:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855695:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e383127d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855707:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444131.855715:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855722:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fa00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.855725:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855733:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855743:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855750:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831284 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855761:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855762:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855764:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444131.855823:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444131.855828:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855836:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:2.0:1783444131.855839:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444131.855843:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855863:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855872:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855879:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855893:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444131.855900:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444131.855904:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855911:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583ee00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.855915:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.855922:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.855923:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.855938:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857069:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.857073:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.857076:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444131.857181:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.857200:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857211:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.857215:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.857220:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857231:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857241:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857250:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857269:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444131.857280:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444131.857288:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857297:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.857301:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444131.857309:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.857311:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857317:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857325:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.857328:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.857332:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857339:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857354:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857360:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857374:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444131.857404:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857413:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e3831292 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444131.857419:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444131.857427:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857435:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:3.0:1783444131.857437:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.857441:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857443:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444131.857450:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857466:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444131.857468:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857470:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857490:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857505:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857515:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857534:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857542:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444131.857544:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3831299 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857553:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444131.857559:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857561:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.857565:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.857568:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.857573:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444131.857576:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857577:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.857587:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857600:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857607:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d636e9/0x42cb6883e38312a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.857624:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.857626:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.857629:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444131.857644:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.857651:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857659:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.857663:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.857667:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857676:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857683:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857696:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.857704:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7df7d9e/0x42cb6883e383128b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.857737:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444131.857739:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444131.857744:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.857749:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.857753:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.857760:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.857772:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.857779:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e38312a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444131.857804:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.857811:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.857814:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.857818:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.857821:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.857822:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.857827:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444131.857891:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.858262:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858276:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858284:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858292:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858322:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444131.858345:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444131.858352:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.858360:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757200 already unused, calling callback (ffffffffc0c36f90) 00002000:00010000:1.0:1783444131.858369:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444131.858370:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858380:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.858384:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.858407:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858419:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.858426:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.858435:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.858436:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e38312ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858468:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.858475:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.858478:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.858480:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.858480:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858491:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858520:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444131.858562:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.858567:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858575:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.858578:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.858582:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858591:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858612:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858619:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858637:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444131.858674:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.858679:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858687:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.858690:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.858694:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858715:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858724:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858731:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858754:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783444131.858811:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.858817:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858825:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.858828:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.858841:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858851:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858859:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858866:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858878:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783444131.858916:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.858921:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858928:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.858937:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.858942:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858951:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858959:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858966:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.858974:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783444131.859010:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.859015:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859022:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.859026:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.859030:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859039:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859048:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859053:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783444131.859062:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859066:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859075:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.859082:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859084:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783444131.859096:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859111:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859125:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38312b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444131.859125:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.859136:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859146:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:2.0:1783444131.859147:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783444131.859149:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444131.859152:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859155:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859165:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.859172:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859175:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859189:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859200:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859205:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859213:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859216:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e38312bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859234:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1783444131.859240:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783444131.859244:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859251:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.859259:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859268:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859279:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444131.859281:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.859292:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859294:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e38312c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859310:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444131.859311:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:2.0:1783444131.859315:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859316:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.859326:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859328:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.859333:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859347:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859348:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859375:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859376:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859385:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e38312ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859391:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859416:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1783444131.859420:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783444131.859424:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859430:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.859434:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859442:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859465:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444131.859470:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444131.859473:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e38312d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859477:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859488:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:2.0:1783444131.859489:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444131.859495:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444131.859496:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859504:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859508:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.859513:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859519:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859536:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859556:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859557:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859577:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070fbfd1a/0x42cb6883e38312d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859579:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859605:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783444131.859608:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444131.859613:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859620:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.859624:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859633:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859645:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444131.859647:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.859659:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859660:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050b55c86/0x42cb6883e38312df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859682:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.859687:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444131.859696:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859707:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859712:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444131.859719:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859721:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859740:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444131.859742:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859746:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859759:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859783:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444131.859811:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859821:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000628ced7c/0x42cb6883e38312e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859837:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444131.859840:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859846:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.859850:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859869:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859882:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444131.859885:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444131.859896:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859897:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c960fb9/0x42cb6883e38312ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859919:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:1.0:1783444131.859924:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444131.859926:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444131.859929:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.859931:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859949:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859957:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859965:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444131.859973:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444131.861058:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444131.861067:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.861093:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444131.861098:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.861108:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.861127:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.861135:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005563487b/0x42cb6883e38312fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.861154:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.861157:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.861159:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.861168:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.861191:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.861263:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444131.861267:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.861277:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.861291:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.861300:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e16ceae4/0x42cb6883e38312f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444131.861327:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.861329:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444131.861331:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.862978:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.862990:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863006:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.863010:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.863016:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863028:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863038:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863045:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863087:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444131.863197:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.863202:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863210:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.863213:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.863216:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863226:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863233:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863239:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863256:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444131.863266:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444131.863271:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863278:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.863289:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863299:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863314:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863322:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ea29408/0x42cb6883e3831302 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863339:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.863343:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863349:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.863353:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863360:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863370:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863377:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3829f5/0x42cb6883e3831309 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863397:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.863399:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.863401:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.863476:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.863482:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863490:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.863493:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.863498:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863507:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863516:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863522:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863535:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444131.863576:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.863581:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863601:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.863604:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.863608:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863617:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863626:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863634:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863651:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444131.863695:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.863700:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863708:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.863711:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.863715:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863724:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863746:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863753:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863765:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783444131.863771:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444131.863775:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863781:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.863785:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863827:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863838:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863845:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001eea3615/0x42cb6883e3831310 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863857:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444131.863865:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863871:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.863874:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863882:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863893:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863901:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014294f49/0x42cb6883e3831317 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863913:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.863916:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863923:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.863926:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863933:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863953:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863960:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383131e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.863973:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.863975:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.863976:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.864040:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.864045:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864052:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.864055:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.864058:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864067:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864074:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864081:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864104:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.864112:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.864115:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864122:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.864125:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864133:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864143:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864150:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831325 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864162:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864164:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864165:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.864206:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.864212:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864219:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.864228:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.864232:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864242:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864250:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864257:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864270:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.864277:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.864281:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864288:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.864291:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864298:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864307:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864325:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e383132c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864339:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864340:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864342:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.864383:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.864388:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864397:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.864400:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.864403:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864413:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864420:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864427:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864439:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.864464:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.864468:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864475:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.864478:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864485:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864496:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864503:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e3831333 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864516:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864518:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864519:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.864561:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.864567:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864574:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.864577:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.864580:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864603:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864611:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864618:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864631:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.864639:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.864642:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864648:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.864652:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864660:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864669:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864676:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e383133a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864697:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864698:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864700:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.864742:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.864747:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864755:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.864757:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.864761:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864770:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864778:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864784:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864823:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.864829:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.864833:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864851:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.864855:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864863:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864873:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864880:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831341 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864893:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864895:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.864896:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.864938:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.864943:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864951:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.864953:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.864957:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864966:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864980:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.864987:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865000:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.865006:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.865009:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865015:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.865018:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865026:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865037:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865043:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831348 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865056:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865063:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865065:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.865111:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.865116:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865123:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.865126:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.865129:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865138:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865146:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865152:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865163:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.865169:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.865172:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865178:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.865182:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865199:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865209:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865216:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e383134f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865227:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865229:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865230:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.865268:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.865272:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865280:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.865283:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.865287:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865295:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865303:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865315:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865327:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.865333:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.865336:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865343:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.865346:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865354:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865364:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865372:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831356 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865384:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865385:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865387:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.865425:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.865437:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865445:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.865447:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.865465:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865475:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865483:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865491:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865503:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.865509:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.865513:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865518:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.865522:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865529:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865545:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865552:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383135d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865566:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865568:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865570:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.865609:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.865613:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865620:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.865623:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.865627:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865635:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865643:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865650:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865670:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.865676:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.865680:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865686:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.865689:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865696:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865705:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865712:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3831364 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865725:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865726:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865728:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.865765:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.865770:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865776:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.865785:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.865808:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865818:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865825:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865831:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865842:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.865848:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.865852:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865857:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.865860:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865868:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865878:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865896:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383136b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865910:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865912:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.865914:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.865953:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.865958:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865965:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.865967:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.865971:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865978:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865985:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.865990:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866000:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.866011:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.866014:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866020:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.866022:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866029:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866038:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866044:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831372 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866054:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.866055:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.866057:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.866092:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.866097:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866103:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.866106:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.866109:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866127:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866134:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866142:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866152:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.866158:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.866161:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866167:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.866170:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866176:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866185:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866193:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831379 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866212:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.866213:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.866215:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.866253:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.866258:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866265:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.866268:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.866271:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866278:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866285:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866291:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866302:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.866307:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.866310:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866325:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.866328:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866336:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866346:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866353:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831380 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866364:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.866366:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.866367:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.866406:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.866410:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866417:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.866420:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.866423:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866431:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.866443:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.866664:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.866670:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.866697:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.869875:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.869920:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444131.870074:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.870082:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870094:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.870099:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.870106:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870120:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870130:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870137:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870248:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444131.870295:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.870301:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870309:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.870312:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.870316:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870326:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870333:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.870339:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870380:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783444131.870389:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870398:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444131.870409:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870431:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870448:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870466:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831387 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870490:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444131.870494:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870500:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444131.870504:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870511:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870521:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870528:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e383138e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870549:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444131.870553:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870560:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444131.870563:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870572:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870583:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444131.870590:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.870592:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444131.870594:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444131.871948:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783444131.871986:0:8420:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:3.0:1783444131.872100:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:83299:x1870073575170176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 33850us (34772us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444131.872111:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5835 00000100:00100000:1.0:1783444131.872306:0:83299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83299:1870073575170176:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783444131.872322:0:83299:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2c1:0x0] from OST, last_created [0x280000401:0x2c1:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:1.0:1783444131.872476:0:83299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901850700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83299:1870073575170560:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783444131.872523:0:83299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444131.872550:0:83299:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016ee40 going to sleep for 20 seconds 00000100:00100000:3.0:1783444131.872607:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575170432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444131.872638:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444131.872722:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575170560 00000100:00100000:3.0:1783444131.872728:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575170560 00000100:00100000:3.0:1783444131.872774:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5837 00000100:00100000:3.0:1783444131.872783:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:83299:x1870073575170560:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1783444131.872809:0:8422:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1783444131.872845:0:8422:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 706 00010000:00010000:0.0:1783444131.874558:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783444131.874575:0:26204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831395 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874626:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.874726:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.874745:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874759:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.874764:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.874770:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874785:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874811:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874818:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874838:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.874845:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.874851:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874858:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.874863:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874872:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874898:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874906:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e383139c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874920:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.874922:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.874924:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.874967:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.874972:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874979:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.874982:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.874986:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.874995:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875003:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875010:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875035:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.875044:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.875048:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875055:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.875058:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875065:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875076:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875083:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e38313a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875095:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.875097:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.875099:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.875142:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.875147:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875154:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.875164:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.875168:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875176:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875184:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875190:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875203:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444131.875239:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.875244:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875251:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.875253:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.875257:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875264:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875271:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875284:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875297:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444131.875304:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444131.875308:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875314:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.875317:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875324:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875335:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875342:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e38313aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875354:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.875357:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875375:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.875378:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875386:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875397:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875404:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e38313b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875512:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.875515:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.875516:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.875564:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.875570:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875578:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.875580:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.875584:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875593:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875608:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875616:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875629:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.875637:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.875641:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875648:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.875651:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875659:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875671:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875678:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e38313b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875691:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.875698:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.875700:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.875761:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.875767:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875774:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.875778:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.875781:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875811:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875819:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875826:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875839:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.875846:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.875850:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875857:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.875860:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875880:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875892:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875900:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e38313bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875914:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.875915:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.875917:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.875959:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.875964:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875972:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.875975:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.875978:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875987:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.875994:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876008:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876020:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.876027:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.876030:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876037:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.876040:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876048:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876059:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876067:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e38313c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876078:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.876080:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.876081:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.876121:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.876131:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876139:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.876142:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.876145:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876154:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876161:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876168:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876180:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.876186:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.876189:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876196:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.876199:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876207:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876224:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876231:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e38313cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876244:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.876246:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.876247:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444131.876292:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444131.876298:0:26204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876306:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=3122s v=(0 0) 00010000:00010000:0.0:1783444131.876309:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444131.876313:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876321:0:26204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876329:0:26204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876336:0:26204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876359:0:26204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444131.876367:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444131.876370:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876377:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444131.876380:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876388:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876400:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.876408:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e38313d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444131.877050:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.877052:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444131.877054:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783444131.877098:0:26204:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:0.0:1783444131.877245:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:83301:x1870073575170304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 38719us (39619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444131.877255:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5836 00010000:00010000:0.0:1783444131.877302:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444131.877522:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:83299:x1870073575170560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4739us (4998us total) trans 4294969446 rc 0/0 00000100:00100000:3.0:1783444131.877530:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5837 00000100:00100000:0.0:1783444131.877679:0:83299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901850700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83299:1870073575170560:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783444131.877694:0:83299:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2c1:0x0]-[0x280000401:0x2e1:0x0] 00000100:00100000:1.0:1783444131.877785:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575170432 00000100:00100000:1.0:1783444131.877817:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575170432 00000100:00100000:0.0:1783444131.877926:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:0.0:1783444131.877934:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575170432:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1783444131.877940:0:13537:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783444131.877961:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444131.878003:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575170432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (5363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444131.878012:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:3.0:1783444131.878110:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575170432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444131.878189:0:83301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901851180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83301:1870073575170304:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783444131.878200:0:83301:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2c1:0x0] from OST, last_created [0x2c0000401:0x2c1:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:0.0:1783444131.878273:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e786b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575170688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444131.878315:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444131.878379:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575170688 00000100:00100000:1.0:1783444131.878384:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575170688 00000100:00100000:1.0:1783444131.878428:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731 00000100:00100000:1.0:1783444131.878435:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575170688:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1783444131.878441:0:8424:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1783444131.878468:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444131.878542:0:83301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83301:1870073575170816:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783444131.878567:0:83301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444131.878586:0:83301:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75e5e40 going to sleep for 20 seconds 00000100:00100000:2.0:1783444131.878602:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575170816 00000100:00100000:2.0:1783444131.878606:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575170816 00000100:00100000:2.0:1783444131.878631:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5838 00000100:00100000:2.0:1783444131.878637:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:83301:x1870073575170816:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:2.0:1783444131.878641:0:26206:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1783444131.878665:0:26206:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00000100:00100000:2.0:1783444131.880219:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:83301:x1870073575170816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1578us (1646us total) trans 4294969449 rc 0/0 00000100:00100000:2.0:1783444131.880231:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5838 00000100:00100000:2.0:1783444131.880293:0:83301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83301:1870073575170816:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783444131.880304:0:83301:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2c1:0x0]-[0x2c0000401:0x2e1:0x0] 00000100:00100000:1.0:1783444131.880835:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575170688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2397us (2515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444131.880844:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731 00000100:00100000:0.0:1783444131.881022:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e786b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575170688:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783444132.637241:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444132.637249:0:50586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1783444132.637323:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575170944:0@lo:400:kworker.0 00000100:00100000:2.0:1783444132.637406:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444132.637482:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575171456:0@lo:400:kworker.0 00000100:00100000:0.0:1783444132.637510:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575171328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444132.637519:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783444132.637606:0:29151:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff936901853b80 x1870073575168896/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1783444141 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444132.637819:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575171072:0@lo:400:kworker.0 00000100:00100000:1.0:1783444132.640824:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575168896:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1009641us (1010168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444132.640842:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:1.0:1783444132.640897:0:83288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575170944 00000100:00100000:1.0:1783444132.640906:0:83288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575170944 00000100:00100000:1.0:1783444132.640950:0:83288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783444132.640959:0:83288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575170944:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783444132.640966:0:83288:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783444132.641026:0:83288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575170944:12345-0@lo:400:kworker.0 Request processed in 68us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444132.641034:0:83288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783444132.641319:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444132.641366:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575171840:0@lo:400:kworker.0 00000100:00100000:1.0:1783444132.641387:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575171456 00000100:00100000:1.0:1783444132.641393:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575171456 00000100:00100000:0.0:1783444132.641401:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444132.641425:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575172352:0@lo:400:kworker.0 00000100:00100000:0.0:1783444132.641465:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444132.641491:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444132.641500:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444132.641527:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444132.641534:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444132.641697:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575171968:0@lo:400:kworker.0 00000100:00100000:2.0:1783444132.642029:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444132.642211:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575170944:0@lo:400:kworker.0 00000100:00100000:1.0:1783444132.642277:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575171328 00000100:00100000:1.0:1783444132.642283:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575171328 00000100:00100000:1.0:1783444132.642312:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575171840 00000100:00100000:1.0:1783444132.642316:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575171840 00000100:00100000:1.0:1783444132.642328:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575172352 00000100:00100000:1.0:1783444132.642332:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575172352 00000100:00100000:1.0:1783444132.642346:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783444132.642353:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575171456:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783444132.642360:0:80475:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783444132.642412:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575171456:12345-0@lo:400:kworker.0 Request processed in 59us (4896us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444132.642420:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783444132.642449:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1783444132.642458:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575171328:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783444132.642462:0:80475:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783444132.642473:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1783444132.642485:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575171840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444132.642502:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575171328:12345-0@lo:400:kworker.0 Request processed in 45us (1184us total) trans 0 rc 0/0 00000020:02000000:0.0:1783444132.642502:0:71469:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783444132.642512:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1783444132.642527:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1783444132.642542:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575171840:12345-0@lo:400:kworker.0 Request processed in 59us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444132.642549:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575172352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444132.642553:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000020:02000000:1.0:1783444132.642556:0:80475:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783444132.642581:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575172480 00000100:00100000:0.0:1783444132.642586:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575172480 00000100:00100000:1.0:1783444132.642592:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575172352:12345-0@lo:400:kworker.0 Request processed in 45us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444132.642599:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1783444132.642622:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732 00000100:00100000:0.0:1783444132.642632:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575172480:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1783444132.642637:0:8423:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00080000:1.0:1783444132.642644:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783444132.642655:0:3632:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff936901850e00 x1870073575168896/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444161 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1783444132.642655:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783444132.642669:0:3632:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff936901850e00 x1870073575168896/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444161 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444132.642693:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575172480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (1157us total) trans 0 rc 0/0 00000100:00080000:1.0:1783444132.642703:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444132.642706:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732 00000100:02000000:1.0:1783444132.642720:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444132.642749:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444132.642762:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575171328:0@lo:400:kworker.0 00000100:00100000:0.0:1783444132.642771:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575171840:0@lo:400:kworker.0 00000100:00100000:0.0:1783444132.642780:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575172352:0@lo:400:kworker.0 00000100:00080000:0.0:1783444132.642840:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444132.642845:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444132.642847:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444132.642869:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575171968 00000100:00100000:0.0:1783444132.642873:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575171968 00000100:00100000:0.0:1783444132.642898:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:0.0:1783444132.642903:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575171968:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1783444132.642908:0:8430:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783444132.642951:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575171968:12345-0@lo:400:kworker.0 Request processed in 47us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444132.642957:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000100:00100000:0.0:1783444132.643019:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575171200:0@lo:400:kworker.0 00000100:00080000:1.0:1783444132.643070:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e4e5ee80): req@ffff9368dd158700 x1870073575086720/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783443956 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444132.643093:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575168896:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1783444132.643352:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575171072 00000100:00100000:1.0:1783444132.643356:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575171072 00000100:00100000:1.0:1783444132.643390:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1783444132.643398:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575171072:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783444132.643402:0:71469:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444132.643507:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575171456:0@lo:400:kworker.0 00000100:00100000:2.0:1783444132.643519:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575171968:0@lo:400:kworker.0 00000100:00080000:2.0:1783444132.643598:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444132.645227:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575171584:0@lo:400:kworker.0 00000100:00100000:3.0:1783444132.645280:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444132.645310:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575172096:0@lo:400:kworker.0 00000100:00100000:3.0:1783444132.645332:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444132.645353:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dceaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575172608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444132.645378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444132.645404:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444132.645412:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575172736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444132.645450:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444132.645486:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575171584 00000100:00100000:3.0:1783444132.645493:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575171584 00000100:00100000:3.0:1783444132.645653:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575172096 00000100:00100000:3.0:1783444132.645657:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575172096 00000100:00100000:2.0:1783444132.645702:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:2.0:1783444132.645714:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575171584:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444132.645721:0:26199:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444132.645777:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575171584:12345-0@lo:400:kworker.0 Request processed in 66us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444132.645785:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:2.0:1783444132.645820:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00100000:2.0:1783444132.645827:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575172096:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444132.645831:0:26199:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444132.645858:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575172096:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444132.645865:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00100000:2.0:1783444132.645894:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575172608 00000100:00100000:2.0:1783444132.645898:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575172608 00000100:00100000:2.0:1783444132.645935:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:2.0:1783444132.645941:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575172608:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:2.0:1783444132.645946:0:8424:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1783444132.645973:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444132.646007:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575172608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444132.646014:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00080000:2.0:1783444132.646031:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444132.646060:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575172736 00000100:00100000:2.0:1783444132.646064:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575172736 00000100:00100000:2.0:1783444132.646289:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:2.0:1783444132.646298:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575172736:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1783444132.646302:0:8431:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783444132.646328:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444843520 avail 1298604032 00000100:00100000:2.0:1783444132.646368:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575172736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444132.646374:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00100000:2.0:1783444132.646434:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575172736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444132.646460:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575171584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444132.646471:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575172096:0@lo:400:kworker.0 00000100:00100000:2.0:1783444132.646485:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dceaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575172608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444132.646801:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575171072:12345-0@lo:400:kworker.0 Request processed in 3389us (5260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444132.646810:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1783444132.646891:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575171072:0@lo:400:kworker.0 00000100:00100000:0.0:1783444132.653334:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444132.653407:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575171712:0@lo:400:kworker.0 00000100:00100000:0.0:1783444132.653485:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444132.653517:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575172224:0@lo:400:kworker.0 00000100:00100000:0.0:1783444132.653546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444132.653597:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444132.653662:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575086720 00000100:00100000:2.0:1783444132.653663:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575171712 00000100:00100000:2.0:1783444132.653672:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575171712 00000100:00100000:0.0:1783444132.653672:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575086720 00000100:00100000:2.0:1783444132.653723:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575172224 00000100:00100000:2.0:1783444132.653727:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575172224 00000100:00100000:0.0:1783444132.653731:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:0.0:1783444132.653743:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575086720:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1783444132.653750:0:23687:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444132.653755:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00100000:2.0:1783444132.653764:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575171712:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444132.653769:0:26202:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1783444132.653785:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444843520 avail 1298604032 00000100:00100000:0.0:1783444132.653867:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575086720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444132.653870:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575171712:12345-0@lo:400:kworker.0 Request processed in 107us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444132.653880:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00100000:2.0:1783444132.653883:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00100000:2.0:1783444132.653902:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:2.0:1783444132.653910:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575172224:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444132.653914:0:26202:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783444132.653930:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575171712:0@lo:400:kworker.0 00000100:00100000:2.0:1783444132.653943:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575172224:12345-0@lo:400:kworker.0 Request processed in 33us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444132.653949:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575172224:0@lo:400:kworker.0 00000100:00100000:2.0:1783444132.653951:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00100000:0.0:1783444132.653971:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575086720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444132.654535:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575171200 00000100:00100000:1.0:1783444132.654541:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575171200 00000100:00100000:1.0:1783444132.654595:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1783444132.654603:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575171200:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783444132.654609:0:66225:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783444132.654663:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575171200:12345-0@lo:400:kworker.0 Request processed in 61us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444132.654669:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00080000:2.0:1783444132.654739:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444132.654840:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575171200:0@lo:400:kworker.0 00010000:00010000:0.0:1783444132.765042:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444133.789325:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444134.685132:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444134.685161:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575172864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444134.685247:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444134.685352:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575172864 00000100:00100000:1.0:1783444134.685364:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575172864 00000100:00100000:1.0:1783444134.685429:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:1.0:1783444134.685440:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575172864:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:1.0:1783444134.685448:0:8431:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1783444134.685514:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444134.685583:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575172864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444134.685591:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00100000:3.0:1783444134.685785:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575172864:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783444134.819438:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444135.838940:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444136.669731:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575173120:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.669834:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.669877:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575173632:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.669924:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.669941:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575174144:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.669970:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.669995:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783444136.670001:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575173248:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670023:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.670041:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575173760:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.670083:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd10a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575174272:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670104:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.670159:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575173120 00000100:00100000:2.0:1783444136.670167:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575173120 00000100:00100000:2.0:1783444136.670220:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575173248 00000100:00100000:2.0:1783444136.670224:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575173248 00000100:00100000:2.0:1783444136.670246:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1783444136.670255:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575173120:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444136.670263:0:67017:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444136.670318:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575173120:12345-0@lo:400:kworker.0 Request processed in 63us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444136.670326:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1783444136.670342:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1783444136.670349:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575173248:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444136.670353:0:67017:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444136.670394:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575173248:12345-0@lo:400:kworker.0 Request processed in 45us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444136.670399:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00080000:2.0:1783444136.670415:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444136.670419:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444136.670468:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575173248:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670482:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575173120:0@lo:400:kworker.0 00000100:00100000:3.0:1783444136.670507:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575172992:0@lo:400:kworker.0 00000100:00100000:3.0:1783444136.670552:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444136.670598:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575173504:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670608:0:83290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575172992 00000100:00100000:2.0:1783444136.670612:0:83290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575172992 00000100:00100000:3.0:1783444136.670621:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444136.670635:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575174016:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670635:0:83290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783444136.670641:0:83290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575172992:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444136.670645:0:83290:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783444136.670654:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444136.670671:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575174528:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670672:0:83290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575172992:12345-0@lo:400:kworker.0 Request processed in 31us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444136.670688:0:83290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783444136.670692:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444136.670715:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575172992:0@lo:400:kworker.0 00000100:00100000:3.0:1783444136.670725:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783444136.670730:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575173376:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670734:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575173504 00000100:00100000:2.0:1783444136.670737:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575173504 00000100:00100000:3.0:1783444136.670755:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.670761:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575174016 00000100:00100000:2.0:1783444136.670763:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575174016 00000100:00100000:3.0:1783444136.670765:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575173888:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670773:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575174528 00000100:00100000:2.0:1783444136.670775:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575174528 00000100:00100000:3.0:1783444136.670785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.670785:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575173376 00000100:00100000:2.0:1783444136.670809:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575173376 00000100:00100000:3.0:1783444136.670827:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575174400:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670827:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1783444136.670833:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575173504:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444136.670837:0:66223:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783444136.670848:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444136.670865:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575173504:12345-0@lo:400:kworker.0 Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444136.670870:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575173504:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670871:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1783444136.670882:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1783444136.670889:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575174016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444136.670890:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575173760 00000100:00100000:3.0:1783444136.670893:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575173760 00000020:02000000:2.0:1783444136.670893:0:66223:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783444136.670917:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575174272 00000100:00100000:3.0:1783444136.670920:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575174272 00000100:00100000:3.0:1783444136.670937:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575173888 00000100:00100000:2.0:1783444136.670937:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575174016:12345-0@lo:400:kworker.0 Request processed in 49us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444136.670939:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575173888 00000100:00100000:2.0:1783444136.670943:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1783444136.670953:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1783444136.670956:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575174400 00000100:00100000:3.0:1783444136.670958:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575174400 00000100:00100000:2.0:1783444136.670958:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575174528:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444136.670962:0:66223:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783444136.670974:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:3.0:1783444136.670980:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575173760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.670987:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575174528:12345-0@lo:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000020:02000000:3.0:1783444136.670990:0:26201:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444136.670992:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1783444136.671008:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1783444136.671014:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575173376:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444136.671018:0:66223:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783444136.671021:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575173760:12345-0@lo:400:kworker.0 Request processed in 42us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444136.671027:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00100000:3.0:1783444136.671039:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:2.0:1783444136.671043:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575173376:12345-0@lo:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444136.671045:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575174272:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783444136.671048:0:26201:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444136.671049:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1783444136.671067:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:3.0:1783444136.671072:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575174272:12345-0@lo:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444136.671073:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575173888:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1783444136.671077:0:26205:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783444136.671078:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00100000:3.0:1783444136.671088:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:3.0:1783444136.671094:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575174400:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1783444136.671097:0:26201:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1783444136.671102:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575173888:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444136.671107:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:3.0:1783444136.671116:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575174400:12345-0@lo:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444136.671122:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00080000:2.0:1783444136.671123:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444136.671126:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444136.671128:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444136.671129:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444136.671153:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575173760:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.671153:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575173376:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.671163:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575173888:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.671172:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575174400:0@lo:400:kworker.0 00000100:00100000:3.0:1783444136.671179:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd10a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575174272:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.671179:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575174016:0@lo:400:kworker.0 00000100:00100000:2.0:1783444136.671187:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575174528:0@lo:400:kworker.0 00000100:00100000:0.0:1783444136.671852:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575173632 00000100:00100000:0.0:1783444136.671860:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575173632 00000100:00100000:0.0:1783444136.671890:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575174144 00000100:00100000:0.0:1783444136.671893:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575174144 00000100:00100000:1.0:1783444136.671984:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:1.0:1783444136.671995:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575173632:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1783444136.672001:0:8431:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1783444136.672140:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:0.0:1783444136.672149:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fa173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575174144:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1783444136.672153:0:23687:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783444136.672293:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575173632:12345-0@lo:400:kworker.0 Request processed in 300us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444136.672300:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:3.0:1783444136.674815:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575173632:0@lo:400:kworker.0 00000100:00100000:0.0:1783444136.676061:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fa173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575174144:12345-0@lo:400:kworker.0 Request processed in 3906us (6082us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444136.676075:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00100000:3.0:1783444136.676817:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575174144:0@lo:400:kworker.0 00010000:00010000:0.0:1783444136.861062:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444137.036846:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444137.036941:0:83288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557735040 00000100:00100000:1.0:1783444137.036952:0:83288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557735040 00000100:00100000:1.0:1783444137.037018:0:83288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00100000:1.0:1783444137.037029:0:83288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557735040:12345-192.168.204.20@tcp:400:kworker.0 00000020:02000000:1.0:1783444137.037037:0:83288:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783444137.037136:0:83288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557735040:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444137.037144:0:83288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00100000:2.0:1783444137.040552:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444137.040596:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444137.040638:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444137.040677:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557735168 00000100:00100000:3.0:1783444137.040689:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557735168 00000100:00100000:3.0:1783444137.040785:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557735296 00000100:00100000:3.0:1783444137.040821:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557735296 00000100:00100000:1.0:1783444137.040827:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557735424 00000100:00100000:1.0:1783444137.040835:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557735424 00000100:00100000:1.0:1783444137.040901:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2217 00000100:00100000:1.0:1783444137.040913:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557735424:12345-192.168.204.20@tcp:400:kworker.0 00000020:02000000:1.0:1783444137.040924:0:26206:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1783444137.041002:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557735424:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444137.041010:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2217 00000100:00100000:0.0:1783444137.041299:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1005 00000100:00100000:0.0:1783444137.041307:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557735168:12345-192.168.204.20@tcp:38:kworker.0 00000020:02000000:0.0:1783444137.043486:0:66223:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1783444137.043533:0:66223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp t94489280515 exp 0000000000000000 cur 3128 last 0 00000020:00000080:0.0:1783444137.043596:0:66223:0:(genops.c:1406:class_connect()) connect: client 778015c5-4969-44f5-82a5-0f6eadd152d5, cookie 0x42cb6883e38313db 00000004:00100000:0.0:1783444137.043622:0:66223:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783444137.043736:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9368c9a14000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444137.043836:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557735168:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 2528us (3293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444137.043848:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1005 00000100:00100000:3.0:1783444137.049080:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 731 00000100:00100000:3.0:1783444137.049098:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557735296:12345-192.168.204.20@tcp:400:kworker.0 00000020:02000000:3.0:1783444137.049107:0:80475:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1783444137.049214:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557735296:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 120us (8616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444137.049221:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 731 00000100:00080000:1.0:1783444137.049272:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444137.049294:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444137.063677:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444137.063834:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557735552 00000100:00100000:2.0:1783444137.063857:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557735552 00000100:00100000:2.0:1783444137.063909:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1006 00000100:00100000:2.0:1783444137.063919:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64039:x1870073557735552:12345-192.168.204.20@tcp:41:lfs.0 00000020:02000000:2.0:1783444137.063927:0:71469:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783444137.063963:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444137.064040:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64039:x1870073557735552:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 122us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444137.064047:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1006 00000100:00100000:2.0:1783444137.071004:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444137.071224:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557735680 00000100:00100000:3.0:1783444137.071235:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557735680 00000100:00100000:3.0:1783444137.071284:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5839 00000100:00100000:3.0:1783444137.071293:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2400:x1870073557735680:12345-192.168.204.20@tcp:8:lfs.0 00000020:02000000:3.0:1783444137.071301:0:26209:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:3.0:1783444137.071342:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp t0 exp 0000000000000000 cur 3128 last 0 00000020:00000080:3.0:1783444137.071534:0:26209:0:(genops.c:1406:class_connect()) connect: client 778015c5-4969-44f5-82a5-0f6eadd152d5, cookie 0x42cb6883e38313e2 00002000:00100000:3.0:1783444137.071549:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 778015c5-4969-44f5-82a5-0f6eadd152d5/ffff9368ff68d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783444137.071568:0:26209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783444137.071645:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783444137.071678:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9368ff68a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444137.071757:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557735680:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 462us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444137.071766:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5839 00000001:00100000:2.0:1783444137.076848:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:2.0:1783444137.076872:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969446 is committed 00000100:00100000:3.0:1783444137.088830:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444137.088927:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557735808 00000100:00100000:0.0:1783444137.088938:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557735808 00000100:00100000:0.0:1783444137.088999:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1734 00000100:00100000:0.0:1783444137.089010:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64039:x1870073557735808:12345-192.168.204.20@tcp:13:lfs.0 00000020:02000000:0.0:1783444137.089034:0:13537:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783444137.089058:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444137.089140:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64039:x1870073557735808:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 132us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444137.089148:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1734 00000100:00100000:1.0:1783444137.095636:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444137.100326:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557735936 00000100:00100000:2.0:1783444137.100344:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557735936 00000100:00100000:2.0:1783444137.100427:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1735 00000100:00100000:2.0:1783444137.100438:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64039:x1870073557735936:12345-192.168.204.20@tcp:13:lfs.0 00000020:02000000:2.0:1783444137.100446:0:8423:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1783444137.100482:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444137.100648:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64039:x1870073557735936:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 211us (5023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444137.100656:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1735 00000100:00100000:3.0:1783444137.245266:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dceaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575174656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444137.245361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444137.245934:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575174656 00000100:00100000:0.0:1783444137.245945:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575174656 00000100:00100000:0.0:1783444137.246004:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:0.0:1783444137.246014:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575174656:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1783444137.246022:0:8424:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783444137.246044:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444137.246106:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575174656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444137.246113:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:1.0:1783444137.247001:0:3633:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969446 gen 2 00000100:00100000:1.0:1783444137.247047:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dceaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575174656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444137.250153:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575174784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444137.250231:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444137.250329:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575174784 00000100:00100000:0.0:1783444137.250338:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575174784 00000100:00100000:0.0:1783444137.250478:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:0.0:1783444137.250488:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575174784:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1783444137.250496:0:8423:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1783444137.250525:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444137.250587:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575174784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444137.250595:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:3.0:1783444137.250691:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575174784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444137.760190:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575174912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444137.760272:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444137.760329:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444137.760337:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dceac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575175040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444137.760374:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444137.760412:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444137.760420:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575175168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444137.760446:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444137.760477:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575175040 00000100:00100000:3.0:1783444137.760484:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575175040 00000100:00100000:3.0:1783444137.760523:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575175168 00000100:00100000:3.0:1783444137.760526:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575175168 00000100:00100000:3.0:1783444137.760540:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738 00000100:00100000:3.0:1783444137.760548:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575175040:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:3.0:1783444137.760555:0:8423:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783444137.760577:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444137.760627:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575175040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444137.760635:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738 00000100:00100000:3.0:1783444137.760653:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739 00000100:00100000:3.0:1783444137.760660:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575175168:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:3.0:1783444137.760664:0:8423:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783444137.760676:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444137.760698:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dceac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575175040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444137.760716:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575175168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444137.760723:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739 00000100:00100000:3.0:1783444137.760757:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575175168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444137.761174:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575174912 00000100:00100000:2.0:1783444137.761181:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575174912 00000100:00100000:2.0:1783444137.761223:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:2.0:1783444137.761231:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575174912:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1783444137.761235:0:29151:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783444137.761260:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:2.0:1783444137.761478:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575174912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444137.761495:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00100000:2.0:1783444137.761530:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575174912:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1783444137.765269:0:83281:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:3.0:1783444137.768266:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969449 is committed 00010000:00010000:0.0:1783444137.889780:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444138.909022:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444138.970119:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444138.970181:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557736064 00000100:00100000:0.0:1783444138.970192:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557736064 00000100:00100000:0.0:1783444138.970258:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1007 00000100:00100000:0.0:1783444138.970269:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64132:x1870073557736064:12345-192.168.204.20@tcp:101:lfs.0 00000020:02000000:0.0:1783444138.970277:0:66223:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1783444138.970295:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444138.970330:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e38313e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc99399ed expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783444138.975914:0:66223:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5531us 00010000:00010000:2.0:1783444138.997514:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38313f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444138.997540:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38313f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444138.997553:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38313f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444138.997607:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444138.997611:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1783444138.997655:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38313f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444138.997693:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e38313e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399ed expref: 7 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444138.997712:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38313f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399ed expref: 6 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444138.997721:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368d1a64b00) 00010000:00010000:2.0:1783444138.997724:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444138.997729:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583fa00, rc 0) 00000100:00100000:2.0:1783444138.997977:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64132:x1870073557736064:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 27708us (27866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444138.997996:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1007 00000100:00100000:3.0:1783444139.007865:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444139.007954:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557736192 00000100:00100000:2.0:1783444139.007965:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557736192 00000100:00100000:2.0:1783444139.008022:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1008 00000100:00100000:2.0:1783444139.008033:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64132:x1870073557736192:12345-192.168.204.20@tcp:41:lfs.0 00000020:02000000:2.0:1783444139.008041:0:80475:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783444139.008080:0:80475:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:2.0:1783444139.008161:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64132:x1870073557736192:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 130us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444139.008169:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1008 00000100:00100000:3.0:1783444139.020638:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444139.023453:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557736320 00000100:00100000:2.0:1783444139.023470:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557736320 00000100:00100000:2.0:1783444139.026748:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1009 00000100:00100000:2.0:1783444139.026767:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64132:x1870073557736320:12345-192.168.204.20@tcp:41:lfs.0 00000020:02000000:2.0:1783444139.026775:0:71469:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1783444139.026833:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444139.026912:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64132:x1870073557736320:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 152us (6286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444139.026920:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1009 00000100:00080000:3.0:1783444139.032755:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444139.032913:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444139.033126:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557736448 00000100:00100000:3.0:1783444139.033135:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557736448 00000100:00100000:3.0:1783444139.033192:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1740 00000100:00100000:3.0:1783444139.033200:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64132:x1870073557736448:12345-192.168.204.20@tcp:13:lfs.0 00000020:02000000:3.0:1783444139.033208:0:8423:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1783444139.033238:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444139.033308:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64132:x1870073557736448:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 107us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444139.033325:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1740 00000100:00100000:2.0:1783444139.039474:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444139.039578:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557736576 00000100:00100000:1.0:1783444139.039589:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557736576 00000100:00100000:1.0:1783444139.039666:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1741 00000100:00100000:1.0:1783444139.039677:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64132:x1870073557736576:12345-192.168.204.20@tcp:13:lfs.0 00000020:02000000:1.0:1783444139.039685:0:8424:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1783444139.039718:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444139.039839:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64132:x1870073557736576:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 162us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444139.039847:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1741 00000100:00080000:3.0:1783444139.039971:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444139.070439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444139.070731:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557736704 00000100:00100000:3.0:1783444139.070742:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557736704 00000100:00100000:3.0:1783444139.070843:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1010 00000100:00100000:3.0:1783444139.070854:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:63657:x1870073557736704:12345-192.168.204.20@tcp:101:multiop.0 00000020:02000000:3.0:1783444139.070862:0:67017:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1783444139.070883:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444139.070907:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38313f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc99399f4 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.070975:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.070990:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071003:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071034:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071042:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071049:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071222:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383140c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071230:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383140c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071237:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383140c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444139.071273:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:3.0:1783444139.071277:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1783444139.071330:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383140c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071343:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383140c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071352:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071359:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071376:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071382:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071388:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444139.071392:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071400:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071413:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368d1a64b00) 00010000:00010000:3.0:1783444139.071415:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444139.071420:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071426:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38313fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071439:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071446:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071452:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071457:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444139.071467:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071474:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071482:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9368f57c6000) 00010000:00010000:3.0:1783444139.071485:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444139.071488:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071495:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831405 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071530:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38313f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399f4 expref: 8 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071544:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383140c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399f4 expref: 7 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444139.071552:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9368f57c6400) 00010000:00010000:3.0:1783444139.071554:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444139.071636:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26800, rc 0) 00000100:00100000:3.0:1783444139.071702:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+7:63657:x1870073557736704:12345-192.168.204.20@tcp:101:multiop.0 Request processed in 849us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444139.071710:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1010 00000100:00100000:3.0:1783444139.804910:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575175296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444139.804987:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444139.805047:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575175296 00000100:00100000:3.0:1783444139.805062:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575175296 00000100:00100000:3.0:1783444139.806233:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1783444139.806248:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575175296:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:3.0:1783444139.806256:0:8431:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1783444139.806285:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444139.806437:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575175296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 192us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444139.806444:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1783444139.806500:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575175296:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783444139.933018:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444140.957184:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444141.857173:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575175424:0@lo:400:kworker.0 00000100:00100000:0.0:1783444141.857292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444141.857425:0:83290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575175424 00000100:00100000:1.0:1783444141.857433:0:83290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575175424 00000100:00100000:1.0:1783444141.857552:0:83290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783444141.857565:0:83290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575175424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444141.861468:0:83290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575175424:12345-0@lo:400:kworker.0 Request processed in 3898us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444141.861550:0:83290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783444141.866644:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575175552:0@lo:400:kworker.0 00000100:00100000:3.0:1783444141.866722:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444141.866823:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575175552 00000100:00100000:3.0:1783444141.866832:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575175552 00000100:00100000:2.0:1783444141.867057:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575175680:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.867088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444141.867166:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575175680 00000100:00100000:2.0:1783444141.867170:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575175680 00000100:00100000:2.0:1783444141.867204:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1783444141.867224:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575175552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.867293:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575175552:12345-0@lo:400:kworker.0 Request processed in 72us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.867301:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1783444141.867320:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1783444141.867327:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575175680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.867556:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575175680:12345-0@lo:400:kworker.0 Request processed in 229us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.867563:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1783444141.867606:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575175552:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.867642:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575175808:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.867666:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444141.867703:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575175680:0@lo:400:kworker.0 00000100:00100000:1.0:1783444141.867856:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575175808 00000100:00100000:1.0:1783444141.867862:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575175808 00000100:00100000:1.0:1783444141.867901:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1783444141.867908:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575175808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.867933:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444141.867942:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575175936:0@lo:400:kworker.0 00000100:00100000:1.0:1783444141.867963:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575175808:12345-0@lo:400:kworker.0 Request processed in 55us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444141.867970:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1783444141.868674:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444141.868704:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575175808:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.868718:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575175936 00000100:00100000:2.0:1783444141.868723:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575175936 00000100:00100000:2.0:1783444141.868763:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1783444141.868772:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575175936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.868838:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575175936:12345-0@lo:400:kworker.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.868847:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1783444141.868857:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575175936:0@lo:400:kworker.0 00000100:00100000:1.0:1783444141.868886:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575176064:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.868905:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575176192:0@lo:400:kworker.0 00000100:00100000:0.0:1783444141.869035:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575175424:0@lo:400:kworker.0 00000100:00100000:1.0:1783444141.870267:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444141.870279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444141.870335:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575176064 00000100:00100000:2.0:1783444141.870336:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575176192 00000100:00100000:1.0:1783444141.870343:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575176064 00000100:00100000:2.0:1783444141.870351:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575176192 00000100:00100000:1.0:1783444141.870386:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:1.0:1783444141.870397:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575176064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.870398:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:2.0:1783444141.870414:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575176192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444141.870465:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575176064:12345-0@lo:400:kworker.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.870470:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575176192:12345-0@lo:400:kworker.0 Request processed in 59us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.870478:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:2.0:1783444141.870520:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575176192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.870565:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575176320:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.870590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444141.870617:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575176320 00000100:00100000:2.0:1783444141.870621:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575176320 00000100:00100000:2.0:1783444141.870646:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:2.0:1783444141.870653:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575176320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.870687:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575176320:12345-0@lo:400:kworker.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.870693:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00100000:2.0:1783444141.870722:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575176320:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.870768:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575176704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.870809:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444141.870836:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575176704 00000100:00100000:2.0:1783444141.870840:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575176704 00000100:00100000:2.0:1783444141.870868:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:2.0:1783444141.870875:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575176704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.870909:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575176704:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.870914:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:2.0:1783444141.870950:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575176704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.870979:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575176832:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.871002:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444141.871046:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575176448:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.871070:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444141.871091:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575176448 00000100:00100000:2.0:1783444141.871094:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575176448 00000100:00100000:2.0:1783444141.871121:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1783444141.871127:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575176448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.871154:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575176448:12345-0@lo:400:kworker.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.871159:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1783444141.871185:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575176448:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.871191:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575176960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.871213:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444141.871233:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575176960 00000100:00100000:2.0:1783444141.871236:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575176960 00000100:00100000:2.0:1783444141.871258:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:2.0:1783444141.871280:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575176960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444141.871310:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575176960:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444141.871316:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:2.0:1783444141.871343:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575176960:0@lo:400:kworker.0 00000100:00100000:3.0:1783444141.873001:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575176832 00000100:00100000:3.0:1783444141.873012:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575176832 00000100:00100000:3.0:1783444141.873070:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:3.0:1783444141.873080:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575176832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444141.873143:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575176832:12345-0@lo:400:kworker.0 Request processed in 65us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444141.873151:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:3.0:1783444141.873202:0:3634:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:3.0:1783444141.873222:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575176832:0@lo:400:kworker.0 00000100:00100000:1.0:1783444141.873804:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:1.0:1783444141.873850:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575176576:0@lo:400:kworker.0 00000100:00100000:1.0:1783444141.873894:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444141.873986:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444141.873992:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444141.873995:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444141.873998:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444141.874550:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575176064:0@lo:400:kworker.0 00000100:00100000:3.0:1783444141.876574:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575176576 00000100:00100000:3.0:1783444141.876587:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575176576 00000100:00100000:3.0:1783444141.876639:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:3.0:1783444141.876649:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575176576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444141.876746:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575176576:12345-0@lo:400:kworker.0 Request processed in 99us (2851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444141.876754:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:1.0:1783444141.877192:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575176576:0@lo:400:kworker.0 00010000:00010000:3.0:1783444141.983016:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444142.118029:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444142.118190:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557736960 00000100:00100000:0.0:1783444142.118201:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557736960 00000100:00080000:3.0:1783444142.118291:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444142.118303:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1011 00000100:00100000:0.0:1783444142.118327:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:64250:x1870073557736960:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1783444142.118386:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783444142.118414:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383140c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399f4 expref: 7 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118436:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9368f57c6400) 00010000:00010000:0.0:1783444142.118464:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38313f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399ed expref: 6 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118476:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368d1a64b00) 00010000:00010000:0.0:1783444142.118484:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444142.118515:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118530:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118547:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118559:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118566:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118573:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118662:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118671:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.118677:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783444142.118982:0:71469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].2, 64 off8320 00000004:00080000:0.0:1783444142.119001:0:71469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3133161210619ns, next at 3134161208386ns, rc = 0 00010000:00010000:0.0:1783444142.119063:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119073:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119081:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119088:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119094:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119100:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119127:0:71469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444142.119157:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444142.119161:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444142.119167:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119171:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444142.119184:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444142.119184:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444142.119193:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119194:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444142.119201:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444142.119208:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119223:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119268:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9368d1a64700) 00010000:00010000:0.0:1783444142.119272:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783444142.119276:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119282:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831421 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119298:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119303:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119308:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119314:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119319:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444142.119322:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119329:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119336:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368d1a64000) 00010000:00010000:0.0:1783444142.119344:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444142.119348:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119354:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831413 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444142.119367:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff10c24f reply state 0000000027c909d8 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119380:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444142.119386:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9368d1a64800) 00010000:00010000:0.0:1783444142.119388:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444142.119391:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444142.119477:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:64250:x1870073557736960:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1162us (1457us total) trans 98784247809 rc 0/0 00000100:00100000:0.0:1783444142.119485:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1011 00010000:00010000:3.0:1783444142.122333:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9368d1a64700) 00010000:00010000:3.0:1783444142.122345:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783444142.122355:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444142.122365:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831428 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444142.122392:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444142.122394:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444142.122397:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444142.162693:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444142.162740:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444142.162770:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444142.162839:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444142.162873:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557737472 00000100:00100000:3.0:1783444142.162884:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557737472 00000100:00100000:3.0:1783444142.162938:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557737344 00000100:00100000:3.0:1783444142.162941:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557737344 00000100:00100000:3.0:1783444142.162964:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2222 00000100:00100000:3.0:1783444142.162973:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557737472:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444142.163042:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557737472:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 70us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444142.163050:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2222 00000100:00100000:3.0:1783444142.163066:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2223 00000100:00100000:3.0:1783444142.163072:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557737344:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444142.163095:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557737344:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444142.163101:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2223 00000100:00100000:3.0:1783444142.163117:0:83288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557737088 00000100:00100000:3.0:1783444142.163121:0:83288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557737088 00000100:00100000:3.0:1783444142.163153:0:83288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:3.0:1783444142.163159:0:83288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557737088:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444142.163184:0:83288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557737088:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444142.163191:0:83288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00080000:3.0:1783444142.163228:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444142.163232:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444142.163549:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557737216 00000100:00100000:2.0:1783444142.163554:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557737216 00000100:00100000:2.0:1783444142.163615:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 738 00000100:00100000:2.0:1783444142.163624:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557737216:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444142.163664:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557737216:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444142.163671:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 738 00000100:00080000:3.0:1783444142.163753:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444142.365113:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dceac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575177088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444142.365211:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444142.365332:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575177088 00000100:00100000:0.0:1783444142.365341:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575177088 00000100:00100000:0.0:1783444142.365407:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:0.0:1783444142.365417:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575177088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444142.365447:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444142.365493:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575177088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444142.365499:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:1.0:1783444142.365594:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dceac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575177088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783444142.366035:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444142.366188:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575177216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444142.366224:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444142.366314:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575177216 00000100:00100000:0.0:1783444142.366320:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575177216 00000100:00100000:0.0:1783444142.366370:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1783444142.366386:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575177216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444142.366409:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444142.366457:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575177216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444142.366463:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00080000:1.0:1783444142.366525:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444142.366554:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575177216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444142.877899:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575177344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444142.877979:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444142.878091:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575177344 00000100:00100000:3.0:1783444142.878100:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575177344 00000100:00100000:3.0:1783444142.878209:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744 00000100:00100000:3.0:1783444142.878218:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575177344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444142.878250:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444142.878296:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575177344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444142.878303:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744 00000100:00100000:3.0:1783444142.878327:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575177472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444142.878351:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444142.878383:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444142.878393:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575177472 00000100:00100000:3.0:1783444142.878397:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575177472 00000100:00100000:3.0:1783444142.878424:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:3.0:1783444142.878430:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575177472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444142.878445:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444142.878477:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575177472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444142.878484:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00080000:3.0:1783444142.878500:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444142.878539:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575177472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444142.878579:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575177344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444142.884394:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444142.884420:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575177600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444142.884514:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444142.884567:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575177600 00000100:00100000:3.0:1783444142.884575:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575177600 00000100:00100000:3.0:1783444142.884633:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:3.0:1783444142.884643:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575177600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444142.884679:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:3.0:1783444142.884725:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575177600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444142.884732:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:3.0:1783444142.884772:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575177600:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783444143.005781:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444144.030576:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444144.925137:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575177728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444144.925236:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444144.925339:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575177728 00000100:00100000:1.0:1783444144.925349:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575177728 00000100:00100000:1.0:1783444144.925417:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:1.0:1783444144.925427:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575177728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444144.925467:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444144.926197:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575177728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 769us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444144.926217:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:0.0:1783444144.932462:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575177728:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783444145.053232:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444146.079467:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444146.973210:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575177856:0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.973291:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444146.973331:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575178368:0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.973357:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444146.973375:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575178880:0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.973390:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575178112:0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.973395:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444146.973411:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575179392:0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.973418:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444146.973437:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575178624:0@lo:400:kworker.0 00000100:00100000:3.0:1783444146.973481:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575177984:0@lo:400:kworker.0 00000100:00100000:0.0:1783444146.973525:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575178240:0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.973772:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444146.973838:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575178368 00000100:00100000:2.0:1783444146.973845:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575178368 00000100:00100000:2.0:1783444146.973894:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575178880 00000100:00100000:2.0:1783444146.973897:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575178880 00000100:00100000:2.0:1783444146.973913:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575178112 00000100:00100000:2.0:1783444146.973916:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575178112 00000100:00100000:2.0:1783444146.973928:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575179392 00000100:00100000:2.0:1783444146.973930:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575179392 00000100:00100000:2.0:1783444146.973942:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1783444146.973949:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575178368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.973997:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575178368:12345-0@lo:400:kworker.0 Request processed in 47us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444146.974003:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1783444146.974031:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1783444146.974036:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575178880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.974064:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575178880:12345-0@lo:400:kworker.0 Request processed in 28us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444146.974070:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1783444146.974080:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1783444146.974085:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575178112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.974105:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575178112:12345-0@lo:400:kworker.0 Request processed in 21us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444146.974110:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1783444146.974118:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1783444146.974286:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575179392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.974315:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575179392:12345-0@lo:400:kworker.0 Request processed in 90us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444146.974322:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1783444146.974372:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575178368:0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.974384:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575178880:0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.974393:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575179392:0@lo:400:kworker.0 00000100:00080000:2.0:1783444146.974437:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444146.974468:0:83290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575177856 00000100:00100000:2.0:1783444146.974471:0:83290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575177856 00000100:00100000:2.0:1783444146.974497:0:83290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783444146.974504:0:83290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575177856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.974624:0:83290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575177856:12345-0@lo:400:kworker.0 Request processed in 120us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444146.974636:0:83290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783444146.974669:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575177856:0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.975409:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444146.975453:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575179136:0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.975478:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444146.975510:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575178112:0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.975547:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575178624 00000100:00100000:1.0:1783444146.975552:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575178624 00000100:00100000:1.0:1783444146.975594:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575179136 00000100:00100000:1.0:1783444146.975598:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575179136 00000100:00100000:1.0:1783444146.975620:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:1.0:1783444146.975627:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575178624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.975669:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575178624:12345-0@lo:400:kworker.0 Request processed in 43us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444146.975676:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00000100:00100000:1.0:1783444146.975906:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:1.0:1783444146.975916:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575179136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.975948:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575179136:12345-0@lo:400:kworker.0 Request processed in 35us (469us total) trans 0 rc 0/0 00000100:00080000:2.0:1783444146.976383:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444146.976422:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00100000:1.0:1783444146.976459:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575178624:0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.976469:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575179136:0@lo:400:kworker.0 00000100:00100000:3.0:1783444146.979150:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444146.979291:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575178496:0@lo:400:kworker.0 00000100:00100000:3.0:1783444146.979331:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444146.979556:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575179008:0@lo:400:kworker.0 00000100:00100000:3.0:1783444146.979584:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444146.982017:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575178496 00000100:00100000:1.0:1783444146.982032:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575178496 00000100:00100000:1.0:1783444146.982104:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575179008 00000100:00100000:1.0:1783444146.982107:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575179008 00000100:00100000:1.0:1783444146.982136:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:1.0:1783444146.982145:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575178496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.982246:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575178496:12345-0@lo:400:kworker.0 Request processed in 102us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444146.982253:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:1.0:1783444146.982271:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:1.0:1783444146.982276:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575179008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444146.982303:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575179008:12345-0@lo:400:kworker.0 Request processed in 27us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444146.982324:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:3.0:1783444146.983137:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575178496:0@lo:400:kworker.0 00000100:00100000:3.0:1783444146.983152:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575179008:0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.983279:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575177984 00000100:00100000:2.0:1783444146.983286:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575177984 00000100:00100000:2.0:1783444146.983340:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1783444146.983347:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575177984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783444146.983529:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444146.983637:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575177984:12345-0@lo:400:kworker.0 Request processed in 290us (4495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444146.983644:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:3.0:1783444146.983719:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575177984:0@lo:400:kworker.0 00000100:00100000:0.0:1783444146.986044:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444146.986099:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575178752:0@lo:400:kworker.0 00000100:00100000:0.0:1783444146.986140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444146.986174:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575179264:0@lo:400:kworker.0 00000100:00100000:0.0:1783444146.986195:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444146.986650:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575178240 00000100:00100000:2.0:1783444146.986659:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575178240 00000100:00100000:2.0:1783444146.986731:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1783444146.986740:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575178240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444146.986783:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575178752 00000100:00100000:3.0:1783444146.986812:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575178752 00000100:00100000:2.0:1783444146.986829:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575178240:12345-0@lo:400:kworker.0 Request processed in 87us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444146.986837:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1783444146.986858:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575179264 00000100:00100000:3.0:1783444146.986863:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575179264 00000100:00100000:3.0:1783444146.986885:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226 00000100:00100000:3.0:1783444146.986893:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575178752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444146.986896:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:2.0:1783444146.986909:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575179264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444146.986951:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575178752:12345-0@lo:400:kworker.0 Request processed in 57us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444146.986959:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575179264:12345-0@lo:400:kworker.0 Request processed in 50us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444146.986961:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226 00000100:00100000:2.0:1783444146.986971:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00080000:0.0:1783444146.988826:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444146.988838:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444146.988890:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575178240:0@lo:400:kworker.0 00000100:00100000:0.0:1783444146.988906:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575178752:0@lo:400:kworker.0 00000100:00100000:0.0:1783444146.988916:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575179264:0@lo:400:kworker.0 00010000:00010000:1.0:1783444147.104033:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444147.275274:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444147.275328:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444147.275355:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444147.275385:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444147.275411:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444147.275439:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557738112 00000100:00100000:3.0:1783444147.275448:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557738112 00000100:00100000:3.0:1783444147.275505:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557737984 00000100:00100000:3.0:1783444147.275508:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557737984 00000100:00100000:3.0:1783444147.275534:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2228 00000100:00100000:3.0:1783444147.275544:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557738112:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444147.275618:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557738112:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 75us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444147.275626:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2228 00000100:00100000:3.0:1783444147.275644:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2229 00000100:00100000:3.0:1783444147.275650:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557737984:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444147.275674:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557737984:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444147.275681:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2229 00000100:00100000:3.0:1783444147.275698:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557737856 00000100:00100000:3.0:1783444147.275714:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557737856 00000100:00100000:3.0:1783444147.275746:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557737728 00000100:00100000:3.0:1783444147.275749:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557737728 00000100:00100000:3.0:1783444147.275771:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 745 00000100:00100000:3.0:1783444147.275777:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557737856:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444147.275829:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557737856:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 52us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444147.275835:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 745 00000100:00100000:3.0:1783444147.275847:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 746 00000100:00100000:3.0:1783444147.275853:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2401:x1870073557737728:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444147.275881:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2401:x1870073557737728:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444147.276018:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 746 00000100:00080000:3.0:1783444147.276041:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444147.276045:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444147.276047:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444147.276049:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444147.276623:0:83288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557737600 00000100:00100000:1.0:1783444147.276630:0:83288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557737600 00000100:00100000:1.0:1783444147.276685:0:83288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 155 00000100:00100000:1.0:1783444147.276693:0:83288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2401:x1870073557737600:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444147.276738:0:83288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2401:x1870073557737600:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 46us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444147.276744:0:83288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 155 00000100:00100000:0.0:1783444147.489513:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444147.489536:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dceafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575179520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444147.489601:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444147.489658:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575179520 00000100:00100000:0.0:1783444147.489673:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575179520 00000100:00100000:0.0:1783444147.489716:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:0.0:1783444147.489724:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575179520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444147.489753:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444147.489816:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575179520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444147.489824:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:0.0:1783444147.489871:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dceafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575179520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444147.490244:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575179648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444147.490273:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444147.490340:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575179648 00000100:00100000:3.0:1783444147.490346:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575179648 00000100:00100000:3.0:1783444147.490378:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747 00000100:00100000:3.0:1783444147.490386:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575179648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444147.490404:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000004:00080000:2.0:1783444147.491248:0:83301:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3138533458087ns, next at 3139533455189ns, rc = 0 00000004:00080000:0.0:1783444147.511175:0:83281:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1783444147.511219:0:83281:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247809 is committed 00000004:00080000:0.0:1783444147.511226:0:83281:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1783444147.511256:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.511268:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.511276:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.511283:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444147.511289:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.511296:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.511328:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9368d1a64800) 00010000:00010000:0.0:1783444147.511331:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444147.511336:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.511343:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05e00/0x42cb6883e383141a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444147.511853:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444147.511874:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575179776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783444147.511950:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444147.511998:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575179776 00000100:00100000:1.0:1783444147.512004:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575179776 00000100:00100000:1.0:1783444147.512049:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5840 00000100:00100000:1.0:1783444147.512059:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575179776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783444147.512103:0:17653:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00010000:00010000:1.0:1783444147.512128:0:17653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.512150:0:17653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000733de030/0x42cb6883e3830fcf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399bc expref: 5 pid: 26202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.512172:0:17653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=211s v=(0 0) 00010000:00010000:1.0:1783444147.512176:0:17653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444147.512181:0:17653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.512217:0:17653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000733de030/0x42cb6883e3830fcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399bc expref: 5 pid: 26202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.512235:0:17653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000733de030/0x42cb6883e3830fcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399bc expref: 5 pid: 26202 timeout: 3238 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444147.512249:0:17653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17653:1870073575179904:192.168.204.20@tcp:104: 00000100:00100000:1.0:1783444147.512320:0:17653:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c13593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444147.523970:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575179648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444147.526270:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444147.526349:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557738240 00000100:00100000:0.0:1783444147.526362:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557738240 00010000:00010000:0.0:1783444147.526489:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000733de030/0x42cb6883e3830fcf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399bc expref: 6 pid: 26202 timeout: 3238 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444147.526829:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2539 00000100:00100000:0.0:1783444147.526996:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5936050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557738240:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444147.527028:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444147.527036:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000733de030/0x42cb6883e3830fcf lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399bc expref: 6 pid: 26202 timeout: 3238 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.527054:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000733de030/0x42cb6883e3830fcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399bc expref: 6 pid: 26202 timeout: 3238 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.527082:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444147.527087:0:6490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444147.527092:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.527110:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.527136:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444147.527214:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5936050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557738240:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 373us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444147.527223:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2539 00010000:00010000:1.0:1783444147.527491:0:17653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000733de030/0x42cb6883e3830fcf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399bc expref: 5 pid: 26202 timeout: 3238 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444147.527508:0:17653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17653:1870073575179904:192.168.204.20@tcp:104: 00010000:00010000:1.0:1783444147.527528:0:17653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.527539:0:17653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.527547:0:17653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.527558:0:17653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.527574:0:17653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444147.527599:0:17653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783444147.527870:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3634:x1870073575179776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15810us (15917us total) trans 4294969450 rc 0/0 00000100:00100000:1.0:1783444147.527879:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5840 00000004:00080000:1.0:1783444147.527923:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff936901851880/2, rc 0, transno 4294969450 00000100:00100000:1.0:1783444147.527929:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575179776:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783444147.528427:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444147.528434:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.528444:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444147.528448:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.528458:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.528476:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.528483:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005143b584/0x42cb6883e383142f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444147.528506:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444147.528517:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444147.528519:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444147.532931:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575179648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42533us (42644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444147.532948:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747 00000001:02000400:2.0:1783444147.885886:0:84009:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 13:09:07 (1783444147) 00000100:00100000:3.0:1783444147.997435:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575180032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444147.997513:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444147.997584:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c476b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575180160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444147.997612:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444147.997644:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575180032 00000100:00100000:3.0:1783444147.997652:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575180032 00000100:00100000:3.0:1783444147.997712:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:3.0:1783444147.997722:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575180032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444147.997758:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:3.0:1783444147.997822:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575180032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444147.997829:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:3.0:1783444147.997852:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575180160 00000100:00100000:3.0:1783444147.997856:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575180160 00000100:00100000:3.0:1783444147.997881:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748 00000100:00100000:3.0:1783444147.997887:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575180160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444147.997915:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444147.997952:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575180160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444147.997958:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748 00000100:00100000:3.0:1783444147.998000:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c476b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575180160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444147.998029:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575180032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444147.998168:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575180288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444147.998200:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444147.998233:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575180288 00000100:00100000:1.0:1783444147.998237:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575180288 00000100:00100000:1.0:1783444147.998264:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:1.0:1783444147.998270:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575180288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444147.998281:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444147.998314:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575180288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444147.998320:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00100000:1.0:1783444147.998350:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575180288:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444148.129177:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783444148.792697:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969450 is committed 00000100:00100000:0.0:1783444148.851759:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444148.851858:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557738368 00000100:00100000:3.0:1783444148.851868:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557738368 00000100:00100000:3.0:1783444148.851933:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1012 00000100:00100000:3.0:1783444148.851944:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64837:x1870073557738368:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444148.851965:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444148.851999:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc99399fb expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.852072:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383143d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.852087:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383143d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.852102:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383143d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444148.852157:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444148.852161:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1783444148.852184:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383143d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.852211:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399fb expref: 7 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.852229:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383143d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399fb expref: 6 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.852237:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6700) 00010000:00010000:3.0:1783444148.852240:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444148.852244:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26800, rc 0) 00000100:00100000:3.0:1783444148.852319:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64837:x1870073557738368:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 376us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444148.852326:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1012 00000100:00100000:3.0:1783444148.871624:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444148.871706:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557738496 00000100:00100000:2.0:1783444148.871723:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557738496 00000100:00100000:2.0:1783444148.871811:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1013 00000100:00100000:2.0:1783444148.871822:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64837:x1870073557738496:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1783444148.871856:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:2.0:1783444148.871925:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64837:x1870073557738496:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 106us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444148.871932:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1013 00000100:00100000:2.0:1783444148.878893:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444148.879199:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557738624 00000100:00100000:3.0:1783444148.879209:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557738624 00000100:00100000:3.0:1783444148.879275:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1014 00000100:00100000:3.0:1783444148.879284:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64837:x1870073557738624:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444148.879323:0:66223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444148.879528:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64837:x1870073557738624:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 244us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444148.879536:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1014 00000100:00100000:2.0:1783444148.887465:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444148.887721:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557738752 00000100:00100000:1.0:1783444148.887734:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557738752 00000100:00100000:1.0:1783444148.887832:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1750 00000100:00100000:1.0:1783444148.887842:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64837:x1870073557738752:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:1.0:1783444148.887880:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444148.887952:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64837:x1870073557738752:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 111us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444148.887959:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1750 00000100:00100000:3.0:1783444148.901063:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444148.903480:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557738880 00000100:00100000:1.0:1783444148.903498:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557738880 00000100:00100000:1.0:1783444148.903607:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1751 00000100:00100000:1.0:1783444148.903618:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64837:x1870073557738880:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:1.0:1783444148.903644:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444148.903730:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64837:x1870073557738880:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 113us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444148.903737:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1751 00000100:00100000:2.0:1783444148.961183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444148.967085:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557739008 00000100:00100000:1.0:1783444148.967099:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557739008 00000100:00100000:1.0:1783444148.967179:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1783444148.967190:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64844:x1870073557739008:12345-192.168.204.20@tcp:700:mcreate.0 00000100:00100000:1.0:1783444148.967292:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64844:x1870073557739008:12345-192.168.204.20@tcp:700:mcreate.0 Request processed in 103us (6114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444148.967299:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1783444148.978196:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444148.978318:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557739264 00000100:00100000:3.0:1783444148.978329:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557739264 00000100:00100000:3.0:1783444148.978391:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1015 00000100:00100000:3.0:1783444148.978401:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64844:x1870073557739264:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00010000:3.0:1783444148.978461:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444148.978491:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383143d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399fb expref: 6 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.978508:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6700) 00010000:00010000:3.0:1783444148.978520:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444148.978596:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.978612:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.978624:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.978636:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.978656:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.978663:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980208:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980223:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980230:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980237:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444148.980242:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980249:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980263:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:3.0:1783444148.980266:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444148.980271:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980277:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831444 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444148.980296:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086de1c0e reply state 00000000836898db transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980317:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444148.980324:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368f57c6300) 00010000:00010000:3.0:1783444148.980326:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444148.980329:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444148.980825:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+7:64844:x1870073557739264:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 2421us (2635us total) trans 98784247810 rc 0/0 00000100:00100000:3.0:1783444148.980834:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1015 00000100:00100000:1.0:1783444149.004510:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444149.004592:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557739392 00000100:00100000:2.0:1783444149.004601:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557739392 00000100:00100000:2.0:1783444149.004674:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1016 00000100:00100000:2.0:1783444149.004684:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:64847:x1870073557739392:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1783444149.004711:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444149.004732:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3831452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a02 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.004919:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3831459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.004932:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3831459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.004943:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3831459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444149.004986:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444149.004989:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1783444149.005026:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3831459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.005049:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3831452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a02 expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.005065:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3831459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a02 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.005073:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7f86c00) 00010000:00010000:2.0:1783444149.005076:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444149.005080:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f400, rc 0) 00000100:00080000:3.0:1783444149.005312:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444149.005348:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:64847:x1870073557739392:12345-192.168.204.20@tcp:101:rm.0 Request processed in 665us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444149.005355:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1016 00000100:00100000:0.0:1783444149.010184:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444149.014566:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557739520 00000100:00100000:2.0:1783444149.014584:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557739520 00000100:00100000:2.0:1783444149.014665:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1017 00000100:00100000:2.0:1783444149.014675:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:64847:x1870073557739520:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1783444149.014696:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444149.014718:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3831460 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a09 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.015022:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.015040:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.015052:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.015453:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.015463:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.015472:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016036:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831475 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016045:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831475 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016053:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831475 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444149.016106:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x1:0x0]: returning size 0 00000004:00200000:1.0:1783444149.016110:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1783444149.016488:0:71469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831475 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016522:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831475 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016541:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016548:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016555:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016561:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016568:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fa00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444149.016572:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016592:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016618:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7f86c00) 00010000:00010000:1.0:1783444149.016622:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444149.016627:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016633:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016666:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016673:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016678:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016683:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444149.016686:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016691:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016699:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368f57c6300) 00010000:00010000:1.0:1783444149.016701:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444149.016704:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016720:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54200/0x42cb6883e383146e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.016777:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3831460 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a09 expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.019101:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831475 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a09 expref: 9 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444149.019119:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9368c3cb1e00) 00010000:00010000:1.0:1783444149.019122:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444149.019136:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6a54000, rc 0) 00000100:00100000:1.0:1783444149.019346:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+9:64847:x1870073557739520:12345-192.168.204.20@tcp:101:rm.0 Request processed in 4670us (9178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444149.019356:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1017 00000100:00100000:0.0:1783444149.045039:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444149.045179:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557739776 00000100:00100000:2.0:1783444149.045190:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557739776 00000100:00100000:2.0:1783444149.045250:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1018 00000100:00100000:2.0:1783444149.045259:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dceaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:64847:x1870073557739776:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1783444149.045315:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783444149.045340:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831475 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a09 expref: 9 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045360:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9368c3cb1e00) 00010000:00010000:2.0:1783444149.045375:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3831459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a02 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045387:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7f86c00) 00010000:00010000:2.0:1783444149.045393:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444149.045416:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045429:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045440:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045451:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045460:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045496:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045621:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045629:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045636:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045959:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045969:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045976:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045983:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045989:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.045995:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046017:0:66226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444149.046038:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046051:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046056:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046061:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444149.046066:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046072:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046082:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9368e7f86f00) 00010000:00010000:2.0:1783444149.046085:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783444149.046088:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046094:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e383148a lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046113:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046118:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046123:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046140:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046152:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583ea00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444149.046155:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046161:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046170:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7f86e00) 00010000:00010000:2.0:1783444149.046173:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444149.046175:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.046181:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e383147c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444149.046231:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444149.046239:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444149.046246:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fa00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444149.046250:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444149.046256:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444149.046265:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9368e7f86f00) 00010000:00010000:3.0:1783444149.046268:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783444149.046270:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444149.046275:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3831491 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444149.047935:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444149.047955:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444149.047958:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1783444149.050105:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000788235b9 reply state 000000001215cf1c transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.050142:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444149.050152:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368f57c6300) 00010000:00010000:2.0:1783444149.050155:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444149.050161:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444149.050304:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dceaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:64847:x1870073557739776:12345-192.168.204.20@tcp:36:rm.0 Request processed in 5041us (5269us total) trans 98784247811 rc 0/0 00000100:00100000:2.0:1783444149.050314:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1018 00010000:00010000:1.0:1783444149.154011:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444150.047303:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c476b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575180416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444150.047374:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444150.047426:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575180416 00000100:00100000:2.0:1783444150.047437:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575180416 00000100:00100000:2.0:1783444150.047507:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:2.0:1783444150.047524:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575180416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444150.048329:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444150.048395:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575180416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 871us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444150.048403:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:1.0:1783444150.048758:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c476b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575180416:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783444150.180953:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444151.203047:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444152.093013:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575180544:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093102:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093143:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575181056:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093172:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093189:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575181568:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093208:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093225:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575182080:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093246:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093302:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783444152.093308:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575180928:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093330:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093347:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575181440:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093366:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093379:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575181952:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093395:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093415:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575180800:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093448:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575181312:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093483:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093499:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575181824:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.093519:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.093535:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783444152.093541:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575180672:0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.094766:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575181056 00000100:00100000:3.0:1783444152.094777:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575181056 00000100:00100000:3.0:1783444152.094849:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575181568 00000100:00100000:3.0:1783444152.094854:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575181568 00000100:00100000:3.0:1783444152.094869:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575182080 00000100:00100000:3.0:1783444152.094872:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575182080 00000100:00100000:3.0:1783444152.094883:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575180928 00000100:00100000:3.0:1783444152.094885:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575180928 00000100:00100000:3.0:1783444152.094897:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575180800 00000100:00100000:3.0:1783444152.094899:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575180800 00000100:00100000:3.0:1783444152.094919:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1783444152.094928:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575181056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.094997:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575181056:12345-0@lo:400:kworker.0 Request processed in 70us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095004:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1783444152.095020:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1783444152.095026:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575181568:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783444152.095038:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c33f1880 x1870073575181568/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1783444163 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444152.095078:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575181568:12345-0@lo:400:kworker.0 Request processed in 41us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095085:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1783444152.095096:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1783444152.095102:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575182080:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783444152.095112:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c33f0000 x1870073575182080/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1783444163 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444152.095154:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575182080:12345-0@lo:400:kworker.0 Request processed in 53us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095160:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1783444152.095172:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1783444152.095178:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575180928:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783444152.095188:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c33f4000 x1870073575180928/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1783444163 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444152.095213:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575180928:12345-0@lo:400:kworker.0 Request processed in 35us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095218:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1783444152.095229:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1783444152.095234:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575180800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.095259:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575180800:12345-0@lo:400:kworker.0 Request processed in 26us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095264:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1783444152.095285:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575181440 00000100:00100000:3.0:1783444152.095288:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575181440 00000100:00100000:3.0:1783444152.095313:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575181952 00000100:00100000:3.0:1783444152.095316:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575181952 00000100:00100000:3.0:1783444152.095335:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575181312 00000100:00100000:3.0:1783444152.095338:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575181312 00000100:00100000:3.0:1783444152.095357:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575181824 00000100:00100000:3.0:1783444152.095359:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575181824 00000100:00100000:3.0:1783444152.095376:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230 00000100:00100000:3.0:1783444152.095382:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575181440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.095413:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575181440:12345-0@lo:400:kworker.0 Request processed in 31us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095425:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230 00000100:00100000:3.0:1783444152.095437:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231 00000100:00100000:3.0:1783444152.095443:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575181952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.095471:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575181952:12345-0@lo:400:kworker.0 Request processed in 28us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095476:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231 00000100:00100000:3.0:1783444152.095486:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232 00000100:00100000:3.0:1783444152.095492:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575181312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.095517:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575181312:12345-0@lo:400:kworker.0 Request processed in 25us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095523:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232 00000100:00100000:3.0:1783444152.095533:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:3.0:1783444152.095539:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575181824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.095579:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575181824:12345-0@lo:400:kworker.0 Request processed in 40us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.095585:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00100000:2.0:1783444152.095831:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.095867:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575181184:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.095903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.095922:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575181696:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.095944:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.095990:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575180800:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.096004:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575181312:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.096016:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575181824:0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.096052:0:83290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575180544 00000100:00100000:2.0:1783444152.096056:0:83290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575180544 00000100:00100000:2.0:1783444152.096096:0:83290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783444152.096103:0:83290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575180544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444152.096139:0:83290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c541d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575180544:12345-0@lo:400:kworker.0 Request processed in 36us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444152.096145:0:83290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783444152.096175:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575180672 00000100:00100000:2.0:1783444152.096178:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575180672 00000100:00100000:2.0:1783444152.096204:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:2.0:1783444152.096210:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575180672:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444152.096233:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff667100 x1870073575180672/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1783444163 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444152.096278:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575180672:12345-0@lo:400:kworker.0 Request processed in 67us (2714us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444152.096284:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1783444152.096444:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575180672:0@lo:400:kworker.0 00000100:00080000:3.0:1783444152.096713:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444152.096718:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444152.096721:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444152.096723:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444152.096749:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575181184 00000100:00100000:3.0:1783444152.096753:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575181184 00000100:00100000:3.0:1783444152.096804:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575181696 00000100:00100000:3.0:1783444152.096809:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575181696 00000100:00100000:3.0:1783444152.096836:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:3.0:1783444152.096843:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575181184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444152.096849:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:0.0:1783444152.096860:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575181696:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783444152.096873:0:29151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff666300 x1870073575181184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:528/0 lens 224/224 e 0 to 0 dl 1783444163 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444152.096914:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575181184:12345-0@lo:400:kworker.0 Request processed in 71us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.096920:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:3.0:1783444152.096959:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575180928:0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.096975:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575181440:0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.096985:0:3634:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000004:00080000:3.0:1783444152.096991:0:3634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff936901851880, transno 4294969450 00000100:00100000:3.0:1783444152.097003:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575181952:0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.097016:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575180544:0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.097028:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575181056:0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.097041:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575181568:0@lo:400:kworker.0 00000100:00100000:3.0:1783444152.097052:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575182080:0@lo:400:kworker.0 00000100:00100000:0.0:1783444152.097162:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575181696:12345-0@lo:400:kworker.0 Request processed in 304us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444152.097170:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:0.0:1783444152.097213:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575181184:0@lo:400:kworker.0 00000100:00100000:0.0:1783444152.097226:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575181696:0@lo:400:kworker.0 00010000:00010000:3.0:1783444152.221049:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444152.405208:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444152.405265:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444152.405288:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444152.405304:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444152.405326:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444152.405358:0:83288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557739904 00000100:00100000:2.0:1783444152.405367:0:83288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557739904 00000100:00100000:2.0:1783444152.405418:0:83288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:2.0:1783444152.405427:0:83288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c541d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557739904:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444152.405498:0:83288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c541d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557739904:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 71us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444152.405505:0:83288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:2.0:1783444152.405538:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557740160 00000100:00100000:2.0:1783444152.405541:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557740160 00000100:00100000:2.0:1783444152.405573:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557740032 00000100:00100000:2.0:1783444152.405576:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557740032 00000100:00100000:2.0:1783444152.405595:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 753 00000100:00100000:2.0:1783444152.405600:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557740160:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444152.405625:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557740160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444152.405630:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 753 00000100:00100000:2.0:1783444152.405655:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 754 00000100:00100000:2.0:1783444152.405661:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2402:x1870073557740032:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000080:2.0:1783444152.405677:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c33f2680 x1870073557740032/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:528/0 lens 224/224 e 0 to 0 dl 1783444163 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444152.405703:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2402:x1870073557740032:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444152.405709:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 754 00000100:00100000:2.0:1783444152.405726:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557740416 00000100:00100000:2.0:1783444152.405729:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557740416 00000100:00100000:2.0:1783444152.405753:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557740288 00000100:00100000:2.0:1783444152.405756:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557740288 00000100:00100000:2.0:1783444152.405773:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2234 00000100:00100000:2.0:1783444152.405778:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557740416:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444152.405817:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557740416:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444152.405823:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2234 00000100:00100000:2.0:1783444152.405835:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2235 00000100:00100000:2.0:1783444152.405840:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ead7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557740288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444152.405859:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ead7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557740288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 20us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444152.405864:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2235 00000100:00080000:2.0:1783444152.405999:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444152.406004:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444152.406006:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444152.406009:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444152.606007:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444152.606042:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ead79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575182208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444152.606328:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444152.606495:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575182208 00000100:00100000:3.0:1783444152.606504:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575182208 00000100:00100000:3.0:1783444152.606565:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752 00000100:00100000:3.0:1783444152.606575:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ead7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575182208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444152.606618:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444152.606666:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ead7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575182208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444152.606673:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752 00000100:00100000:3.0:1783444152.606739:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ead79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575182208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444152.608151:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c476b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575182336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444152.608202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444152.610101:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575182336 00000100:00100000:2.0:1783444152.610116:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575182336 00000100:00100000:2.0:1783444152.610171:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:2.0:1783444152.610182:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575182336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444152.610214:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444152.610294:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575182336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444152.610302:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00100000:2.0:1783444152.610365:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c476b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575182336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444153.117004:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444153.117056:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575182464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444153.117134:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444153.117296:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575182464 00000100:00100000:1.0:1783444153.117305:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575182464 00000100:00100000:1.0:1783444153.117364:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:1.0:1783444153.117373:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575182464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444153.117407:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444153.117459:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575182464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444153.117477:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00100000:1.0:1783444153.117523:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575182464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444153.119260:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444153.119278:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e729bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575182592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444153.119289:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444153.119298:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575182720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444153.126316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444153.128355:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575182592 00000100:00100000:0.0:1783444153.128372:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575182592 00000100:00100000:0.0:1783444153.128484:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:0.0:1783444153.128495:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575182592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444153.128575:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444153.128676:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575182592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 182us (2367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444153.128702:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00100000:1.0:1783444153.128823:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444153.129030:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575182720 00000100:00100000:3.0:1783444153.129036:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575182720 00000100:00100000:3.0:1783444153.129085:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:3.0:1783444153.129093:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575182720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444153.129121:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00010000:00000080:3.0:1783444153.129134:0:29151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901851880 x1870073575182720/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:529/0 lens 224/368 e 0 to 0 dl 1783444164 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444153.129168:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575182720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444153.129174:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:3.0:1783444153.129226:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e729bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575182592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444153.145390:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575182720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783444153.250205:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444154.268947:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783444154.655137:0:83281:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247811 is committed 00010000:00010000:1.0:1783444154.655180:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655195:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655203:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655210:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444154.655216:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655225:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655244:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368f57c6300) 00010000:00010000:1.0:1783444154.655248:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444154.655253:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655260:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e383144b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655283:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655291:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655298:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655303:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444154.655307:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655313:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655322:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368f57c6300) 00010000:00010000:1.0:1783444154.655325:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444154.655328:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444154.655334:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f200/0x42cb6883e3831483 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444155.166832:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575182848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444155.166911:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444155.167114:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575182848 00000100:00100000:1.0:1783444155.167123:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575182848 00000100:00100000:1.0:1783444155.167190:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:1.0:1783444155.167199:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575182848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444155.167236:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444155.173999:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575182848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6788us (7075us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444155.174024:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00100000:0.0:1783444155.177095:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7f82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575182848:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783444155.293589:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783444155.629335:0:84404:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1783444155.734942:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444155.735030:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557740544 00000100:00100000:3.0:1783444155.735042:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557740544 00000100:00100000:3.0:1783444155.735124:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1019 00000100:00100000:3.0:1783444155.735136:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ead7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+5:64915:x1870073557740544:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444155.735159:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444155.735186:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3831498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a10 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.735268:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383149f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.735282:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383149f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.735296:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383149f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444155.735343:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444155.735348:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1783444155.735408:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383149f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.735435:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3831498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a10 expref: 7 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.735454:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383149f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a10 expref: 6 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.735462:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6700) 00010000:00010000:3.0:1783444155.735465:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444155.735468:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26e00, rc 0) 00010000:00000080:3.0:1783444155.735475:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ead7ad80 x1870073557740544/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:531/0 lens 576/688 e 0 to 0 dl 1783444166 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444155.735539:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ead7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64915:x1870073557740544:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 405us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444155.735546:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1019 00000100:00080000:2.0:1783444155.735689:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444155.738155:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444155.738223:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557740672 00000100:00100000:3.0:1783444155.738234:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557740672 00000100:00100000:3.0:1783444155.738296:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1020 00000100:00100000:3.0:1783444155.738306:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ead78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64915:x1870073557740672:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444155.738326:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444155.738348:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a17 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738414:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738432:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738445:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738458:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738464:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738471:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738535:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738543:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738565:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738572:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738578:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444155.738582:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738590:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738603:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6700) 00010000:00010000:3.0:1783444155.738606:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444155.738610:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738615:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e38314ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738630:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738636:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738642:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738646:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444155.738654:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738661:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738668:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9368f57c6500) 00010000:00010000:3.0:1783444155.738682:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444155.738685:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738692:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e38314b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738726:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a17 expref: 7 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738735:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6700) 00010000:00010000:3.0:1783444155.738737:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444155.738741:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a17 expref: 7 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.738750:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27800, rc 0) 00010000:00000080:3.0:1783444155.738757:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ead78000 x1870073557740672/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:531/0 lens 592/584 e 0 to 0 dl 1783444166 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444155.738850:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ead78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64915:x1870073557740672:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 545us (704us total) trans 0 rc 301/301 00000100:00100000:3.0:1783444155.738857:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1020 00000100:00100000:2.0:1783444155.744211:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444155.744352:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557740928 00000100:00100000:3.0:1783444155.744373:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557740928 00000100:00100000:3.0:1783444155.744470:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1021 00000100:00100000:3.0:1783444155.744481:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ead79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:64915:x1870073557740928:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444155.744503:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444155.744506:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783444155.744532:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383149f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a10 expref: 6 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.744551:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6700) 00010000:00010000:3.0:1783444155.744563:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444155.744578:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38314bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a1e expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.744687:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.744699:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.744708:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.744719:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.744725:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.744731:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745390:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745398:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745404:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444155.745410:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783444155.745428:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745433:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745436:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745440:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745444:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444155.745447:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745451:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745456:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6e00) 00010000:00010000:3.0:1783444155.745458:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444155.745467:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745471:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38314c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444155.745479:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa21024b reply state 00000000d27d3eb7 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745487:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745491:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9368f57c6800) 00010000:00010000:3.0:1783444155.745493:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444155.745496:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783444155.745522:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38314bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 8 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745541:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 7 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.745548:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff9368f57c6600) 00010000:00010000:3.0:1783444155.745550:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444155.745553:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27000, rc 0) 00010000:00000080:3.0:1783444155.745561:0:71469:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ead79c00 x1870073557740928/t98784247812(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:531/0 lens 536/608 e 0 to 0 dl 1783444166 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444155.745635:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ead79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:64915:x1870073557740928:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1155us (1433us total) trans 98784247812 rc 0/0 00000100:00100000:3.0:1783444155.745642:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1021 00000100:00100000:2.0:1783444155.750446:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444155.750609:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557741184 00000100:00100000:3.0:1783444155.750625:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557741184 00000100:00100000:3.0:1783444155.750719:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1022 00000100:00100000:3.0:1783444155.750730:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c476b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:64915:x1870073557741184:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444155.750756:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444155.750833:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38314de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a25 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.750944:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.750960:0:66226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 9 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.750969:0:66226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.751016:0:66226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 9 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444155.751032:0:66226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 9 pid: 71469 timeout: 3246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444155.751047:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7f83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66226:1870073575182976:192.168.204.20@tcp:104: 00000100:00100000:3.0:1783444155.751125:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5919480 going to sleep for 11 seconds 00000100:00100000:3.0:1783444155.754123:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7f83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66226:1870073575182976:192.168.204.20@tcp:104: 00010000:00010000:3.0:1783444155.754159:0:66226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444155.757947:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444155.758218:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557741312 00000100:00100000:0.0:1783444155.758228:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557741312 00010000:00010000:0.0:1783444155.758268:0:8436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 10 pid: 71469 timeout: 3246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444155.758339:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2540 00000100:00100000:0.0:1783444155.758349:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2401:x1870073557741312:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444155.758364:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444155.758370:0:8436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 10 pid: 71469 timeout: 3246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444155.758383:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 10 pid: 71469 timeout: 3246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444155.758405:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38314d0 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 10 pid: 71469 timeout: 3246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444155.758419:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff9368f57c6600) 00010000:00010000:0.0:1783444155.758424:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444155.758439:0:8436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444155.758446:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444155.758485:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444155.758533:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2401:x1870073557741312:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 184us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444155.758540:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2540 00010000:00010000:2.0:1783444155.758595:0:66226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.758604:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444155.758623:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783444155.758899:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.758907:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.758923:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.758928:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444155.758932:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.758939:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.758949:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff9368f57c6600) 00010000:00010000:2.0:1783444155.758952:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783444155.758956:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.758961:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e38314e5 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.759020:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38314de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a25 expref: 9 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.759030:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6f00) 00010000:00010000:2.0:1783444155.759033:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783444155.759037:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38314de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a25 expref: 9 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444155.759049:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27a00, rc 0) 00010000:00000080:2.0:1783444155.759057:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c476b800 x1870073557741184/t98784247813(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:531/0 lens 712/824 e 0 to 0 dl 1783444166 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444155.759105:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c476b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:64915:x1870073557741184:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 8377us (8668us total) trans 98784247813 rc 301/301 00000100:00100000:2.0:1783444155.759112:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1022 00000100:00100000:1.0:1783444155.769329:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444155.770113:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557741568 00000100:00100000:3.0:1783444155.770125:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557741568 00000100:00100000:3.0:1783444155.770180:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:3.0:1783444155.770190:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:64915:x1870073557741568:12345-192.168.204.20@tcp:35:lfs.0 00010000:00000080:3.0:1783444155.770437:0:76566:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901850a80 x1870073557741568/t98784247814(0) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:531/0 lens 392/456 e 0 to 0 dl 1783444166 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444155.771188:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:64915:x1870073557741568:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 996us (1867us total) trans 98784247814 rc 0/0 00000100:00100000:3.0:1783444155.771198:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:1.0:1783444155.776370:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444155.776478:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557741824 00000100:00100000:1.0:1783444155.776489:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557741824 00000100:00100000:1.0:1783444155.776547:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:1.0:1783444155.776557:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f95b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+9:64915:x1870073557741824:12345-192.168.204.20@tcp:35:lfs.0 00010000:00000080:1.0:1783444155.776743:0:66228:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f95b9850 x1870073557741824/t98784247815(0) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:531/0 lens 392/456 e 0 to 0 dl 1783444166 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444155.776818:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f95b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:64915:x1870073557741824:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 263us (458us total) trans 98784247815 rc 0/0 00000100:00100000:1.0:1783444155.776826:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 215 00010000:00010000:3.0:1783444156.317142:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444157.214013:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575183232:0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.214085:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.214118:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575183744:0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.214144:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.214160:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575184256:0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.214178:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.214201:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1783444157.214206:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575183104:0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.214230:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.214254:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575183616:0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.214272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.214288:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575184128:0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.214306:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.214320:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575184640:0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.214336:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.214361:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575183744 00000100:00100000:2.0:1783444157.214368:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575183744 00000100:00100000:2.0:1783444157.214429:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575184256 00000100:00100000:2.0:1783444157.214433:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575184256 00000100:00100000:2.0:1783444157.214455:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1783444157.214631:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575183360:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.214661:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.214680:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575183872:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.214713:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.214730:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575184384:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.214750:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.214767:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783444157.214773:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575183488:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.214814:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.214832:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575184000:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.214852:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.214868:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575184512:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.214888:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.214918:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575183232 00000100:00100000:0.0:1783444157.214922:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575183232 00000100:00100000:0.0:1783444157.214964:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575183616 00000100:00100000:0.0:1783444157.214989:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575183616 00000100:00100000:0.0:1783444157.215006:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575184128 00000100:00100000:0.0:1783444157.215009:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575184128 00000100:00100000:0.0:1783444157.215018:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575184640 00000100:00100000:0.0:1783444157.215020:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575184640 00000100:00100000:0.0:1783444157.215031:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575183360 00000100:00100000:0.0:1783444157.215032:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575183360 00000100:00100000:0.0:1783444157.215042:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575183488 00000100:00100000:0.0:1783444157.215043:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575183488 00000100:00100000:0.0:1783444157.215057:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1783444157.215062:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575183232:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783444157.215085:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd172680 x1870073575183232/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1783444168 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444157.215127:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575183232:12345-0@lo:400:kworker.0 Request processed in 64us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.215134:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1783444157.215152:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1783444157.215157:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575183616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.215181:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575183616:12345-0@lo:400:kworker.0 Request processed in 24us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.215186:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1783444157.215198:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1783444157.215203:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575184128:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783444157.215212:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ea495180 x1870073575184128/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1783444168 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444157.215234:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575184128:12345-0@lo:400:kworker.0 Request processed in 32us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.215249:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1783444157.215261:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1783444157.215265:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575184640:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783444157.215275:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ea495f80 x1870073575184640/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1783444168 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444157.215300:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575184640:12345-0@lo:400:kworker.0 Request processed in 34us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.215306:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1783444157.215316:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1783444157.215321:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e729bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575183360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.215347:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e729bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575183360:12345-0@lo:400:kworker.0 Request processed in 26us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.215353:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1783444157.215365:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1783444157.215370:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575183488:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783444157.215379:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368eb7a9500 x1870073575183488/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1783444168 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444157.215401:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575183488:12345-0@lo:400:kworker.0 Request processed in 31us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.215407:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1783444157.215424:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575183872 00000100:00100000:0.0:1783444157.215427:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575183872 00000100:00100000:0.0:1783444157.215451:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575184384 00000100:00100000:0.0:1783444157.215454:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575184384 00000100:00100000:2.0:1783444157.216111:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575183744:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444157.216151:0:8431:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ea494a80 x1870073575183744/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1783444168 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444157.216186:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575183744:12345-0@lo:400:kworker.0 Request processed in 1724us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444157.216193:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:2.0:1783444157.216212:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:2.0:1783444157.216221:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575184256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.216248:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575184256:12345-0@lo:400:kworker.0 Request processed in 29us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444157.216253:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:2.0:1783444157.216276:0:83290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575183104 00000100:00100000:2.0:1783444157.216280:0:83290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575183104 00000100:00100000:2.0:1783444157.216307:0:83290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783444157.216313:0:83290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c541ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575183104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444157.216342:0:83290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c541ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575183104:12345-0@lo:400:kworker.0 Request processed in 29us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444157.216348:0:83290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783444157.216593:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575184000 00000100:00100000:0.0:1783444157.216603:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575184000 00000100:00100000:0.0:1783444157.216627:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575184512 00000100:00100000:0.0:1783444157.216630:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575184512 00000100:00100000:0.0:1783444157.216660:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:0.0:1783444157.216666:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575183872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217029:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575183872:12345-0@lo:400:kworker.0 Request processed in 362us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.217036:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00000100:00100000:0.0:1783444157.217051:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:0.0:1783444157.217058:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575184384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217088:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575184384:12345-0@lo:400:kworker.0 Request processed in 30us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.217093:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00100000:0.0:1783444157.217103:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238 00000100:00100000:0.0:1783444157.217109:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575184000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217136:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575184000:12345-0@lo:400:kworker.0 Request processed in 28us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.217142:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238 00000100:00100000:0.0:1783444157.217152:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:0.0:1783444157.217158:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575184512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217183:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575184512:12345-0@lo:400:kworker.0 Request processed in 26us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.217189:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000100:00080000:0.0:1783444157.217226:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444157.217230:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444157.217233:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444157.217236:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444157.217288:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575183488:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217300:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575184000:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217308:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575184512:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217320:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575183360:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217329:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575183872:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.217339:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575184384:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.218828:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575183104:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.218852:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575183616:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.218864:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575184128:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.218877:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575184640:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.218890:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575183232:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.218901:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575183744:0@lo:400:kworker.0 00000100:00100000:0.0:1783444157.218912:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575184256:0@lo:400:kworker.0 00010000:00010000:1.0:1783444157.345962:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444157.517613:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444157.517658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444157.517698:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444157.517733:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444157.517760:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557742080 00000100:00100000:1.0:1783444157.517770:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557742080 00000100:00100000:2.0:1783444157.517808:0:83288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557741952 00000100:00100000:2.0:1783444157.517814:0:83288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557741952 00000100:00100000:1.0:1783444157.517865:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557742208 00000100:00100000:1.0:1783444157.517870:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557742208 00000100:00100000:2.0:1783444157.517871:0:83288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:2.0:1783444157.517885:0:83288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c541e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557741952:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444157.517910:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 761 00000100:00100000:1.0:1783444157.517921:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2401:x1870073557742080:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000080:1.0:1783444157.517960:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901850a80 x1870073557742080/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:533/0 lens 224/224 e 0 to 0 dl 1783444168 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444157.517980:0:83288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c541e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557741952:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444157.517990:0:83288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:1.0:1783444157.518024:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2401:x1870073557742080:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 104us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444157.518032:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 761 00000100:00100000:1.0:1783444157.518054:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 762 00000100:00100000:1.0:1783444157.518062:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557742208:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444157.518087:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557742208:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444157.518094:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 762 00000100:00080000:1.0:1783444157.518116:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444157.518121:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444157.518306:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557742336 00000100:00100000:3.0:1783444157.518311:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557742336 00000100:00100000:3.0:1783444157.518368:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2240 00000100:00100000:3.0:1783444157.518377:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557742336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444157.518412:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557742336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 38us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444157.518419:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2240 00000100:00080000:1.0:1783444157.518891:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444157.524133:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444157.524256:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557742464 00000100:00100000:0.0:1783444157.524267:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557742464 00000100:00080000:2.0:1783444157.524345:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444157.524361:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2241 00000100:00100000:0.0:1783444157.524383:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557742464:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444157.524472:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557742464:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.524480:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2241 00000020:01000004:2.0:1783444157.719976:0:84501:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783444157.720036:0:84501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720053:0:84501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720061:0:84501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720069:0:84501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720089:0:84501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783444157.720094:0:84501:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1783444157.720121:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444157.720127:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720134:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fc00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444157.720138:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720146:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444157.720154:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444157.720159:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783444157.720161:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783444157.720178:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783444157.720217:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720223:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444157.720256:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720263:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e38310ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e38310f5 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720275:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444157.720277:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444157.720279:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444157.720294:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783444157.720299:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783444157.720305:0:84501:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783444157.720317:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368ff57f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783444157.720355:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444157.720373:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575184768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444157.720439:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.720505:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575184768 00000100:00100000:2.0:1783444157.720512:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575184768 00000100:00100000:2.0:1783444157.720558:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1783444157.720567:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575184768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444157.720579:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444157.720595:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71a00/0x42cb6883e38310f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38310ee expref: 24 pid: 83290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.720609:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444157.720653:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3633:x1870073575184768:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444157.720660:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1783444157.720714:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575184768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444157.721871:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575184896:0@lo:39:umount.0 00000100:00100000:1.0:1783444157.721930:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.722057:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575184896 00000100:00100000:2.0:1783444157.722063:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575184896 00000100:00100000:2.0:1783444157.722106:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1783444157.722113:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575184896:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783444157.722139:0:67017:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831206 00000100:00080000:2.0:1783444157.722147:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9367c32ce000 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1783444157.722180:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dcf3c700 x1870073575184896/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:533/0 lens 224/224 e 0 to 0 dl 1783444168 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444157.722226:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3632:x1870073575184896:12345-0@lo:39:umount.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444157.722234:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000020:00000080:2.0:1783444157.722244:0:67017:0:(genops.c:906:class_export_put()) final put ffff9367c32cd800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783444157.722271:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c32cd800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783444157.722309:0:50586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c32ce000 for lustre-MDT0000 00000100:00080000:1.0:1783444157.723905:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ff57f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783444157.723933:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575184896:0@lo:39:umount.0 00000100:00080000:2.0:1783444157.723970:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783444157.723976:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783444157.723981:0:84501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783444157.725211:0:84501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725228:0:84501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725236:0:84501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725257:0:84501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725273:0:84501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444157.725279:0:84501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725286:0:84501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725293:0:84501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725299:0:84501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725319:0:84501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444157.725327:0:84501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725333:0:84501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725338:0:84501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444157.725343:0:84501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.725359:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444157.725542:0:84501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444157.728220:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728240:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444157.728245:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728256:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444157.728265:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444157.728271:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783444157.728275:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1783444157.728323:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728331:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444157.728354:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728362:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383101c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831023 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728377:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444157.728381:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728387:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444157.728405:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728413:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444157.728419:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444157.728425:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783444157.728428:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1783444157.728430:0:10323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783444157.728449:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728455:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444157.728462:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728468:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c583e200/0x42cb6883e3831118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383111f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728477:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444157.728481:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728486:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444157.728489:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728496:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444157.728508:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444157.728513:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783444157.728516:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783444157.728518:0:10323:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783444157.728531:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728537:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444157.728543:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728549:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e38310e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e38310e7 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.728557:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444157.728559:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444157.728562:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444157.728625:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575185024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444157.728699:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.728913:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575185536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444157.728942:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.728989:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444157.728997:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575185152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444157.729024:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.729072:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575185280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444157.729105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.729123:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444157.729129:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575185408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444157.729148:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444157.729265:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444157.729314:0:84501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444157.729324:0:84501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444157.729332:0:84501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444157.729351:0:84501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444157.729366:0:84501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783444157.729386:0:84501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783444157.729390:0:84501:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783444157.729428:0:84501:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783444157.729432:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1783444157.729436:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1783444157.729442:0:84501:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:0.0:1783444157.730325:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575185024 00000100:00100000:0.0:1783444157.730335:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575185024 00000100:00100000:0.0:1783444157.730388:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575185152 00000100:00100000:0.0:1783444157.730392:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575185152 00000100:00100000:0.0:1783444157.730411:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:0.0:1783444157.730419:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575185024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444157.730452:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444157.730508:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575185024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.730515:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:0.0:1783444157.730532:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:0.0:1783444157.730539:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575185152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444157.730553:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444157.730581:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575185152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.730586:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00100000:0.0:1783444157.730606:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575185536 00000100:00100000:0.0:1783444157.730610:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575185536 00000100:00100000:0.0:1783444157.730634:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575185280 00000100:00100000:0.0:1783444157.730637:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575185280 00000100:00100000:0.0:1783444157.730650:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575185408 00000100:00100000:0.0:1783444157.730653:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575185408 00000100:00100000:0.0:1783444157.730681:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1783444157.730688:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3635:x1870073575185536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444157.730711:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444157.732166:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7644e00/0x42cb6883e38310e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38310e0 expref: 25 pid: 83287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.732315:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444157.732379:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575185536:12345-0@lo:103:ldlm_bl.0 Request processed in 1689us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.732387:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1783444157.732421:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1783444157.732431:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3633:x1870073575185280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444157.732445:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444157.732456:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71e00/0x42cb6883e3831023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383101c expref: 23 pid: 83288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.732467:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444157.732501:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3633:x1870073575185280:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (3394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.732508:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1783444157.732520:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1783444157.732527:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575185408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444157.732536:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444157.732544:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7645e00/0x42cb6883e383111f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831118 expref: 21 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.732553:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444157.732574:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3633:x1870073575185408:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (3425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.732597:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00010000:00010000:0.0:1783444157.732637:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444157.732644:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.732652:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444157.732657:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.732666:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444157.732674:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444157.732680:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783444157.732683:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783444157.732687:0:10323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783444157.732712:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.732734:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444157.732751:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.732757:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e383100e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831015 expref: -99 pid: 83280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.732768:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444157.732770:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444157.732777:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444157.732847:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575185152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444157.732866:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7f82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575185024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444157.732875:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575185536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444157.732906:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444157.732915:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575185664:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1783444157.733760:0:84501:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:0.0:1783444157.734152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444157.734430:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575185664 00000100:00100000:0.0:1783444157.734439:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575185664 00000100:00100000:0.0:1783444157.734486:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1783444157.734494:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3635:x1870073575185664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444157.734506:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444157.734523:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70c00/0x42cb6883e3831015 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383100e expref: 20 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.734537:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444157.734573:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3635:x1870073575185664:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444157.734579:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1783444157.734621:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575185408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444157.734632:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575185280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444157.734667:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575185664:0@lo:103:ldlm_bl.0 00000001:00080000:3.0:1783444157.735547:0:83281:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00000020:00000080:3.0:1783444157.735614:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1783444157.735624:0:84501:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c9a10800 778015c5-4969-44f5-82a5-0f6eadd152d5 192.168.204.20@tcp 5 (0 0 0) 0 0 0 1: ffff9368c715d000 98784247815 stale:0 00000020:00080000:3.0:1783444157.735630:0:84501:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368dd1ef000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444157.735635:0:84501:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9367c32cb000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444157.735640:0:84501:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368dd1ee000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444157.735644:0:84501:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9367c5621800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444157.735649:0:84501:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9367c3330000) has exports, disconnecting them 00000020:00080000:3.0:1783444157.735654:0:84501:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.20@tcp (ffff9368c9a10800), last request at 1783444157 00000020:00000080:3.0:1783444157.735663:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38313db 00000100:00080000:3.0:1783444157.735672:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368c9a14000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1783444157.735697:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783444157.735706:0:84501:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368c9a10800): rc 0 00000020:00080000:3.0:1783444157.735710:0:84501:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368dd1ef000), last request at 1783443950 00000020:00000080:3.0:1783444157.735713:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383120d 00010000:00010000:1.0:1783444157.735891:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444157.736832:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.736861:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.736868:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.736874:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444157.736879:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.736887:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.736905:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9368f57c6800) 00010000:00010000:0.0:1783444157.736907:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444157.736912:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444157.736995:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38314c9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783444157.737017:0:3620:0:(genops.c:906:class_export_put()) final put ffff9368c9a10800/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444157.737049:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a10800/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-MDT0000 00000020:00000080:0.0:1783444157.737286:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c9a14000 for lustre-MDT0000 00000100:00080000:3.0:1783444157.738043:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca3000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783444157.738084:0:84501:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368dd1ef000): rc 0 00000020:00000080:3.0:1783444157.738086:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368dd1ef000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783444157.738096:0:84501:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9367c32cb000), last request at 1783444157 00000020:00000080:3.0:1783444157.738101:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38311ff 00000100:00080000:3.0:1783444157.738106:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9367c32cc000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783444157.738127:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1ef000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783444157.738163:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368f8ca3000 for lustre-MDT0000 00010000:00010000:1.0:1783444157.738299:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444157.738818:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444157.739029:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783444157.741895:0:84501:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367c32cb000): rc 0 00000020:00000080:2.0:1783444157.741901:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c32cb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783444157.741915:0:84501:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368dd1ee000), last request at 1783444157 00000020:00000080:2.0:1783444157.741935:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38311f8 00000100:00080000:2.0:1783444157.741950:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368dd1ee800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1783444157.741997:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c32cb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783444157.742046:0:50586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c32cc000 for lustre-MDT0000 00000020:00080000:2.0:1783444157.742058:0:84501:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368dd1ee000): rc 0 00000020:00000080:2.0:1783444157.742060:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368dd1ee000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1783444157.742068:0:84501:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9367c5621800), last request at 1783443945 00000020:00000080:2.0:1783444157.742072:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831062 00000100:00080000:2.0:1783444157.742081:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368dd20c800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1783444157.742102:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1ee000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783444157.742129:0:50586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd1ee800 for lustre-MDT0000 00000020:00080000:2.0:1783444157.742138:0:84501:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367c5621800): rc 0 00000020:00000080:2.0:1783444157.742140:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5621800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1783444157.742149:0:84501:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac1c41fabae0 00000020:00000080:2.0:1783444157.742163:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5621800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1783444157.742185:0:50586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd20c800 for lustre-MDT0000 00000100:00080000:2.0:1783444157.742205:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783444157.742209:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411430 gen 3 00010000:00010000:0.0:1783444157.742391:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444157.742836:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444157.744336:0:84501:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783444157.746022:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368cb7d3800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783444157.746240:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783444157.746258:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969446 gen 3 00000004:00080000:2.0:1783444157.746279:0:84501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783444157.746343:0:84501:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783444157.746360:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368c88ca800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783444157.746366:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783444157.746369:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:2.0:1783444157.746377:0:84501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783444157.746445:0:84501:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783444157.746456:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368ef0b2800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783444157.746497:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9367c3330000) has no exports 00000100:00100000:2.0:1783444157.747094:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575185792:0@lo:39:umount.0 00000100:00100000:2.0:1783444157.747167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.747202:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575185920:0@lo:9:umount.0 00000100:00100000:2.0:1783444157.747230:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.747246:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575186048:0@lo:9:umount.0 00000100:00100000:2.0:1783444157.747267:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444157.747308:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575185792 00000100:00100000:2.0:1783444157.747316:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575185792 00000100:00100000:2.0:1783444157.747450:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:2.0:1783444157.747461:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575185792:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783444157.747492:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831093 00000100:00080000:2.0:1783444157.747501:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9368c518b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783444157.747524:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411430 00000100:00100000:2.0:1783444157.747679:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3632:x1870073575185792:12345-0@lo:39:umount.0 Request processed in 219us (511us total) trans 77309411431 rc 0/0 00000100:00100000:2.0:1783444157.747686:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00080000:2.0:1783444157.747737:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb7d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783444157.747836:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575185792:0@lo:39:umount.0 00010000:00010000:2.0:1783444157.747850:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444157.749989:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575185920 00000100:00100000:3.0:1783444157.750002:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575185920 00000100:00100000:3.0:1783444157.750055:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575186048 00000100:00100000:3.0:1783444157.750059:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575186048 00000100:00100000:3.0:1783444157.750093:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5841 00000100:00100000:3.0:1783444157.750104:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575185920:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783444157.750136:0:26210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38310af 00000100:00080000:3.0:1783444157.750145:0:26210:0:(import.c:65:import_set_state_nolock()) ffff9368eb18d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783444157.750149:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5842 00000100:00100000:2.0:1783444157.750161:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575186048:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783444157.750177:0:26200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38310cb 00000100:00080000:2.0:1783444157.750182:0:26200:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783444157.750215:0:26200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:2.0:1783444157.750358:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575186048:12345-0@lo:9:umount.0 Request processed in 199us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444157.750382:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5842 00000100:00080000:2.0:1783444157.750434:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef0b2800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783444157.750444:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783444157.750446:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444157.750450:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575186048:0@lo:9:umount.0 00000001:00000004:3.0:1783444157.751032:0:26210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969446 00000100:00100000:3.0:1783444157.751159:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575185920:12345-0@lo:9:umount.0 Request processed in 1056us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444157.751168:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5841 00000100:00080000:2.0:1783444157.751183:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368c88ca800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783444157.751193:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783444157.751195:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444157.751198:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575185920:0@lo:9:umount.0 00010000:00010000:3.0:1783444157.751267:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444157.752949:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1783444157.753549:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9367c3330000) has no exports 00000020:00000080:3.0:1783444157.806051:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831077 00000020:00000080:3.0:1783444157.806069:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368cab9e800/lustre-QMT0000_UUID 00000020:01000000:3.0:1783444157.806080:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783444157.806169:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cab9e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783444157.806223:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444157.806299:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783444157.806305:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9367c3334d40) has no exports 00000020:00000080:2.0:1783444157.806892:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831070 00000020:00000080:2.0:1783444157.806899:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368ea608000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444157.806916:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea608000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783444157.806976:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444157.806985:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783444157.806988:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368ef0cd000/lustre-QMT0000_UUID 00000020:00000080:2.0:1783444157.806991:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0cd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783444157.807009:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1783444157.807151:0:84501:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c46afba0 - data ffff9368ffa35360/ffff9368dcf23000 00000020:01000000:2.0:1783444157.807380:0:84501:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c46af2a0 - data ffff9368ffb40af8/ffff9367c55d9800 00000100:00080000:3.0:1783444157.848050:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783444157.848060:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411430 gen 4 00000100:00100000:3.0:1783444157.848094:0:84501:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9368ea494380 x1870073575185792/t77309411431(77309411431) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444167 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444157.848121:0:84501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783444157.849781:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783444157.849803:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969446 gen 4 00000004:00080000:3.0:1783444157.849816:0:84501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444157.849819:0:84501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783444157.850055:0:83298:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783444157.850060:0:83298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:0.0:1783444157.850091:0:83298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:3.0:1783444157.850901:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783444157.850905:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:3.0:1783444157.850921:0:84501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444157.850923:0:84501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783444157.851184:0:83300:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783444157.851188:0:83300:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 2 count 1 00000040:00080000:0.0:1783444157.851196:0:83300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:3.0:1783444157.852124:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831031 00000020:00000080:3.0:1783444157.852135:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5625000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444157.852205:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5625000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783444157.852689:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831046 00000020:00000080:3.0:1783444157.852695:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368ff5e6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783444157.852701:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783444157.852708:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff5e6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1783444157.852716:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444157.852728:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783444157.852732:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9367c33319c0) has no exports 00000004:01000000:3.0:1783444157.852920:0:84501:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783444157.852928:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38310c4 00000020:00000080:3.0:1783444157.852932:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368ef12d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783444157.852939:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783444157.852946:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef12d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783444157.852954:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444157.852973:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783444157.852976:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9368e7123380) has no exports 00000020:00000080:3.0:1783444157.852981:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38310bd 00000020:00000080:3.0:1783444157.852984:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368ef0b1000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444157.853014:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0b1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783444157.853336:0:84501:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783444157.853341:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783444157.853344:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:3.0:1783444157.853350:0:84501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444157.853352:0:84501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783444157.853370:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef0b2800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783444157.853394:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783444157.853402:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444157.853405:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5626800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444157.853408:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5626800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783444157.853412:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444157.853483:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38310a8 00000020:00000080:3.0:1783444157.853488:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5620000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783444157.853493:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783444157.853500:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5620000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783444157.853510:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444157.853514:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783444157.853517:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9368e7124d40) has no exports 00000020:00000080:3.0:1783444157.853520:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38310a1 00000020:00000080:3.0:1783444157.853523:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368c88cb800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444157.853531:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88cb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783444157.853855:0:84501:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783444157.853858:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783444157.853860:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969446 gen 5 00000004:00080000:3.0:1783444157.853864:0:84501:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444157.853866:0:84501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783444157.853880:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c88ca800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783444157.853907:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783444157.853913:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444157.853924:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5621000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444157.853926:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5621000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783444157.853930:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783444157.853989:0:84501:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783444157.853994:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383108c 00000020:00000080:3.0:1783444157.853999:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368eb18c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783444157.854005:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783444157.854013:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb18c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783444157.854022:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444157.854027:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783444157.854029:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9368c5078000) has no exports 00000020:00000080:3.0:1783444157.854034:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831085 00000020:00000080:3.0:1783444157.854036:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368ef12f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444157.854044:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef12f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783444157.861889:0:84501:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783444157.861899:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783444157.861904:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411430 gen 5 00000100:00100000:0.0:1783444157.861912:0:84501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444157.861947:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368cb7d3800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783444157.862001:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444157.862017:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444157.862023:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5620800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444157.862026:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5620800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783444157.862032:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444157.862135:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444157.862141:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444157.862143:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5626000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444157.862145:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5626000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783444157.862149:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444157.862200:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383104d 00000020:00000080:0.0:1783444157.862208:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c4e23800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783444157.862217:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783444157.862224:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c4e23800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783444157.862233:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444157.862239:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783444157.862242:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9367c3333380) has no exports 00000020:00000080:0.0:1783444157.862263:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444157.862267:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444157.862270:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5627000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783444157.862272:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5627000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783444157.862275:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444157.862314:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831054 00000020:00000080:0.0:1783444157.862320:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c4e20800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444157.862333:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c4e20800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783444157.862344:0:84501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ead89800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783444157.862348:0:84501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ead89800 3 00000020:01000004:0.0:1783444157.862351:0:84501:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368ead89800 from lustre-MDT0000 00000020:00000080:0.0:1783444157.862370:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444157.862375:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783444157.862378:0:84501:0:(genops.c:906:class_export_put()) final put ffff9367c5625800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783444157.862380:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5625800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783444157.862386:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783444157.862430:0:84501:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783444157.862434:0:84501:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783444157.862438:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783444157.862440:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444157.862443:0:84501:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783444157.862453:0:84501:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9368f9910000 fea1b1de-aca2-4501-86bf-fe28138c0593 192.168.204.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444157.862459:0:84501:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9367c17cc800 c89ab73b-dbb2-4305-b221-37cc64d61227 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444157.862464:0:84501:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff9368f8f1cd40) has exports, disconnecting them 00000020:00080000:0.0:1783444157.862469:0:84501:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.20@tcp (ffff9368f9910000), last request at 1783443945 00000020:00000080:0.0:1783444157.862487:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831111 00000020:00010000:0.0:1783444157.862492:0:84501:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368f9910000: total 0 00000100:00080000:0.0:1783444157.862495:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368f9916800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444157.862523:0:84501:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368f9910000): rc 0 00000020:00080000:0.0:1783444157.862525:0:84501:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9367c17cc800), last request at 1783443945 00000020:00000080:0.0:1783444157.862563:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3830ff2 00000020:00010000:0.0:1783444157.862566:0:84501:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9367c17cc800: total 0 00000100:00080000:0.0:1783444157.862569:0:84501:0:(import.c:65:import_set_state_nolock()) ffff9368c511b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444157.862583:0:84501:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367c17cc800): rc 0 00000020:00080000:0.0:1783444157.862587:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9368f8f1cd40) has no exports 00000020:00010000:1.0:1783444157.862661:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368f9910000: total 0 00010000:00010000:1.0:1783444157.862702:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368f9910000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783444157.862735:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7645a00/0x42cb6883e38311ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399d1 expref: 5 pid: 83288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862753:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7645400/0x42cb6883e38311e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399ca expref: 4 pid: 83290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862763:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5757400/0x42cb6883e38311f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399d8 expref: 3 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862785:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5756200/0x42cb6883e38311dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc99399c3 expref: 2 pid: 83290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862824:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368f9910000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1783444157.862843:0:6493:0:(genops.c:906:class_export_put()) final put ffff9368f9910000/fea1b1de-aca2-4501-86bf-fe28138c0593 00000020:00010000:1.0:1783444157.862852:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9367c17cc800: total 1 00010000:00010000:1.0:1783444157.862868:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9367c17cc800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783444157.862882:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7644200/0x42cb6883e383118f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831188 expref: 14 pid: 83290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862893:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7644800/0x42cb6883e3831181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383117a expref: 13 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862902:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7645000/0x42cb6883e383113b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831134 expref: 12 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862914:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71c00/0x42cb6883e383119d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831196 expref: 11 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862923:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7644c00/0x42cb6883e383112d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831126 expref: 10 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862932:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71600/0x42cb6883e38311ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38311a4 expref: 9 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862941:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7644a00/0x42cb6883e38311b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38311b2 expref: 8 pid: 83290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862950:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583f000/0x42cb6883e3831149 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831142 expref: 7 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862985:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5756c00/0x42cb6883e38311c7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38311c0 expref: 6 pid: 83288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.862996:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71200/0x42cb6883e3831157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831150 expref: 5 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.863007:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5756000/0x42cb6883e38311d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38311ce expref: 4 pid: 83290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.863017:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7645800/0x42cb6883e3831165 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383115e expref: 3 pid: 83288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.863028:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583e000/0x42cb6883e3831173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383116c expref: 2 pid: 83290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444157.863038:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9367c17cc800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783444157.863052:0:6493:0:(genops.c:906:class_export_put()) final put ffff9367c17cc800/c89ab73b-dbb2-4305-b221-37cc64d61227 00010000:00010000:1.0:1783444157.863057:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444157.863058:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444157.863060:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783444157.863068:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f9910000/fea1b1de-aca2-4501-86bf-fe28138c0593 for MGS 00000020:00000080:1.0:1783444157.863091:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17cc800/c89ab73b-dbb2-4305-b221-37cc64d61227 for MGS 00000020:00000080:1.0:1783444157.863101:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368f9916800 for MGS 00000020:00000080:1.0:1783444157.863105:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c511b000 for MGS 00010000:00010000:2.0:1783444157.863219:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444157.863256:0:83290:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9368ead80600:83290] 3 exiting: rc = 0 00000100:00100000:2.0:1783444157.863362:0:83285:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9367c21e8800:83285] 0 exiting: rc = 1 00000100:00100000:2.0:1783444157.863407:0:83288:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9367c33ae800:83288] 2 exiting: rc = 0 00000100:00100000:2.0:1783444157.863450:0:83287:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9367c33afe00:83287] 1 exiting: rc = 0 00000100:00100000:0.0:1783444157.863625:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863632:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863640:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863646:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863658:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863665:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863670:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863676:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863682:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863688:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863693:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863700:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863705:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863711:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863716:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863722:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863727:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863732:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863737:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863743:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863747:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863752:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863758:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863763:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863768:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863773:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863777:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863782:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863853:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863860:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863866:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863872:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863877:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863882:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863887:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863901:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863907:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863912:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863918:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863922:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863928:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863933:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863940:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863945:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863950:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863955:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.863972:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864018:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864024:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864029:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864035:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864041:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864046:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864050:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864055:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864061:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864066:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864071:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864076:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864080:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864085:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864090:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864095:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444157.864101:0:84501:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783444157.865940:0:84501:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c77574e0 - data ffff9368ffb06af8/ffff9367c786f000 00000020:01000000:1.0:1783444157.866076:0:84501:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c7757900 - data ffff9368ffa5ae58/ffff9368e3fba800 00000020:00000080:1.0:1783444157.866496:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3830feb 00000020:00000080:1.0:1783444157.866505:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368c518a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444157.866519:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1783444157.866543:0:84501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ead89800 from MGS, refs=2 00000020:01000004:1.0:1783444157.866547:0:84501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ead89800 2 00000020:01000004:1.0:1783444157.866550:0:84501:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368ead89800 from MGS 00000020:00000080:1.0:1783444157.866571:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444157.866579:0:84501:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783444157.866582:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368c518d000/MGS 00000020:00000080:1.0:1783444157.866584:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518d000/MGS for MGS 00000020:01000000:1.0:1783444157.866590:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783444157.866666:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783444157.866671:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444157.866681:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783444157.866687:0:84501:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9368f8ca6800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783444157.866692:0:84501:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9368f8f18000) has exports, disconnecting them 00000020:00080000:1.0:1783444157.866697:0:84501:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9368f8ca6800), last request at 1783443945 00000020:00000080:1.0:1783444157.866701:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831103 00000020:00080000:1.0:1783444157.866710:0:84501:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368f8ca6800): rc 0 00000020:00000080:1.0:1783444157.866715:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368f8ca6800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783444157.866736:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca6800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783444157.868918:0:84501:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783444157.868926:0:84501:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444157.868932:0:84501:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783444157.868940:0:84501:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444157.868974:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff57f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783444157.869120:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444157.869135:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783444157.869141:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368f8ca3800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783444157.869145:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783444157.869152:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783444157.869238:0:84501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ead89800 1 00000020:00000080:0.0:1783444157.869244:0:84501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3830fdd 00000020:00000080:0.0:1783444157.869250:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368c518c800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783444157.869257:0:84501:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783444157.869266:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444157.869277:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444157.869283:0:84501:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783444157.869287:0:84501:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9368dd0ecd40) has no exports 00000020:00000080:0.0:1783444157.942261:0:84501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444157.942276:0:84501:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783444157.942282:0:84501:0:(genops.c:906:class_export_put()) final put ffff9368ead8a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444157.942287:0:84501:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ead8a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783444157.942300:0:84501:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783444157.942434:0:84501:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9368ead8b000 00000020:02000400:0.0:1783444157.942508:0:84501:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1783444158.237213:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575186176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444158.237292:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444158.237476:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575186176 00000100:00100000:3.0:1783444158.237485:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575186176 00000100:00100000:3.0:1783444158.237532:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:3.0:1783444158.237541:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575186176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444158.237566:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444158.237609:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575186176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444158.237616:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:3.0:1783444158.237742:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575186432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444158.237773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444158.237824:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575186432 00000100:00100000:3.0:1783444158.237828:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575186432 00000100:00100000:3.0:1783444158.237852:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:3.0:1783444158.237858:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575186432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444158.237877:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444158.237909:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575186432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444158.237916:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00100000:3.0:1783444158.237963:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575186432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444158.238227:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575186304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444158.238262:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444158.240118:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575186304 00000100:00100000:3.0:1783444158.240129:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575186304 00000100:00100000:3.0:1783444158.240169:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:3.0:1783444158.240177:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3634:x1870073575186304:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1783444158.240185:0:8430:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783444158.240258:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3634:x1870073575186304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (1994us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444158.240266:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:02020000:3.0:1783444158.240317:0:3634:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1783444158.242223:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575186176:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783444158.261571:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783444158.261579:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783444158.261584:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783444158.261590:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444158.261595:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3122 00000100:00080000:3.0:1783444158.261605:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444158.261641:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7f81180 x1870073575186560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444158.261714:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575186560:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783444158.261877:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444158.263765:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575186560 00000100:00100000:2.0:1783444158.263778:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575186560 00000100:00100000:2.0:1783444158.263848:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:2.0:1783444158.263857:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575186560:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783444158.263881:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444158.263967:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575186560:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 110us (2090us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444158.263975:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00080000:2.0:1783444158.264021:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444158.264026:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444158.264030:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7f81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575186560:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1783444158.365050:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444159.390138:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444160.413188:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444161.437619:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444162.334332:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444162.334339:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444162.334342:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444162.334351:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3149 00000100:00080000:2.0:1783444162.334371:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444162.334378:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444162.334403:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ff100 x1870073575187328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444162.334435:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575187328:0@lo:38:kworker.0 00000100:00100000:2.0:1783444162.334507:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444162.334674:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575186688:0@lo:400:kworker.0 00000400:00000100:3.0:1783444162.334710:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575186688 offset 0 length 224: 4 00000100:00100000:3.0:1783444162.334745:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575187200:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.334769:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444162.334827:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783444162.334833:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575187072:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.334852:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444162.334864:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575187712:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.334892:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444162.334919:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575187328 00000100:00100000:3.0:1783444162.334926:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575187328 00000100:00100000:3.0:1783444162.334957:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1783444162.334964:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575187328:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444162.334983:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444162.335017:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575187328:12345-0@lo:38:kworker.0 Request processed in 53us (510us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444162.335024:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1783444162.335048:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575186944:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.335068:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444162.335081:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575187584:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.335098:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444162.335114:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783444162.335119:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575186816:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.335137:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444162.335150:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575187456:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.335175:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444162.335195:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575187200 00000100:00100000:3.0:1783444162.335199:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575187200 00000100:00100000:3.0:1783444162.335230:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575187072 00000100:00100000:3.0:1783444162.335233:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575187072 00000100:00100000:3.0:1783444162.335240:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575187712 00000100:00100000:3.0:1783444162.335242:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575187712 00000100:00100000:3.0:1783444162.335248:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575186944 00000100:00100000:3.0:1783444162.335250:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575186944 00000100:00100000:3.0:1783444162.335259:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575186816 00000100:00100000:3.0:1783444162.335261:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575186816 00000100:00100000:3.0:1783444162.335270:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1783444162.335275:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575187200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.335311:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575187200:12345-0@lo:400:kworker.0 Request processed in 36us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444162.335318:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1783444162.335327:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1783444162.335332:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575186944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.335355:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575186944:12345-0@lo:400:kworker.0 Request processed in 23us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444162.335361:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1783444162.335369:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1783444162.335373:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870073575187072:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783444162.335378:0:66223:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783444162.335394:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870073575187072:12345-0@lo:400:kworker.0 Request processed in 20us (541us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444162.335399:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1783444162.335407:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1783444162.335417:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870073575187712:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783444162.335422:0:66223:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783444162.335446:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870073575187712:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444162.335451:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1783444162.335461:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1783444162.335466:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1870073575186816:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783444162.335470:0:66223:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783444162.335490:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1870073575186816:12345-0@lo:400:kworker.0 Request processed in 23us (351us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444162.335496:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:3.0:1783444162.335527:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783444162.335531:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783444162.335535:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783444162.335540:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444162.335543:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2941 00000100:00080000:3.0:1783444162.335548:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444162.335566:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e79df480 x1870073575187840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444162.335579:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575186816:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.335594:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575186944:0@lo:400:kworker.0 00000100:00080000:3.0:1783444162.335621:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783444162.335623:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783444162.335626:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783444162.335635:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444162.335638:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2941 00000100:00080000:3.0:1783444162.335642:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444162.335653:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e79ddc00 x1870073575187968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444162.335663:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575187072:0@lo:400:kworker.0 00000100:00080000:3.0:1783444162.335673:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783444162.335675:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783444162.335678:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783444162.335681:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444162.335683:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2941 00000100:00080000:3.0:1783444162.335687:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444162.335694:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e79dea00 x1870073575188096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444162.335702:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575187712:0@lo:400:kworker.0 00000100:00100000:3.0:1783444162.335711:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575187200:0@lo:400:kworker.0 00000100:00100000:2.0:1783444162.335987:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575187584 00000100:00100000:2.0:1783444162.335992:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575187584 00000100:00100000:2.0:1783444162.336031:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575187456 00000100:00100000:2.0:1783444162.336034:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575187456 00000100:00100000:2.0:1783444162.336055:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242 00000100:00100000:2.0:1783444162.336062:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575187584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444162.336101:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575187584:12345-0@lo:400:kworker.0 Request processed in 41us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444162.336108:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242 00000100:00100000:2.0:1783444162.336121:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:2.0:1783444162.336127:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575187456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444162.336153:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575187456:12345-0@lo:400:kworker.0 Request processed in 26us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444162.336159:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00080000:2.0:1783444162.336178:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444162.336182:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444162.336185:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444162.336201:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575187840:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783444162.336228:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444162.336245:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575187968:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783444162.336279:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444162.336294:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575188096:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783444162.336317:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783444162.336355:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444162.336360:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444162.336363:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575187328:0@lo:38:kworker.0 00000100:00100000:2.0:1783444162.336388:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575187840 00000100:00100000:2.0:1783444162.336392:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575187840 00000100:00100000:2.0:1783444162.336409:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575187968 00000100:00100000:2.0:1783444162.336412:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575187968 00000100:00100000:2.0:1783444162.336419:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575188096 00000100:00100000:2.0:1783444162.336421:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575188096 00000100:00100000:2.0:1783444162.336431:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1783444162.336435:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575187840:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783444162.336450:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444162.336481:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575187840:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 44us (253us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444162.336487:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1783444162.336498:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1783444162.336502:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575187968:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1783444162.336511:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444162.336535:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575187968:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31us (255us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444162.336541:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1783444162.336551:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1783444162.336555:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575188096:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1783444162.336573:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444162.336598:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575188096:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41us (280us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444162.336604:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00080000:2.0:1783444162.336632:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444162.336636:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444162.336639:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575187840:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1783444162.336646:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444162.336649:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444162.336651:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575187968:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1783444162.336658:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444162.336660:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444162.336663:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575188096:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783444162.338269:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575187456:0@lo:400:kworker.0 00000100:00100000:2.0:1783444162.338289:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575187584:0@lo:400:kworker.0 00010000:00010000:3.0:1783444162.461034:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1783444162.634543:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557742592 offset 0 length 224: 4 00000100:00100000:3.0:1783444162.634582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444162.634829:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444162.634877:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444162.634936:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557743104 00000100:00100000:1.0:1783444162.634946:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557743104 00000100:00100000:1.0:1783444162.635024:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2244 00000100:00100000:1.0:1783444162.635034:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557743104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444162.635107:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557743104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444162.635115:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2244 00000100:00080000:2.0:1783444162.635238:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444162.641973:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444162.642105:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557742976 00000100:00100000:1.0:1783444162.642115:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557742976 00000100:00100000:1.0:1783444162.642187:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2245 00000100:00100000:1.0:1783444162.642196:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557742976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444162.642265:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557742976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444162.642273:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2245 00000100:00080000:3.0:1783444162.642931:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444162.645702:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557742848 00000100:00100000:0.0:1783444162.645717:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557742848 00000100:00100000:0.0:1783444162.645999:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557742720 00000100:00100000:0.0:1783444162.646005:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557742720 00000100:00080000:3.0:1783444162.646129:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444162.646435:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 765 00000100:00100000:1.0:1783444162.646450:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557742848:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444162.646549:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557742848:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 102us (11964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444162.646557:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 765 00000100:00100000:1.0:1783444162.646583:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1030 00000100:00100000:1.0:1783444162.646588:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1870073557742720:12345-192.168.204.20@tcp:400:kworker.0 00000020:00080000:1.0:1783444162.646595:0:80475:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.20@tcp 00000100:00100000:1.0:1783444162.646619:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1870073557742720:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (11751us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783444162.646625:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1030 00000100:00100000:3.0:1783444162.695419:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444162.695549:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557743232 00000100:00100000:0.0:1783444162.695560:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557743232 00000100:00100000:0.0:1783444162.695611:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1031 00000100:00100000:0.0:1783444162.695619:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557743232:12345-192.168.204.20@tcp:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1783444162.695647:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444162.695725:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557743232:12345-192.168.204.20@tcp:38:ptlrpcd_00_00.0 Request processed in 105us (315us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444162.695733:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1031 00000100:00100000:0.0:1783444163.358175:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444163.358197:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575188224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444163.358268:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444163.358363:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575188224 00000100:00100000:1.0:1783444163.358370:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575188224 00000100:00100000:1.0:1783444163.358425:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:1.0:1783444163.358434:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575188224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444163.358463:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444163.358520:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575188224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444163.358528:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00100000:2.0:1783444163.358620:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575188224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444163.359082:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444163.359093:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575188352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444163.359126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444163.359247:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575188352 00000100:00100000:0.0:1783444163.359252:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575188352 00000100:00100000:0.0:1783444163.359291:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1783444163.359299:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575188352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444163.359317:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444163.359359:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575188352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444163.359365:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:3.0:1783444163.359462:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575188352:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783444163.485085:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783444163.875887:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444163.875897:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368c518a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444163.875919:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783444163.875960:0:50586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368f8ca4000 for lustre-OST0001 00000001:00100000:3.0:1783444163.876988:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783444163.877004:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411431 is committed 00000020:00000080:3.0:1783444163.877011:0:75651:0:(genops.c:906:class_export_put()) final put ffff9368c5189800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444163.877032:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c5189800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783444163.877098:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c518b000 for lustre-MDT0001 00000001:00100000:0.0:1783444163.877854:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444163.877860:0:8415:0:(genops.c:906:class_export_put()) final put ffff9368eb18b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444163.877915:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb18b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783444163.877956:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368eb18d800 for lustre-OST0000 00010000:00010000:1.0:1783444164.509777:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444165.534024:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444166.557180:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444167.452933:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444167.452957:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444167.452960:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444167.452969:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3153 00000100:00080000:2.0:1783444167.452975:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444167.452981:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444167.453007:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ff100 x1870073575188608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444167.453054:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444167.453058:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444167.453060:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444167.453064:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3153 00000100:00080000:2.0:1783444167.453066:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444167.453070:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444167.453082:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ff800 x1870073575188864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444167.453098:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444167.453102:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444167.453103:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444167.453108:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3153 00000100:00080000:2.0:1783444167.453111:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444167.453116:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444167.453128:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444167.453130:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fc380 x1870073575189120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444167.453151:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575188480:0@lo:400:kworker.0 00000100:00080000:2.0:1783444167.453161:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444167.453172:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444167.453173:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444167.453177:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3153 00000100:00080000:2.0:1783444167.453180:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444167.453185:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444167.453202:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368c9f69180 x1870073575189504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1783444167.453207:0:3633:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575188480 offset 0 length 224: 4 00000100:00100000:2.0:1783444167.453237:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575188736:0@lo:400:kworker.0 00000100:00100000:1.0:1783444167.453260:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575189248:0@lo:400:kworker.0 00000100:00100000:2.0:1783444167.453281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444167.453295:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444167.453310:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444167.453318:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575188992:0@lo:400:kworker.0 00000100:00100000:1.0:1783444167.453321:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444167.453331:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575189376:0@lo:400:kworker.0 00000100:00100000:2.0:1783444167.453349:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444167.453370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444167.454628:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575188608:0@lo:38:kworker.0 00000100:00100000:0.0:1783444167.454697:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444167.454740:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575188864:0@lo:38:kworker.0 00000100:00100000:1.0:1783444167.454762:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575188736 00000100:00100000:1.0:1783444167.454783:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575188736 00000100:00100000:0.0:1783444167.454832:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444167.454857:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575189120:0@lo:38:kworker.0 00000100:00100000:1.0:1783444167.454879:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575188992 00000100:00100000:1.0:1783444167.454884:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575188992 00000100:00100000:0.0:1783444167.454890:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444167.454911:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575188608 00000100:00100000:1.0:1783444167.454916:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575188608 00000100:00100000:0.0:1783444167.454917:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575189504:0@lo:38:kworker.0 00000100:00100000:1.0:1783444167.454928:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575188864 00000100:00100000:1.0:1783444167.454932:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575188864 00000100:00100000:1.0:1783444167.454951:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1783444167.454952:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444167.454965:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575188736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444167.454990:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575189248 00000100:00100000:0.0:1783444167.454996:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575189248 00000100:00100000:1.0:1783444167.455033:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575188736:12345-0@lo:400:kworker.0 Request processed in 70us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444167.455035:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575189376 00000100:00100000:0.0:1783444167.455040:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575189376 00000100:00100000:1.0:1783444167.455045:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1783444167.455065:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246 00000100:00100000:1.0:1783444167.455067:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575189504 00000100:00100000:1.0:1783444167.455073:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575189504 00000100:00100000:0.0:1783444167.455076:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575189248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444167.455091:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1783444167.455099:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575188992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444167.455125:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575189248:12345-0@lo:400:kworker.0 Request processed in 51us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444167.455132:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246 00000100:00100000:1.0:1783444167.455142:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575188992:12345-0@lo:400:kworker.0 Request processed in 42us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444167.455149:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:0.0:1783444167.455158:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575189376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444167.455164:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1783444167.455183:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1783444167.455188:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575188608:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783444167.455197:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575189376:12345-0@lo:400:kworker.0 Request processed in 41us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444167.455205:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00010000:00020000:1.0:1783444167.455210:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444167.455241:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1783444167.455248:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575188864:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783444167.455255:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575188608:12345-0@lo:38:kworker.0 Request processed in 64us (556us total) trans 0 rc -19/-19 00010000:00020000:0.0:1783444167.455261:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444167.455266:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1783444167.455281:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1783444167.455286:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575189504:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444167.455298:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444167.455301:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575188864:12345-0@lo:38:kworker.0 Request processed in 48us (465us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444167.455310:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1783444167.455346:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575189504:12345-0@lo:38:kworker.0 Request processed in 58us (397us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444167.455352:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1783444167.455364:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575189120 00000100:00100000:0.0:1783444167.455369:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575189120 00000100:00100000:0.0:1783444167.455392:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:1.0:1783444167.455398:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575189376:0@lo:400:kworker.0 00000100:00100000:0.0:1783444167.455399:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575189120:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444167.455415:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444167.455416:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575189248:0@lo:400:kworker.0 00000100:00100000:0.0:1783444167.455448:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575189120:12345-0@lo:38:kworker.0 Request processed in 48us (557us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444167.455456:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00080000:1.0:1783444167.455479:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444167.455485:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444167.455489:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575188608:0@lo:38:kworker.0 00000100:00100000:0.0:1783444167.455515:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575188992:0@lo:400:kworker.0 00000100:00080000:3.0:1783444167.455552:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444167.455557:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444167.455560:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444167.456129:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444167.456134:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444167.456138:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575188864:0@lo:38:kworker.0 00000100:00080000:1.0:1783444167.456147:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444167.456150:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444167.456160:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575189120:0@lo:38:kworker.0 00000100:00080000:1.0:1783444167.456172:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444167.456175:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444167.456177:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575189504:0@lo:38:kworker.0 00000100:00100000:0.0:1783444167.465131:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575188736:0@lo:400:kworker.0 00010000:00010000:1.0:1783444167.581510:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444167.754379:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444167.754508:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444167.754780:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444167.754835:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557743616 00000400:00000100:3.0:1783444167.754846:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557743360 offset 0 length 224: 4 00000100:00100000:0.0:1783444167.754849:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557743616 00000100:00100000:0.0:1783444167.754981:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557743488 00000100:00100000:0.0:1783444167.754986:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557743488 00000100:00100000:0.0:1783444167.755013:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 768 00000100:00100000:0.0:1783444167.755026:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557743616:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444167.755129:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557743616:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 105us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444167.755138:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 768 00000100:00100000:0.0:1783444167.755158:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1035 00000100:00100000:0.0:1783444167.755163:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557743488:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444167.755192:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444167.755221:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557743488:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 57us (714us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444167.755228:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1035 00000100:00080000:0.0:1783444167.755267:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444167.755469:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444167.755500:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557743872 00000100:00100000:3.0:1783444167.755504:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557743872 00000100:00100000:3.0:1783444167.755543:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557743744 00000100:00100000:3.0:1783444167.755546:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557743744 00000100:00100000:3.0:1783444167.755570:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2248 00000100:00100000:3.0:1783444167.755577:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557743872:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444167.755613:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557743872:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 37us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444167.755630:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2248 00000100:00100000:3.0:1783444167.755643:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2249 00000100:00100000:3.0:1783444167.755649:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557743744:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:1.0:1783444167.755853:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444167.755863:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444167.756598:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557743744:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 941us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444167.756610:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2249 00000100:00100000:3.0:1783444168.477169:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444168.477196:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575189632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444168.477292:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444168.477382:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575189632 00000100:00100000:0.0:1783444168.477399:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575189632 00000100:00100000:0.0:1783444168.477484:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1783444168.477494:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575189632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444168.477531:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444168.477634:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575189632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444168.477642:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:2.0:1783444168.478071:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575189632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444168.478941:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575189760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444168.479036:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444168.480251:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575189760 00000100:00100000:2.0:1783444168.480262:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575189760 00000100:00100000:2.0:1783444168.480331:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:2.0:1783444168.480340:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575189760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444168.480385:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444168.483740:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575189760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3391us (4693us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444168.484005:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00000100:00100000:3.0:1783444168.485006:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575189760:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783444168.605098:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444169.630076:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444170.653045:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444171.683356:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444172.573902:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444172.573909:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444172.573912:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444172.573937:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3158 00000100:00080000:2.0:1783444172.573943:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444172.573950:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444172.573975:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368c9f69500 x1870073575190016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444172.574000:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444172.574003:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444172.574005:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444172.574008:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3158 00000100:00080000:2.0:1783444172.574011:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444172.574015:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444172.574025:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368c9f68000 x1870073575190272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444172.574052:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444172.574055:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444172.574058:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444172.574061:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3158 00000100:00080000:2.0:1783444172.574063:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444172.574067:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444172.574080:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368c9f68700 x1870073575190528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444172.574105:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444172.574108:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444172.574110:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444172.574121:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3158 00000100:00080000:2.0:1783444172.574123:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444172.574128:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444172.574363:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575190144:0@lo:400:kworker.0 00000100:00100000:1.0:1783444172.574453:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444172.574498:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783444172.574505:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575189888:0@lo:400:kworker.0 00000400:00000100:1.0:1783444172.574526:0:3634:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575189888 offset 0 length 224: 4 00000100:00100000:1.0:1783444172.574550:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575190784:0@lo:400:kworker.0 00000100:00100000:1.0:1783444172.574588:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444172.574619:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575190016:0@lo:38:kworker.0 00000100:00100000:1.0:1783444172.574642:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444172.574661:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575190272:0@lo:38:kworker.0 00000100:00100000:1.0:1783444172.574701:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444172.574720:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575190528:0@lo:38:kworker.0 00000100:00100000:1.0:1783444172.574766:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444172.574826:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575190144 00000100:00100000:1.0:1783444172.574834:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575190144 00000100:00100000:1.0:1783444172.574884:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575190016 00000100:00100000:1.0:1783444172.574887:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575190016 00000100:00100000:1.0:1783444172.574914:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575190272 00000100:00100000:1.0:1783444172.574917:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575190272 00000100:00100000:1.0:1783444172.574933:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1783444172.574942:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575190144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444172.574994:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575190144:12345-0@lo:400:kworker.0 Request processed in 53us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444172.575001:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1783444172.575021:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1783444172.575025:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575190016:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444172.575044:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444172.575090:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575190016:12345-0@lo:38:kworker.0 Request processed in 49us (432us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444172.575097:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1783444172.575110:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1783444172.575113:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575190272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444172.575121:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444172.575145:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575190272:12345-0@lo:38:kworker.0 Request processed in 29us (442us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444172.575150:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1783444172.575169:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575190784 00000100:00100000:1.0:1783444172.575184:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575190784 00000100:00100000:1.0:1783444172.575216:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250 00000100:00100000:1.0:1783444172.575222:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575190784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444172.575254:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575190784:12345-0@lo:400:kworker.0 Request processed in 32us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444172.575260:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250 00000100:00100000:1.0:1783444172.575295:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575190528 00000100:00100000:1.0:1783444172.575299:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575190528 00000100:00100000:1.0:1783444172.575322:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:1.0:1783444172.575326:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575190528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444172.575337:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444172.575364:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575190528:12345-0@lo:38:kworker.0 Request processed in 36us (598us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444172.575369:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00080000:1.0:1783444172.575384:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444172.575389:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444172.575428:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444172.575434:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444172.575437:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575190016:0@lo:38:kworker.0 00000100:00080000:1.0:1783444172.575447:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444172.575450:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444172.575453:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575190272:0@lo:38:kworker.0 00000100:00080000:1.0:1783444172.575461:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444172.575464:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444172.575467:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575190528:0@lo:38:kworker.0 00000100:00100000:1.0:1783444172.575507:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575190784:0@lo:400:kworker.0 00000100:00100000:1.0:1783444172.575518:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575190144:0@lo:400:kworker.0 00000100:00100000:2.0:1783444172.579530:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3444000 x1870073575190912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444172.579636:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575190400:0@lo:400:kworker.0 00000100:00100000:2.0:1783444172.579786:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444172.579844:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444172.579851:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575190656:0@lo:400:kworker.0 00000100:00100000:2.0:1783444172.579876:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444172.579911:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575190912:0@lo:38:kworker.0 00000100:00100000:2.0:1783444172.579934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444172.579962:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575190400 00000100:00100000:2.0:1783444172.579985:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575190400 00000100:00100000:2.0:1783444172.580037:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575190912 00000100:00100000:2.0:1783444172.580040:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575190912 00000100:00100000:2.0:1783444172.580061:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1783444172.580069:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575190400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444172.580123:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575190400:12345-0@lo:400:kworker.0 Request processed in 54us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444172.580140:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1783444172.580158:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1783444172.580162:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575190912:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444172.580181:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444172.580213:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575190912:12345-0@lo:38:kworker.0 Request processed in 49us (277us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444172.580233:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1783444172.580251:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575190656 00000100:00100000:2.0:1783444172.580255:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575190656 00000100:00100000:2.0:1783444172.580281:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251 00000100:00100000:2.0:1783444172.580287:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575190656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444172.580316:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575190656:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444172.580322:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251 00000100:00080000:2.0:1783444172.580338:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444172.580342:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444172.580387:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575190656:0@lo:400:kworker.0 00000100:00100000:2.0:1783444172.580400:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575190400:0@lo:400:kworker.0 00000100:00080000:2.0:1783444172.580432:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444172.580437:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444172.580440:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575190912:0@lo:38:kworker.0 00010000:00010000:1.0:1783444172.701100:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1783444172.880355:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557744000 offset 0 length 224: 4 00000100:00100000:3.0:1783444172.880398:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444172.880440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444172.880468:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444172.881128:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444172.881171:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557744256 00000100:00100000:3.0:1783444172.881389:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557744256 00000100:00100000:3.0:1783444172.881454:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557744128 00000100:00100000:3.0:1783444172.881458:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557744128 00000100:00100000:3.0:1783444172.881479:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 771 00000100:00100000:3.0:1783444172.881491:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557744256:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444172.881579:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557744256:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444172.882827:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 771 00000100:00100000:3.0:1783444172.882867:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1039 00000100:00100000:3.0:1783444172.882875:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557744128:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:3.0:1783444172.882900:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444172.882952:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557744128:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 76us (2523us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444172.882958:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1039 00000100:00100000:0.0:1783444172.883303:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557744384 00000100:00100000:0.0:1783444172.883311:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557744384 00000100:00100000:0.0:1783444172.883358:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557744512 00000100:00100000:0.0:1783444172.883361:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557744512 00000100:00100000:0.0:1783444172.883385:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5843 00000100:00100000:0.0:1783444172.883392:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2400:x1870073557744384:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1783444172.883416:0:8422:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38313e2 00000100:00080000:0.0:1783444172.883424:0:8422:0:(import.c:65:import_set_state_nolock()) ffff9368ff68a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783444172.883470:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969446 00000100:00100000:0.0:1783444172.883627:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+2:2400:x1870073557744384:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 233us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444172.883644:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5843 00000100:00100000:0.0:1783444172.883661:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5844 00000100:00100000:0.0:1783444172.883668:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2400:x1870073557744512:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1783444172.883691:0:8422:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38309e0 00000100:00080000:0.0:1783444172.883696:0:8422:0:(import.c:65:import_set_state_nolock()) ffff9368ef0ca000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1783444172.883898:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444172.883903:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444172.883905:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:0.0:1783444172.884044:0:8422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00010000:00010000:2.0:1783444172.889912:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444172.890125:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+2:2400:x1870073557744512:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 4757us (7298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444172.890160:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5844 00010000:00010000:0.0:1783444172.891176:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444173.597249:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444173.597268:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575191040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444173.597342:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444173.597447:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575191040 00000100:00100000:1.0:1783444173.597455:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575191040 00000100:00100000:1.0:1783444173.597510:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764 00000100:00100000:1.0:1783444173.597534:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575191040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444173.597567:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444173.597631:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575191040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444173.597639:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764 00000100:00100000:3.0:1783444173.597806:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575191040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444173.606004:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575191168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444173.606081:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444173.607759:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575191168 00000100:00100000:1.0:1783444173.607771:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575191168 00000100:00100000:1.0:1783444173.607873:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:1.0:1783444173.607883:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575191168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444173.607918:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444173.613011:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575191168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5118us (6919us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444173.613025:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:0.0:1783444173.615462:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575191168:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783444173.725281:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444174.751963:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444175.772886:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444176.797823:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444177.698223:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444177.698232:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444177.698237:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444177.698247:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3163 00000100:00080000:2.0:1783444177.698254:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444177.698261:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444177.698299:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3444e00 x1870073575191424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444177.698333:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444177.698337:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444177.698339:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444177.698342:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3163 00000100:00080000:2.0:1783444177.698345:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444177.698348:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444177.698360:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3445880 x1870073575191680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444177.698376:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444177.698379:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444177.698380:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444177.698383:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3163 00000100:00080000:2.0:1783444177.698385:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444177.698389:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444177.698398:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd158380 x1870073575191936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444177.698418:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444177.698421:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444177.698423:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444177.698426:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3163 00000100:00080000:2.0:1783444177.698428:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444177.698432:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444177.698453:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7868380 x1870073575192320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444177.698488:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575192064:0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.698571:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444177.698616:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783444177.698623:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575191296:0@lo:400:kworker.0 00000400:00000100:2.0:1783444177.698644:0:3635:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575191296 offset 0 length 224: 4 00000100:00100000:2.0:1783444177.698666:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575192192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.698689:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444177.698719:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575191424:0@lo:38:kworker.0 00000100:00100000:2.0:1783444177.698747:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444177.698767:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575191680:0@lo:38:kworker.0 00000100:00100000:2.0:1783444177.698813:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444177.698836:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575191936:0@lo:38:kworker.0 00000100:00100000:2.0:1783444177.698860:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444177.698891:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575192320:0@lo:38:kworker.0 00000100:00100000:2.0:1783444177.698914:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444177.698944:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575191552:0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.698969:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444177.698988:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444177.698995:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575191808:0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.699016:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444177.699045:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575192064 00000100:00100000:2.0:1783444177.699053:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575192064 00000100:00100000:2.0:1783444177.699116:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575192192 00000100:00100000:2.0:1783444177.699120:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575192192 00000100:00100000:2.0:1783444177.699145:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:2.0:1783444177.699154:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575192064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.699206:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575192064:12345-0@lo:400:kworker.0 Request processed in 53us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444177.699213:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00000100:00100000:2.0:1783444177.699230:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253 00000100:00100000:2.0:1783444177.699236:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575192192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.699265:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575192192:12345-0@lo:400:kworker.0 Request processed in 29us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444177.699272:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253 00000100:00100000:2.0:1783444177.699293:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575191424 00000100:00100000:2.0:1783444177.699297:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575191424 00000100:00100000:2.0:1783444177.699317:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575191680 00000100:00100000:2.0:1783444177.699320:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575191680 00000100:00100000:2.0:1783444177.699327:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575192320 00000100:00100000:2.0:1783444177.699329:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575192320 00000100:00100000:2.0:1783444177.699336:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575191552 00000100:00100000:2.0:1783444177.699338:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575191552 00000100:00100000:2.0:1783444177.699352:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575191808 00000100:00100000:2.0:1783444177.699355:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575191808 00000100:00100000:2.0:1783444177.699369:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1783444177.699374:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575191552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.699410:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575191552:12345-0@lo:400:kworker.0 Request processed in 35us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444177.699416:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1783444177.699428:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1783444177.699434:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575191808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.699472:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575191808:12345-0@lo:400:kworker.0 Request processed in 38us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444177.699478:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1783444177.699490:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1783444177.699494:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575191424:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444177.699513:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444177.699545:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575191424:12345-0@lo:38:kworker.0 Request processed in 50us (797us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444177.699551:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1783444177.699562:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1783444177.699566:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575191680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444177.699575:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444177.699618:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575191680:12345-0@lo:38:kworker.0 Request processed in 49us (805us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444177.699624:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1783444177.699635:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1783444177.699639:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575192320:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444177.699648:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444177.699669:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575192320:12345-0@lo:38:kworker.0 Request processed in 29us (754us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444177.699674:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:2.0:1783444177.699704:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444177.699708:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444177.699710:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444177.699775:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575191808:0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.699824:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575191552:0@lo:400:kworker.0 00000100:00080000:2.0:1783444177.699858:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444177.699862:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444177.699865:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575191424:0@lo:38:kworker.0 00000100:00080000:2.0:1783444177.699874:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444177.699877:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444177.699880:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575191680:0@lo:38:kworker.0 00000100:00080000:2.0:1783444177.699887:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444177.699890:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444177.699893:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575192320:0@lo:38:kworker.0 00000100:00100000:2.0:1783444177.699922:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575192192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444177.699935:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575192064:0@lo:400:kworker.0 00000100:00100000:3.0:1783444177.700391:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575191936 00000100:00100000:3.0:1783444177.700398:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575191936 00000100:00100000:3.0:1783444177.700436:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:3.0:1783444177.700441:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575191936:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444177.700455:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444177.700498:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575191936:12345-0@lo:38:kworker.0 Request processed in 56us (1637us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444177.700504:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00080000:3.0:1783444177.700533:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444177.700551:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444177.700555:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575191936:0@lo:38:kworker.0 00010000:00010000:1.0:1783444177.826493:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1783444178.022231:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557744640 offset 0 length 520: 4 00000100:00100000:0.0:1783444178.022277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444178.022370:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444178.022404:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557744768 00000100:00100000:0.0:1783444178.022414:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557744768 00000100:00100000:0.0:1783444178.022453:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557744896 00000100:00100000:0.0:1783444178.022457:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557744896 00000100:00100000:0.0:1783444178.022507:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 774 00000100:00100000:0.0:1783444178.022519:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557744896:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444178.022606:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557744896:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444178.022614:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 774 00000100:00100000:0.0:1783444178.022633:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1043 00000100:00100000:0.0:1783444178.022638:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557744768:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444178.022658:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444178.022696:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557744768:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 57us (419us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444178.022702:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1043 00000100:00080000:0.0:1783444178.022722:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000400:3.0:1783444178.653071:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444162/real 1783444162] req@ffff9368ea497480 x1870073575186688/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444178 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444178.653112:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9368ea497480 x1870073575186688/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444178.653141:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783444178.653147:0:3636:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783444178.653150:0:3636:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783444178.653152:0:3636:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783444178.653156:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368ea497480 x1870073575186688/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444178.653165:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368e69fc700 x1870073575188480/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444178.653339:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368c9f6bb80 x1870073575189888/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444188 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444178.653367:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368e3444000 x1870073575191296/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783444178.653394:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783444178.653397:0:3636:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783444178.653399:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783444178.653402:0:3636:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1783444178.653440:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575186688:0@lo:400:kworker.0 00000100:00080000:3.0:1783444178.653497:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444178.653503:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783444178.653506:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444178.653513:0:83732:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 2936 00000100:00080000:3.0:1783444178.653525:0:83732:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444178.653577:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c56f4380 x1870073575192448/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444178.653608:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444178.653612:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444178.653621:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444178.653626:0:83732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3168 00000100:00080000:3.0:1783444178.653628:0:83732:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444178.653632:0:83732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444178.653651:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c56f4000 x1870073575192576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444178.653671:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444178.653675:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444178.653677:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444178.653681:0:83732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3168 00000100:00080000:3.0:1783444178.653683:0:83732:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444178.653686:0:83732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444178.653700:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f8ffa300 x1870073575192832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444178.653715:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444178.653719:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444178.653720:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444178.653724:0:83732:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3168 00000100:00080000:3.0:1783444178.653726:0:83732:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444178.653729:0:83732:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444178.653740:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f8ffaa00 x1870073575193088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444178.653766:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444178.653769:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444178.653776:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444178.653780:0:83732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3168 00000100:00080000:3.0:1783444178.653783:0:83732:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444178.653815:0:83732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444178.653829:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f8ffb100 x1870073575193472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444178.653868:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575192448:0@lo:250:kworker.0 00000400:00000100:3.0:1783444178.653920:0:3632:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575192448 offset 0 length 520: 4 00000100:00100000:3.0:1783444178.653953:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575192576:0@lo:38:kworker.0 00000100:00100000:3.0:1783444178.653987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444178.654009:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575192832:0@lo:38:kworker.0 00000100:00100000:3.0:1783444178.654030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444178.654046:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575193088:0@lo:38:kworker.0 00000100:00100000:3.0:1783444178.654069:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444178.654084:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575193472:0@lo:38:kworker.0 00000100:00100000:3.0:1783444178.654119:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444178.654159:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575192576 00000100:00100000:3.0:1783444178.654168:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575192576 00000100:00100000:3.0:1783444178.654202:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575192832 00000100:00100000:3.0:1783444178.654205:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575192832 00000100:00100000:2.0:1783444178.655713:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575188480:0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.655749:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575192704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.655828:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444178.655878:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444178.655887:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575192960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.655914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444178.655918:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575193216:0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.655957:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575193472 00000100:00100000:1.0:1783444178.655960:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444178.655966:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575193472 00000100:00100000:2.0:1783444178.655993:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575192704 00000100:00100000:2.0:1783444178.655996:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575192704 00000100:00100000:1.0:1783444178.656001:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575191296:0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.656018:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575192960 00000100:00100000:1.0:1783444178.656032:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444178.656036:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575192960 00000100:00100000:1.0:1783444178.656041:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575193344:0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.656069:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1783444178.656079:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575192704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444178.656196:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444178.656327:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575192704:12345-0@lo:400:kworker.0 Request processed in 249us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444178.656336:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1783444178.656359:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1783444178.656367:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575193088 00000100:00100000:2.0:1783444178.656368:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575192960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444178.656374:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575193088 00000100:00100000:1.0:1783444178.656406:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1783444178.656410:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575192960:12345-0@lo:400:kworker.0 Request processed in 42us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444178.656416:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575193088:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783444178.656423:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1783444178.656437:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1783444178.656442:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575192576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444178.656451:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1783444178.656456:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444178.656511:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575192576:12345-0@lo:38:kworker.0 Request processed in 68us (2523us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444178.656519:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1783444178.656532:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1783444178.656536:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575193472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444178.656547:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444178.656577:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575189888:0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.656595:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575193472:12345-0@lo:38:kworker.0 Request processed in 55us (2474us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444178.656602:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1783444178.656613:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575193216 00000100:00100000:0.0:1783444178.656618:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575193216 00000100:00100000:0.0:1783444178.656654:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575193344 00000100:00100000:0.0:1783444178.656658:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575193344 00000100:00100000:2.0:1783444178.656663:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575192960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.656682:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575192704:0@lo:400:kworker.0 00000100:00100000:0.0:1783444178.656684:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254 00000100:00100000:0.0:1783444178.656694:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575193216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444178.656724:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255 00000100:00100000:2.0:1783444178.656735:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575193344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444178.656749:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575193216:12345-0@lo:400:kworker.0 Request processed in 56us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444178.656757:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254 00000100:00100000:2.0:1783444178.656777:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575193344:12345-0@lo:400:kworker.0 Request processed in 43us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444178.656780:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1783444178.656811:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575192832:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444178.656824:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444178.656858:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575192832:12345-0@lo:38:kworker.0 Request processed in 48us (2827us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444178.656875:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1783444178.657513:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255 00000100:00080000:0.0:1783444178.657607:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444178.657613:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444178.657617:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575192576:0@lo:38:kworker.0 00000100:00080000:0.0:1783444178.657629:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444178.657633:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444178.657635:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575192832:0@lo:38:kworker.0 00000100:00080000:0.0:1783444178.657644:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444178.657648:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444178.657651:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575193088:0@lo:38:kworker.0 00000100:00080000:0.0:1783444178.657660:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444178.657663:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444178.657677:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575193472:0@lo:38:kworker.0 00000100:00100000:0.0:1783444178.657731:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575193344:0@lo:400:kworker.0 00000100:00100000:0.0:1783444178.657743:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575193216:0@lo:400:kworker.0 00000100:00100000:1.0:1783444178.660878:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575193088:12345-0@lo:38:kworker.0 Request processed in 1756us (4100us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444178.660919:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1783444178.721508:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575193600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444178.721611:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444178.722162:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444178.722172:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575193728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444178.722208:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444178.722243:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575193600 00000100:00100000:3.0:1783444178.722251:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575193600 00000100:00100000:3.0:1783444178.722310:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575193728 00000100:00100000:3.0:1783444178.722313:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575193728 00000100:00100000:3.0:1783444178.722336:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:3.0:1783444178.722345:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575193600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444178.722372:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444178.722416:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575193600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444178.722423:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:3.0:1783444178.722439:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:3.0:1783444178.722445:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575193728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444178.722459:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444178.722485:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575193728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444178.722491:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:3.0:1783444178.722539:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575193728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444178.722588:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575193600:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1783444178.725683:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444178.725694:0:8415:0:(genops.c:906:class_export_put()) final put ffff9368ff68d000/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444178.725722:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68d000/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-OST0000 00000020:00000080:0.0:1783444178.725760:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff68a800 for lustre-OST0000 00000001:00100000:2.0:1783444178.729886:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:2.0:1783444178.729896:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368ef0cf800/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:2.0:1783444178.729932:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0cf800/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-OST0001 00000020:00000080:2.0:1783444178.729973:0:50586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef0ca000 for lustre-OST0001 00010000:00010000:3.0:1783444178.846762:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444179.871424:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444180.893948:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783444180.928531:0:85121:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783444180.928537:0:85121:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783444180.928539:0:85121:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783444180.928658:0:85121:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9368ef0cb000 00000020:01000004:2.0:1783444180.928676:0:85121:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783444180.928690:0:85121:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783444180.928704:0:85121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9368f8f199c0) 00000020:00000080:2.0:1783444180.928745:0:85121:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783444181.050442:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783444181.059742:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.062771:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.063212:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.063614:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.064220:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.064462:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.064825:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.065156:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.065387:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.065677:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.066048:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.066572:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.066855:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.067207:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.067411:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.067680:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.068089:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.068304:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.068606:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.068822:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.069139:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.070807:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783444181.071878:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.072406:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783444181.072743:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783444181.077057:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783444181.077461:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783444181.077783:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783444181.078100:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783444181.078367:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783444181.078642:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783444181.079103:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1783444181.079350:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783444181.087703:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.088397:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783444181.093773:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.094309:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.094647:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783444181.095051:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783444181.095373:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.095664:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783444181.095881:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.096201:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783444181.096403:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.096665:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783444181.096882:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.097614:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.098622:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.098829:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.100284:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.100629:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783444181.100862:0:85121:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1783444181.102453:0:85121:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783444181.102710:0:85121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783444181.102721:0:85121:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783444181.102732:0:85121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38314fa 00000020:01000004:3.0:1783444181.102739:0:85121:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783444181.102750:0:85121:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783444181.102756:0:85121:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9368ef0cb000 from MGS 00000020:01000004:3.0:1783444181.102760:0:85121:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783444181.102769:0:85121:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9368c50799c0) 00000020:00000080:3.0:1783444181.102781:0:85121:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1783444181.102884:0:85121:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368ef0cb000 from MGS, refs=2 00080000:01000000:3.0:1783444181.102906:0:85121:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783444181.102913:0:85121:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831508 00010000:00010000:3.0:1783444181.103026:0:85121:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1783444181.111058:0:85121:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783444181.119995:0:85125:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783444181.122362:0:85121:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783444181.122424:0:85121:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783444181.125206:0:85121:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783444181.125673:0:85121:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783444181.126706:0:85121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783444181.126714:0:85121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783444181.129318:0:85121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783444181.129331:0:85121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783444181.129778:0:85121:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783444181.129785:0:85121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783444181.131040:0:85121:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783444181.131064:0:85121:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1783444181.131066:0:85121:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1783444181.131070:0:85121:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1783444181.131076:0:85121:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 73, was 0): CONNECTING 00000100:00100000:2.0:1783444181.131082:0:85121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:1.0:1783444181.917858:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444182.943233:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444183.114432:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444183.114502:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444183.114624:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557745024 00000100:00100000:2.0:1783444183.114635:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557745024 00000100:00100000:2.0:1783444183.114706:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557745152 00000100:00100000:2.0:1783444183.114710:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557745152 00000100:00100000:2.0:1783444183.114769:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 777 00000100:00100000:2.0:1783444183.114780:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557745152:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444183.114888:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557745152:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 110us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444183.114896:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 777 00000100:00100000:2.0:1783444183.114917:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1047 00000100:00100000:2.0:1783444183.114921:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557745024:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444183.114943:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444183.114967:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557745024:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 44us (546us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444183.114973:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1047 00000100:00080000:1.0:1783444183.115145:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444183.837665:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444183.837675:0:83732:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783444183.837678:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444183.837682:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444183.837686:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444183.837694:0:83732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3169 00000100:00080000:3.0:1783444183.837699:0:83732:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444183.837707:0:83732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444183.837745:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018abb80 x1870073575193856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444183.837785:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444183.837806:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444183.837808:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444183.837811:0:83732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3169 00000100:00080000:3.0:1783444183.837814:0:83732:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444183.837818:0:83732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444183.837830:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018a9500 x1870073575194112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444183.837845:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783444183.838081:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575193984:0@lo:400:kworker.0 00000100:00100000:0.0:1783444183.838154:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444183.838187:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444183.838201:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575194240:0@lo:400:kworker.0 00000100:00100000:0.0:1783444183.838226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444183.838267:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575194368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444183.838293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444183.838325:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575193856:0@lo:38:kworker.0 00000100:00100000:0.0:1783444183.838351:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444183.838366:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575194112:0@lo:38:kworker.0 00000100:00100000:0.0:1783444183.838384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444183.838417:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575194368 00000100:00100000:0.0:1783444183.838424:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575194368 00000100:00100000:0.0:1783444183.838486:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:0.0:1783444183.838496:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575194368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444183.838523:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444183.838564:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575194368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444183.838572:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:0.0:1783444183.838595:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575193984 00000100:00100000:0.0:1783444183.838598:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575193984 00000100:00100000:0.0:1783444183.838624:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575194240 00000100:00100000:0.0:1783444183.838627:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575194240 00000100:00100000:0.0:1783444183.838642:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575193856 00000100:00100000:0.0:1783444183.838644:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575193856 00000100:00100000:0.0:1783444183.838653:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575194112 00000100:00100000:0.0:1783444183.838655:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575194112 00000100:00100000:0.0:1783444183.838664:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1783444183.838670:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575193984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444183.838706:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575193984:12345-0@lo:400:kworker.0 Request processed in 35us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444183.838720:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1783444183.838733:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1783444183.838738:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575194240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444183.838767:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575194240:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444183.838773:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1783444183.838784:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1783444183.838806:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575193856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444183.838824:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444183.838855:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575193856:12345-0@lo:38:kworker.0 Request processed in 66us (503us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444183.838861:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1783444183.838891:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1783444183.838895:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575194112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444183.838905:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444183.838927:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575194112:12345-0@lo:38:kworker.0 Request processed in 30us (542us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444183.838933:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1783444183.838973:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575194368:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783444183.838998:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444183.839002:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444183.839006:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575193856:0@lo:38:kworker.0 00000100:00080000:0.0:1783444183.839014:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444183.839022:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444183.839025:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575194112:0@lo:38:kworker.0 00000100:00100000:0.0:1783444183.839055:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575194240:0@lo:400:kworker.0 00000100:00100000:0.0:1783444183.839065:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575193984:0@lo:400:kworker.0 00000100:00080000:3.0:1783444183.839359:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444183.839363:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444183.839482:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444183.839487:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444183.839492:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444183.839501:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575194496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444183.839532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444183.839563:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575194496 00000100:00100000:1.0:1783444183.839567:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575194496 00000100:00100000:1.0:1783444183.839599:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:1.0:1783444183.839606:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575194496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444183.839623:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444183.839655:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575194496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444183.839661:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00080000:1.0:1783444183.839677:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444183.839698:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575194496:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783444183.844351:0:83732:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3169 00000100:00080000:3.0:1783444183.844359:0:83732:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444183.844368:0:83732:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444183.844413:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018a8a80 x1870073575194624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444183.844519:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444183.844523:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444183.844526:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444183.844531:0:83732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3169 00000100:00080000:3.0:1783444183.844533:0:83732:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444183.844538:0:83732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444183.844557:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018a8e00 x1870073575194752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444183.846619:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575194624:0@lo:38:kworker.0 00000100:00100000:0.0:1783444183.846701:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444183.846746:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575194752:0@lo:38:kworker.0 00000100:00100000:0.0:1783444183.848545:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444183.848681:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575194624 00000100:00100000:3.0:1783444183.848691:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575194624 00000100:00100000:3.0:1783444183.848745:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1783444183.848754:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575194624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444183.848781:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444183.848865:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575194624:12345-0@lo:38:kworker.0 Request processed in 110us (2163us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444183.848872:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:1.0:1783444183.849116:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575194752 00000100:00100000:1.0:1783444183.849121:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575194752 00000100:00100000:1.0:1783444183.849151:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:1.0:1783444183.849157:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575194752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444183.849168:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444183.849202:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575194752:12345-0@lo:38:kworker.0 Request processed in 44us (662us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444183.849209:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00080000:0.0:1783444183.849386:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444183.849392:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444183.849396:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575194624:0@lo:38:kworker.0 00000100:00080000:0.0:1783444183.849406:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444183.849409:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444183.849412:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575194752:0@lo:38:kworker.0 00010000:00010000:3.0:1783444183.965008:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444184.991019:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444186.013210:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444187.043173:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444188.064239:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444188.234017:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444188.234064:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444188.234100:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444188.234316:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557745280 00000100:00100000:1.0:1783444188.234327:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557745280 00000100:00100000:1.0:1783444188.234378:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1783444188.234396:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2400:x1870073557745280:12345-192.168.204.20@tcp:250:kworker.0 00010000:00080000:1.0:1783444188.234426:0:85127:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fea1b1de-aca2-4501-86bf-fe28138c0593@192.168.204.20@tcp t0 exp 0000000000000000 cur 3179 last 0 00000020:00000080:1.0:1783444188.234455:0:85127:0:(genops.c:1406:class_connect()) connect: client fea1b1de-aca2-4501-86bf-fe28138c0593, cookie 0x42cb6883e383150f 00000100:00080000:1.0:1783444188.234601:0:85127:0:(import.c:65:import_set_state_nolock()) ffff9368ff64f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444188.234667:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+5:2400:x1870073557745280:12345-192.168.204.20@tcp:250:kworker.0 Request processed in 270us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444188.234674:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1783444188.234951:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557745536 00000100:00100000:2.0:1783444188.234957:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557745536 00000100:00100000:2.0:1783444188.235016:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557745408 00000100:00100000:2.0:1783444188.235020:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557745408 00000100:00100000:2.0:1783444188.235044:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 780 00000100:00100000:2.0:1783444188.235053:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557745536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444188.235088:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557745536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 37us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444188.235096:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 780 00000100:00100000:2.0:1783444188.235114:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1051 00000100:00100000:2.0:1783444188.235119:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557745408:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444188.235134:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444188.235176:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557745408:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 55us (1075us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444188.235184:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1051 00000100:00080000:1.0:1783444188.236822:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444188.957203:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575194880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444188.957280:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444188.957293:0:3632:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444178/real 1783444178] req@ffff9367c56f4380 x1870073575192448/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444188 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444188.957321:0:3632:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9367c56f4380 x1870073575192448/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444188 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444188.957338:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444188.957354:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783444188.957387:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575192448:0@lo:250:kworker.0 00000100:00080000:2.0:1783444188.957420:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444188.957425:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783444188.957428:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444188.957433:0:50586:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3169 00000100:00080000:2.0:1783444188.957439:0:50586:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444188.957446:0:50586:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444188.957465:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c56f4380 x1870073575195008/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444188.957480:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444188.957484:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444188.957486:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 10000000:01000000:0.0:1783444188.957489:0:85121:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:2.0:1783444188.957490:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3174 00000100:00080000:2.0:1783444188.957494:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444188.957499:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00010000:00010000:0.0:1783444188.957508:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e38311c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38311c7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444188.957534:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f8ffbb80 x1870073575195136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:0.0:1783444188.957539:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e38311c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38311c7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957549:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00080000:2.0:1783444188.957563:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444188.957568:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00010000:00010000:0.0:1783444188.957568:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:2.0:1783444188.957570:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444188.957575:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3174 00000100:00080000:2.0:1783444188.957578:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00010000:00010000:0.0:1783444188.957580:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e38311c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38311c7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783444188.957582:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444188.957596:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f8ffb100 x1870073575195392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1783444188.957607:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c7645600/0x42cb6883e3831126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383112d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783444188.957616:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:0.0:1783444188.957616:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c7645600/0x42cb6883e3831126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383112d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783444188.957624:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444188.957629:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 10000000:01000000:0.0:1783444188.957629:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:2.0:1783444188.957637:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3174 00010000:00010000:0.0:1783444188.957637:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:2.0:1783444188.957640:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444188.957644:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00010000:00010000:0.0:1783444188.957644:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c7645600/0x42cb6883e3831126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383112d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.957659:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831149 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444188.957660:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f8ffa300 x1870073575195648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:0.0:1783444188.957678:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831149 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957684:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:2.0:1783444188.957688:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:0.0:1783444188.957689:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:2.0:1783444188.957693:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00010000:00010000:0.0:1783444188.957695:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831149 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783444188.957696:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444188.957703:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3174 00000100:00080000:2.0:1783444188.957706:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444188.957710:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00010000:00010000:0.0:1783444188.957726:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e383116c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831173 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444188.957732:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3444000 x1870073575195904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:0.0:1783444188.957735:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e383116c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831173 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957752:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444188.957758:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.957763:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e383116c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831173 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:2.0:1783444188.957771:0:3632:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9367c56f4380 x1870073575195008/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783444188.957772:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e383117a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831181 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.957826:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e383117a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831181 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957833:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444188.957836:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.957840:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e383117a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831181 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.957850:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383119d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.957855:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383119d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957859:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444188.957870:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.957874:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383119d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.957882:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38311a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38311ab expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.957887:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38311a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38311ab expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957892:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444188.957895:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.957897:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38311a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38311ab expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.957904:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e38311ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38311d5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.957910:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e38311ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38311d5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957914:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444188.957917:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.957920:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e38311ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38311d5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.957930:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c583ec00/0x42cb6883e3831134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383113b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.957936:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c583ec00/0x42cb6883e3831134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383113b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957950:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444188.957953:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.957956:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c583ec00/0x42cb6883e3831134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383113b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.957967:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5757000/0x42cb6883e3831150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831157 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.957973:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757000/0x42cb6883e3831150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831157 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.957977:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444188.957979:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.957982:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5757000/0x42cb6883e3831150 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831157 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.957993:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383115e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831165 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.957999:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383115e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831165 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444188.958134:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575194880 00000100:00100000:1.0:1783444188.958142:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575194880 00000100:00100000:1.0:1783444188.958201:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:1.0:1783444188.958210:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575194880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444188.958241:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444188.958292:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575194880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444188.958300:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:1.0:1783444188.958326:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575195520:0@lo:400:kworker.0 00000100:00100000:1.0:1783444188.958357:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444188.958389:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444188.958395:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575195776:0@lo:400:kworker.0 00000100:00100000:1.0:1783444188.958420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783444188.958447:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444188.958464:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575195520 00000100:00100000:1.0:1783444188.958475:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575195520 00000100:00100000:1.0:1783444188.958510:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1783444188.958516:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575195520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444188.958554:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575195520:12345-0@lo:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444188.958562:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1783444188.958584:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575195776 00000100:00100000:1.0:1783444188.958587:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575195776 00000100:00100000:1.0:1783444188.958611:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256 00000100:00100000:1.0:1783444188.958617:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575195776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444188.958649:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575195776:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444188.958655:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256 00000100:00080000:1.0:1783444188.958668:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444188.958671:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444188.958695:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575195776:0@lo:400:kworker.0 00000100:00100000:1.0:1783444188.958706:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575195520:0@lo:400:kworker.0 00000100:00100000:1.0:1783444188.958740:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575196032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444188.958767:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444188.958817:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575194880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444188.958830:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444188.958835:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575195264:0@lo:400:kworker.0 00000100:00100000:1.0:1783444188.958859:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444188.958886:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575196032 00000100:00100000:1.0:1783444188.958890:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575196032 00000100:00100000:1.0:1783444188.958910:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:1.0:1783444188.958926:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575196032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444188.958941:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444188.958975:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575196032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444188.958981:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 10000000:01000000:0.0:1783444188.959115:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444188.959122:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.959131:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383115e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831165 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.959143:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70e00/0x42cb6883e3831188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383118f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.959161:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70e00/0x42cb6883e3831188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383118f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.959166:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444188.959170:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.959174:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70e00/0x42cb6883e3831188 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383118f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444188.959183:0:85121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5757800/0x42cb6883e38311b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38311b9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444188.959190:0:85121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757800/0x42cb6883e38311b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38311b9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444188.959195:0:85121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444188.959198:0:85121:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444188.959201:0:85121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5757800/0x42cb6883e38311b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38311b9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444188.960301:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575195264 00000100:00100000:3.0:1783444188.960312:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575195264 00000100:00100000:3.0:1783444188.960384:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1783444188.960393:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575195264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444188.960454:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575195264:12345-0@lo:400:kworker.0 Request processed in 64us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444188.960461:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00080000:3.0:1783444188.960498:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444188.960673:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575196032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444188.960707:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575195264:0@lo:400:kworker.0 00000100:00080000:0.0:1783444189.001737:0:85121:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 74, was 0): CONNECTING 00000100:00080000:0.0:1783444189.001753:0:85121:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1783444189.005893:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444189.005932:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1783444189.005955:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:0:1870073575195008:0@lo:250:kworker.0 00000100:00080000:2.0:1783444189.005978:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.005983:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783444189.005987:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444189.005992:0:50586:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3179 00000100:00080000:2.0:1783444189.005998:0:50586:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444189.006005:0:50586:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444189.006058:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3445880 x1870073575196160/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444189.006080:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.006084:0:50586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444189.006119:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.006122:0:50586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444189.006145:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.006149:0:50586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444189.006165:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.006168:0:50586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783444189.006203:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575195136:0@lo:38:kworker.0 00000100:00100000:1.0:1783444189.006205:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575196672:0@lo:400:kworker.0 00000100:00100000:1.0:1783444189.006296:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.006356:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444189.006363:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575196288:0@lo:400:kworker.0 00000100:00100000:1.0:1783444189.006407:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.006446:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575196672 00000100:00100000:1.0:1783444189.006455:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575196672 00000100:00100000:1.0:1783444189.006503:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00100000:1.0:1783444189.006513:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575196672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444189.006569:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575196672:12345-0@lo:400:kworker.0 Request processed in 55us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.006577:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00100000:2.0:1783444189.006587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.006610:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575195392:0@lo:38:kworker.0 00000100:00100000:1.0:1783444189.006633:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575196672:0@lo:400:kworker.0 00000100:00100000:2.0:1783444189.006648:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.006673:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575195648:0@lo:38:kworker.0 00000100:00100000:1.0:1783444189.006678:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575196288 00000100:00100000:1.0:1783444189.006684:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575196288 00000100:00100000:2.0:1783444189.006699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.006717:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575195904:0@lo:38:kworker.0 00000100:00100000:1.0:1783444189.006717:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575195136 00000100:00100000:1.0:1783444189.006723:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575195136 00000100:00100000:2.0:1783444189.006741:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.006742:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575195392 00000100:00100000:1.0:1783444189.006746:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575195392 00000100:00100000:2.0:1783444189.006764:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575196160:0@lo:250:kworker.0 00000100:00100000:1.0:1783444189.006768:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575195904 00000100:00100000:1.0:1783444189.006772:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575195904 00000100:00100000:2.0:1783444189.006815:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.006821:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1783444189.006831:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575196288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444189.006872:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575196288:12345-0@lo:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.006877:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1783444189.006891:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1783444189.006895:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575195136:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444189.006916:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444189.006947:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575195136:12345-0@lo:38:kworker.0 Request processed in 50us (361us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444189.006953:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1783444189.006964:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1783444189.006969:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575195392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444189.006977:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444189.007001:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575195392:12345-0@lo:38:kworker.0 Request processed in 30us (354us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444189.007091:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1783444189.007105:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1783444189.007109:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575195904:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444189.007119:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444189.007147:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575195904:12345-0@lo:38:kworker.0 Request processed in 35us (407us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444189.007154:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:2.0:1783444189.007188:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444189.007194:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444189.007198:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575195136:0@lo:38:kworker.0 00000100:00100000:1.0:1783444189.007204:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575196288:0@lo:400:kworker.0 00000100:00080000:2.0:1783444189.007210:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783444189.007311:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575195648 00000100:00100000:0.0:1783444189.007317:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575195648 00000100:00100000:0.0:1783444189.007348:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1783444189.007353:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575195648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444189.007374:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1783444189.007399:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444189.007403:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575195392:0@lo:38:kworker.0 00000100:00100000:0.0:1783444189.007408:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575195648:12345-0@lo:38:kworker.0 Request processed in 52us (706us total) trans 0 rc -19/-19 00000100:00080000:2.0:1783444189.007423:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1783444189.007427:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00080000:2.0:1783444189.007429:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444189.007434:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575195648:0@lo:38:kworker.0 00000100:00080000:2.0:1783444189.007444:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444189.007448:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444189.007452:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575195904:0@lo:38:kworker.0 00000100:00100000:0.0:1783444189.007460:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575196160 00000100:00100000:0.0:1783444189.007465:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575196160 00000100:00100000:0.0:1783444189.007487:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783444189.007493:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3632:x1870073575196160:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1783444189.007508:0:85129:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo t0 exp 0000000000000000 cur 3180 last 0 00000020:00000080:0.0:1783444189.007535:0:85129:0:(genops.c:1406:class_connect()) connect: client c89ab73b-dbb2-4305-b221-37cc64d61227, cookie 0x42cb6883e3831516 00000100:00100000:2.0:1783444189.007563:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575196416:0@lo:400:kworker.0 00000100:00100000:2.0:1783444189.007602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.007622:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444189.007628:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575196544:0@lo:400:kworker.0 00000100:00100000:2.0:1783444189.007651:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.007678:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575196544 00000100:00100000:2.0:1783444189.007681:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575196544 00000100:00080000:0.0:1783444189.007704:0:85129:0:(import.c:65:import_set_state_nolock()) ffff9368ca0fe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444189.007707:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258 00000100:00100000:2.0:1783444189.007715:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575196544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444189.007765:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+5:3632:x1870073575196160:12345-0@lo:250:kworker.0 Request processed in 270us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444189.007767:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575196544:12345-0@lo:400:kworker.0 Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444189.007784:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258 00000100:00100000:0.0:1783444189.007784:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783444189.007888:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575196416 00000100:00100000:1.0:1783444189.007893:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575196416 00000100:00100000:1.0:1783444189.007921:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:1.0:1783444189.007927:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575196416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444189.007960:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575196416:12345-0@lo:400:kworker.0 Request processed in 33us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.007967:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1783444189.017144:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575196544:0@lo:400:kworker.0 00000100:00100000:0.0:1783444189.017168:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575196416:0@lo:400:kworker.0 00000100:00100000:0.0:1783444189.017212:0:3632:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 24 00000100:00080000:0.0:1783444189.017222:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1783444189.017230:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783444189.017235:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783444189.017240:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783444189.017243:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783444189.017274:0:3632:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783444189.017289:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575196160:0@lo:250:kworker.0 00000020:01000000:0.0:1783444189.017339:0:77261:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.120@tcp 10000000:01000000:0.0:1783444189.017363:0:77261:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1783444189.017380:0:77261:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783444189.017382:0:77261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783444189.017383:0:77261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444189.017385:0:77261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444189.017393:0:77261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444189.017394:0:77261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444189.017395:0:77261:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444189.017397:0:77261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444189.017398:0:77261:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783444189.017437:0:77261:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1783444189.017445:0:77261:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1783444189.017447:0:77261:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783444189.017448:0:77261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783444189.017449:0:77261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444189.017450:0:77261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444189.017451:0:77261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444189.017452:0:77261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444189.017453:0:77261:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444189.017454:0:77261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444189.017455:0:77261:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783444189.017472:0:77261:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1783444189.017476:0:77261:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1783444189.017478:0:77261:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1783444189.017479:0:77261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783444189.017480:0:77261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444189.017481:0:77261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444189.017482:0:77261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444189.017483:0:77261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444189.017484:0:77261:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783444189.017485:0:77261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444189.017486:0:77261:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1783444189.017496:0:77261:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1783444189.017522:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575196928:0@lo:253:kworker.0 00000100:00100000:0.0:1783444189.017586:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.017627:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444189.017633:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575197056:0@lo:253:kworker.0 00000100:00100000:0.0:1783444189.017659:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.017684:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575196928 00000100:00100000:0.0:1783444189.017691:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575196928 00000100:00100000:0.0:1783444189.017725:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575197056 00000100:00100000:0.0:1783444189.017727:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575197056 00000100:00100000:0.0:1783444189.017750:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783444189.017757:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:3633:x1870073575196928:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783444189.017786:0:85128:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1783444189.017847:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783444189.017854:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+6:3633:x1870073575197056:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783444189.017868:0:85129:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:0.0:1783444189.018016:0:85131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783444189.018113:0:85128:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 103 00000100:00100000:3.0:1783444189.020408:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575196800:0@lo:253:kworker.0 00000100:00100000:3.0:1783444189.020493:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.020621:0:85127:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1783444189.020632:0:85127:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1783444189.021297:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575196800 00000100:00100000:0.0:1783444189.021307:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575196800 20000000:01000000:0.0:1783444189.022463:0:85133:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783444189.022469:0:85133:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783444189.022472:0:85133:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783444189.022475:0:85133:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783444189.022708:0:85133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783444189.023140:0:85128:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444189.023167:0:85128:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783444189.023340:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783444189.023355:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3636:x1870073575196800:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783444189.023400:0:85132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:1.0:1783444189.035536:0:85121:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1783444189.035561:0:85121:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783444189.035609:0:85121:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783444189.035616:0:85121:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783444189.035724:0:85121:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783444189.035775:0:85121:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783444189.035780:0:85121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783444189.035781:0:85121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783444189.035783:0:85121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444189.035784:0:85121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444189.035785:0:85121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 20000000:01000000:2.0:1783444189.041084:0:85128:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444189.041099:0:85128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783444189.041298:0:85132:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783444189.041429:0:85131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444189.041435:0:85131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444189.041464:0:85131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.041485:0:85131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444189.041496:0:85131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000062352s 00010000:00010000:0.0:1783444189.041501:0:85131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.041508:0:85131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.041533:0:85131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.041541:0:85131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.041546:0:85131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444189.041551:0:85131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.041560:0:85131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.041576:0:85131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.041585:0:85131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444189.041586:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3633:x1870073575196928:12345-0@lo:253:kworker.0 Request processed in 23824us (23995us total) trans 0 rc 0/0 00010000:00010000:0.0:1783444189.041600:0:85131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05c00/0x42cb6883e383151d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444189.041608:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1783444189.041662:0:3633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783444189.041664:0:3633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783444189.041666:0:3633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444189.041667:0:3633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444189.041669:0:3633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444189.041671:0:3633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444189.041672:0:3633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444189.041674:0:3633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444189.041676:0:3633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783444189.041680:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575196928:0@lo:253:kworker.0 00000020:01000004:1.0:1783444189.041712:0:85121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444189.041714:0:85121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783444189.041715:0:85121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783444189.041717:0:85121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444189.041718:0:85121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783444189.041722:0:85121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783444189.041725:0:85121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783444189.041727:0:85121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783444189.041728:0:85121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444189.041730:0:85121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444189.041731:0:85121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444189.041732:0:85121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444189.041733:0:85121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783444189.041734:0:85121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783444189.041735:0:85121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444189.041743:0:85121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783444189.041780:0:85121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783444189.041817:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197184:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783444189.041859:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.041903:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444189.042016:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575197184 00000100:00100000:2.0:1783444189.042024:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575197184 00000100:00100000:2.0:1783444189.042074:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783444189.042090:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:85121:x1870073575197184:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783444189.042130:0:85127:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444189.042133:0:85127:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783444189.042136:0:85127:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1783444189.042144:0:85127:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783444189.055535:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:85121:x1870073575197184:12345-0@lo:253:mount.lustre.0 Request processed in 13436us (13665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.055552:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783444189.057237:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197184:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783444189.057258:0:85121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783444189.057261:0:85121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783444189.057263:0:85121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783444189.057265:0:85121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444189.057266:0:85121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444189.057267:0:85121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444189.057268:0:85121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444189.057270:0:85121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783444189.057271:0:85121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783444189.057273:0:85121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444189.057274:0:85121:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783444189.057300:0:85121:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9368ef0cb000 from lustre-MDT0000 10000000:01000000:1.0:1783444189.057334:0:85121:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783444189.057337:0:85121:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783444189.057346:0:85121:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9368ef0cb000 10000000:01000000:1.0:1783444189.057350:0:85121:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783444189.057355:0:85121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9368ef0cb000 10000000:01000000:1.0:1783444189.057357:0:85121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783444189.057361:0:85121:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ef0cb000 from 1 10000000:01000000:1.0:1783444189.057377:0:85121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783444189.057415:0:85121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.057426:0:85121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.057435:0:85121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444189.057468:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444189.057520:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.057567:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444189.057587:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575197312 00000100:00100000:2.0:1783444189.057596:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575197312 00000100:00100000:2.0:1783444189.057646:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783444189.057656:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:85121:x1870073575197312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444189.057671:0:85128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444189.057689:0:85128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583e200/0x42cb6883e383152b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831524 expref: -99 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444189.057715:0:85128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583e200/0x42cb6883e383152b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831524 expref: 8 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444189.057726:0:85128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583e200/0x42cb6883e383152b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831524 expref: 8 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444189.057735:0:85128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583e200, rc 0) 00000100:00100000:2.0:1783444189.057783:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:85121:x1870073575197312:12345-0@lo:101:mount.lustre.0 Request processed in 128us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444189.057815:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783444189.058140:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444189.058153:0:85121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.058162:0:85121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444189.058178:0:85121:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783444189.058195:0:85121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.058203:0:85121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444189.058209:0:85121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783444189.058214:0:85121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783444189.058218:0:85121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9368ef0cb000 10000000:01000000:1.0:1783444189.058221:0:85121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783444189.058224:0:85121:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783444189.058227:0:85121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783444189.058243:0:85121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.058249:0:85121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.058266:0:85121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444189.058304:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444189.058334:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.058361:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575197440 00000100:00100000:1.0:1783444189.058375:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575197440 00000100:00100000:1.0:1783444189.058399:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783444189.058405:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:85121:x1870073575197440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444189.058414:0:85128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444189.058424:0:85128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6a55a00/0x42cb6883e3831539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831532 expref: -99 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.058437:0:85128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a55a00/0x42cb6883e3831539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831532 expref: 9 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.058445:0:85128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6a55a00/0x42cb6883e3831539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831532 expref: 9 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.058452:0:85128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6a55a00, rc 0) 00000100:00100000:1.0:1783444189.058477:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85121:x1870073575197440:12345-0@lo:101:mount.lustre.0 Request processed in 72us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.058483:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783444189.058516:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.058529:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444189.058538:0:85121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.058552:0:85121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444189.058606:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444189.058630:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.058650:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575197568 00000100:00100000:1.0:1783444189.058653:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575197568 00000100:00100000:1.0:1783444189.058671:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783444189.058676:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85121:x1870073575197568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444189.058834:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85121:x1870073575197568:12345-0@lo:501:mount.lustre.0 Request processed in 156us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.058841:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783444189.058866:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.058878:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444189.058904:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444189.058943:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.058964:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575197696 00000100:00100000:1.0:1783444189.058967:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575197696 00000100:00100000:1.0:1783444189.058984:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783444189.058990:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85121:x1870073575197696:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444189.059461:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5919780 going to sleep for 11 seconds 20000000:01000000:0.0:1783444189.059559:0:85132:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783444189.059573:0:85132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783444189.059699:0:85129:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783444189.059985:0:85131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783444189.059990:0:85131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783444189.060111:0:85131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060137:0:85131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783444189.060146:0:85131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000156935s 00010000:00010000:1.0:1783444189.060151:0:85131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060159:0:85131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060166:0:85131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060173:0:85131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060179:0:85131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444189.060184:0:85131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060192:0:85131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060207:0:85131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060214:0:85131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.060220:0:85131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831540 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444189.064449:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:3636:x1870073575196800:12345-0@lo:253:kworker.0 Request processed in 41090us (43947us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.064463:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1783444189.064606:0:3636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783444189.064609:0:3636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783444189.064610:0:3636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444189.064611:0:3636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444189.064612:0:3636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444189.064613:0:3636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444189.064615:0:3636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444189.064617:0:3636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444189.064627:0:3636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783444189.064631:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575196800:0@lo:253:kworker.0 00000100:00100000:1.0:1783444189.065457:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85121:x1870073575197696:12345-0@lo:503:mount.lustre.0 Request processed in 6462us (6509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.065467:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783444189.065569:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575197696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444189.066022:0:85134:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85134:1870073575197824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444189.066074:0:85134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.066115:0:85134:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444189.066249:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575197824 00000100:00100000:3.0:1783444189.066257:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575197824 00000100:00100000:3.0:1783444189.066297:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783444189.066306:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85134:x1870073575197824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444189.067336:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85134:x1870073575197824:12345-0@lo:502:llog_process_th.0 Request processed in 1027us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.067346:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783444189.067734:0:85134:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85134:1870073575197824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444189.067767:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444189.067778:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.067781:0:85134:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783444189.067885:0:85134:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783444189.067890:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444189.067905:0:85134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9368f8f1b380) 00000020:00000080:2.0:1783444189.067927:0:85134:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1783444189.067932:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783444189.068158:0:85134:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783444189.068167:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e383154e 00000020:00000080:2.0:1783444189.068387:0:85134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783444189.068393:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444189.068397:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.068399:0:85134:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783444189.068401:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444189.068405:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.068407:0:85134:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783444189.068410:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444189.068419:0:85134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9368f8f18000) 00000020:00000080:2.0:1783444189.068431:0:85134:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1783444189.068436:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783444189.068437:0:85134:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783444189.068441:0:85134:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783444189.068446:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783444189.068495:0:85134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368ef0cb000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783444189.068508:0:85134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9368f8f1cd40) 00000020:00000080:2.0:1783444189.068518:0:85134:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1783444189.068578:0:85134:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783444189.068585:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3831563 00000020:00000080:2.0:1783444189.068681:0:85134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783444189.068688:0:85134:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783444189.068702:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42cb6883e383156a 00080000:01000000:2.0:1783444189.068707:0:85134:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783444189.068711:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831571 20000000:01000000:3.0:1783444189.069228:0:85129:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783444189.069243:0:85129:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1783444189.069392:0:85131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783444189.069398:0:85131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783444189.069419:0:85131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069435:0:85131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783444189.069444:0:85131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000156935s 00010000:00010000:1.0:1783444189.069449:0:85131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069456:0:85131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069462:0:85131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069469:0:85131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069475:0:85131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444189.069480:0:85131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069488:0:85131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069515:0:85131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069523:0:85131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.069529:0:85131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831578 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444189.069678:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3633:x1870073575197056:12345-0@lo:253:kworker.0 Request processed in 51817us (52010us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.069688:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1783444189.070255:0:3633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1783444189.070259:0:3633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783444189.070261:0:3633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444189.070262:0:3633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444189.070263:0:3633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444189.070265:0:3633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444189.070267:0:3633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783444189.070268:0:3633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444189.070270:0:3633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783444189.070273:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575197056:0@lo:253:kworker.0 00010000:00010000:0.0:1783444189.091711:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444189.229211:0:85134:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1783444189.229359:0:85134:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 778015c5-4969-44f5-82a5-0f6eadd152d5 idx: 0 lr: 0 srv lr: 98784247808 lx: 0 gen 23 00000001:00080000:2.0:1783444189.235356:0:85134:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 22 00000001:00000004:2.0:1783444189.235391:0:85134:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:2.0:1783444189.235554:0:85134:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1783444189.235614:0:85134:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368caa40f00: xid 1870073557736960, transno 98784247809, client gen 23, slot idx 0 00000020:00000080:2.0:1783444189.237350:0:85134:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9367c3330000) 00000020:00000080:2.0:1783444189.237386:0:85134:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1783444189.237472:0:85134:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783444189.237478:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831594 00000020:00000080:0.0:1783444189.242555:0:85134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783444189.272684:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42cb6883e383159b 00000020:00000080:2.0:1783444189.274123:0:85134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783444189.274140:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444189.274149:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.274152:0:85134:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783444189.274156:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783444189.274159:0:85134:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1783444189.274160:0:85134:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444189.274162:0:85134:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444189.274164:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783444189.274167:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.274168:0:85134:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783444189.274170:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444189.274175:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.274177:0:85134:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783444189.274181:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783444189.274235:0:85134:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783444189.274252:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444189.274266:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.274268:0:85134:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783444189.274272:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444189.274275:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.274276:0:85134:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1783444189.274278:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783444189.274284:0:85134:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:2.0:1783444189.274308:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444189.274324:0:85134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9367c3333380) 00000020:00000080:2.0:1783444189.274348:0:85134:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1783444189.274354:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783444189.274438:0:85134:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1783444189.274444:0:85134:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783444189.274450:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38315a9 00010000:00080000:2.0:1783444189.274480:0:85134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9367c229d000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1783444189.282555:0:85134:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1783444189.285336:0:85134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444189.285353:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783444189.285408:0:85134:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783444189.285435:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38315b0 00000100:00080000:2.0:1783444189.285447:0:85134:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444189.285453:0:85134:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9367c229d000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444189.285501:0:85134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f7b80 x1870073575197952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444189.285528:0:85134:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783444189.285567:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.285572:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444189.285575:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444189.285579:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3179 00000100:00080000:2.0:1783444189.285591:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444189.285596:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444189.285609:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f6a00 x1870073575198080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444189.285621:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.285624:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444189.285626:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444189.285629:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3179 00000100:00080000:2.0:1783444189.285632:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444189.285635:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444189.285644:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f5500 x1870073575198208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444189.285653:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.285656:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444189.285658:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444189.285661:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3179 00000100:00080000:2.0:1783444189.285663:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444189.285666:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444189.285675:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f5880 x1870073575198336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444189.285684:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444189.285687:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444189.285689:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444189.285692:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3179 00000100:00080000:2.0:1783444189.285698:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444189.285702:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444189.285713:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f4a80 x1870073575198464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:2.0:1783444189.285768:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444189.285772:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.285774:0:85134:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783444189.285777:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783444189.285780:0:85134:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1783444189.285782:0:85134:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444189.285784:0:85134:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444189.285785:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783444189.285820:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.285822:0:85134:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783444189.285826:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783444189.285831:0:85134:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783444189.285834:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.285836:0:85134:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783444189.285839:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783444189.285843:0:85134:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1783444189.285866:0:85134:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783444189.285869:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444189.285881:0:85134:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9367c33319c0) 00000020:00000080:2.0:1783444189.285897:0:85134:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783444189.285901:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783444189.285973:0:85134:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783444189.285980:0:85134:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783444189.285987:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38315be 00000100:00100000:0.0:1783444189.286110:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575197952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783444189.286187:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.286224:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575198080:0@lo:38:kworker.0 00010000:00080000:2.0:1783444189.286238:0:85134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9367c5032000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00000100:00100000:0.0:1783444189.286265:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.286286:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575198208:0@lo:38:kworker.0 00000100:00100000:0.0:1783444189.286306:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.286320:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575198336:0@lo:38:kworker.0 00000100:00100000:0.0:1783444189.286337:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.286352:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575198464:0@lo:38:kworker.0 00000100:00100000:0.0:1783444189.286381:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.286417:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575198080 00000100:00100000:0.0:1783444189.286423:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575198080 00000100:00100000:0.0:1783444189.286447:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575198208 00000100:00100000:0.0:1783444189.286450:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575198208 00010000:00010000:2.0:1783444189.286453:0:85134:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1783444189.286458:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575198464 00000100:00100000:0.0:1783444189.286460:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575198464 00000100:00100000:0.0:1783444189.286486:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1783444189.286493:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575198080:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783444189.286540:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575198080:12345-0@lo:38:kworker.0 Request processed in 47us (275us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783444189.286547:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1783444189.286560:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1783444189.286564:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575198208:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783444189.286588:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575198208:12345-0@lo:38:kworker.0 Request processed in 23us (281us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783444189.286831:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575197952 00000100:00100000:3.0:1783444189.286836:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575197952 00000100:00100000:3.0:1783444189.286858:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575198336 00000100:00100000:3.0:1783444189.286862:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575198336 00000100:00100000:3.0:1783444189.286880:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1783444189.286883:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1783444189.286885:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575197952:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783444189.286944:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:2.0:1783444189.286955:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575198336:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783444189.286995:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575198336:12345-0@lo:38:kworker.0 Request processed in 39us (657us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783444189.287002:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00010000:00080000:3.0:1783444189.287178:0:23687:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3180 last 0 00000020:00000080:3.0:1783444189.287216:0:23687:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38315c5 00000004:00100000:3.0:1783444189.287231:0:23687:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783444189.287330:0:23687:0:(import.c:65:import_set_state_nolock()) ffff9368ef12e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444189.287388:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575197952:12345-0@lo:38:llog_process_th.0 Request processed in 502us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.287395:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000040:01000000:2.0:1783444189.288262:0:85134:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783444189.288287:0:85134:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783444189.288665:0:85134:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:2.0:1783444189.293483:0:85134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783444189.293643:0:85134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:2.0:1783444189.293893:0:85134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000100:00100000:1.0:1783444189.297990:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1783444189.298008:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575198464:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783444189.298133:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575198464:12345-0@lo:38:kworker.0 Request processed in 128us (11750us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783444189.298141:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1783444189.298229:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783444189.298241:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1783444189.298252:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783444189.298258:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783444189.298261:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c229d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783444189.298286:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575197952:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783444189.298303:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444189.298307:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783444189.298310:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575198080:0@lo:38:kworker.0 00000100:00080000:1.0:1783444189.298458:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444189.298464:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783444189.298467:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575198208:0@lo:38:kworker.0 00000100:00080000:1.0:1783444189.298569:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444189.298574:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783444189.298578:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575198336:0@lo:38:kworker.0 00000100:00080000:1.0:1783444189.298589:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444189.298592:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783444189.298596:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575198464:0@lo:38:kworker.0 00000100:00100000:1.0:1783444189.299620:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575198592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444189.299676:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.301714:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575198592 00000100:00100000:2.0:1783444189.301729:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575198592 00000100:00100000:2.0:1783444189.301816:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:2.0:1783444189.301826:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575198592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444189.301869:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444189.301946:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575198592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444189.301953:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1783444189.303973:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575198592:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783444189.305303:0:85140:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:2.0:1783444189.305311:0:85140:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1783444189.305685:0:85140:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1783444189.305708:0:85140:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1783444189.305888:0:85140:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:2.0:1783444189.305892:0:85140:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783444189.308314:0:85134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444189.308411:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783444189.308460:0:85134:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783444189.308559:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38315cc 00000100:00080000:2.0:1783444189.308574:0:85134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444189.308590:0:85134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9367c5032000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444189.308626:0:85134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f4700 x1870073575198720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444189.308707:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575198720:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783444189.308782:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444189.308903:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575198720 00000100:00100000:3.0:1783444189.308913:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575198720 00000100:00100000:3.0:1783444189.308953:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5845 00000100:00100000:3.0:1783444189.308961:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3632:x1870073575198720:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783444189.308988:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3180 last 0 00000100:00080000:2.0:1783444189.309174:0:85134:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783444189.309272:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444189.309277:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.309279:0:85134:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783444189.309283:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783444189.309285:0:85134:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1783444189.309287:0:85134:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444189.309289:0:85134:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444189.309290:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783444189.309293:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.309294:0:85134:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783444189.309296:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783444189.309301:0:85134:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783444189.309304:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444189.309306:0:85134:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783444189.309309:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783444189.309313:0:85134:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1783444189.310573:0:85134:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783444189.310581:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444189.310600:0:85134:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9367c3334d40) 00000020:00000080:2.0:1783444189.310626:0:85134:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1783444189.310632:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783444189.310712:0:85134:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783444189.310719:0:85134:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783444189.310725:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38315e1 00010000:00080000:2.0:1783444189.310757:0:85134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ff5e7000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00000020:00000080:3.0:1783444189.311122:0:26209:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38315d3 00002000:00100000:3.0:1783444189.311138:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9368f8ca3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783444189.311142:0:26209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783444189.311146:0:26209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783444189.311241:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783444189.311275:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444189.311600:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575198720:12345-0@lo:8:llog_process_th.0 Request processed in 2637us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.311610:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5845 00000100:00100000:1.0:1783444189.312478:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783444189.312567:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783444189.312577:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783444189.312582:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783444189.312586:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c5032000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783444189.312616:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783444189.312624:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575198720:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1783444189.312725:0:85140:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783444189.312829:0:85140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3180355039274ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783444189.312837:0:85140:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:2.0:1783444189.312994:0:85134:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:0.0:1783444189.313163:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575198848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444189.313224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.313536:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575198848 00000100:00100000:0.0:1783444189.313544:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575198848 00000100:00100000:0.0:1783444189.313608:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1783444189.313618:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575198848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444189.313639:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444189.313681:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575198848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444189.313689:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1783444189.313733:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575198848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783444189.314198:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:01000000:2.0:1783444189.315182:0:85134:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783444189.315217:0:85134:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783444189.316782:0:85134:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000004:00080000:1.0:1783444189.318257:0:85122:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1783444189.318635:0:85134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783444189.318665:0:85134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:2.0:1783444189.318838:0:85134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:0.0:1783444189.325977:0:85142:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1783444189.325987:0:85142:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783444189.331090:0:85134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444189.331272:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783444189.331328:0:85134:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783444189.331499:0:85134:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38315e8 00000100:00080000:0.0:1783444189.331512:0:85134:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783444189.331527:0:85134:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9368ff5e7000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444189.331568:0:85134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd15e300 x1870073575198976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444189.331604:0:85134:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783444189.331704:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444189.331709:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444189.331711:0:85134:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783444189.331714:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444189.331719:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444189.331720:0:85134:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783444189.331724:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783444189.331726:0:85134:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783444189.331728:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444189.331730:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444189.331732:0:85134:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783444189.331734:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444189.331736:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444189.331737:0:85134:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783444189.331741:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783444189.331774:0:85134:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85134:1870073575199104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444189.331877:0:85134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.331922:0:85134:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.332178:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575198976:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783444189.332214:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444189.332431:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575199104 00000100:00100000:3.0:1783444189.332439:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575199104 00000100:00100000:0.0:1783444189.332448:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575198976 00000100:00100000:0.0:1783444189.332452:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575198976 00000100:00100000:3.0:1783444189.332476:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783444189.332480:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5846 00000100:00100000:3.0:1783444189.332484:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:85134:x1870073575199104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444189.332485:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3632:x1870073575198976:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783444189.332510:0:26212:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3180 last 0 00000020:00000080:0.0:1783444189.332536:0:26212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38315ef 00002000:00100000:0.0:1783444189.332549:0:26212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9368ead89800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783444189.332562:0:26212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783444189.332565:0:26212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783444189.332642:0:26212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783444189.332665:0:26212:0:(import.c:65:import_set_state_nolock()) ffff9368ead8c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444189.332672:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:85134:x1870073575199104:12345-0@lo:502:llog_process_th.0 Request processed in 189us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.332680:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783444189.332712:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575198976:12345-0@lo:8:llog_process_th.0 Request processed in 226us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444189.332719:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5846 00000100:00100000:0.0:1783444189.332752:0:85134:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85134:1870073575199104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444189.332779:0:85134:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444189.332785:0:85134:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444189.332809:0:85134:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783444189.332816:0:85134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:2.0:1783444189.334527:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783444189.334539:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783444189.334548:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783444189.334554:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783444189.334558:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ff5e7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783444189.334576:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783444189.334584:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575198976:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1783444189.335128:0:85121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783444189.335164:0:85121:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783444189.335190:0:85121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.335219:0:85121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444189.335229:0:85121:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cb000 from 1 10000000:01000000:1.0:1783444189.335232:0:85121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783444189.335286:0:85121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.335295:0:85121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.335306:0:85121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444189.335332:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575199232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444189.335411:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.335454:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444189.335469:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575199232 00000100:00100000:3.0:1783444189.335477:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575199232 00000100:00100000:3.0:1783444189.335536:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783444189.335546:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:85121:x1870073575199232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444189.335560:0:85127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444189.335576:0:85127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38315f6 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.335599:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 9 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.335609:0:85127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 9 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.335629:0:85127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26800, rc 0) 00000100:00100000:3.0:1783444189.335663:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85121:x1870073575199232:12345-0@lo:101:mount.lustre.0 Request processed in 119us (253us total) trans 0 rc 0/0 00000040:00080000:0.0:1783444189.335665:0:85142:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 3 count 2 00000100:00100000:3.0:1783444189.335670:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000040:00080000:0.0:1783444189.335693:0:85142:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:0.0:1783444189.335698:0:85142:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1783444189.335707:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444189.335715:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575199360:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783444189.335720:0:85142:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1783444189.335743:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444189.335772:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575199360 00000100:00100000:3.0:1783444189.335776:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575199360 00000004:00080000:0.0:1783444189.335776:0:85142:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3180377986172ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783444189.335781:0:85142:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783444189.335826:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5847 00000100:00100000:3.0:1783444189.335832:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575199360:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783444189.335842:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00080000:3.0:1783444189.335850:0:26211:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00000100:00100000:0.0:1783444189.335850:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575199488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444189.335881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444189.335916:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575199360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 83us (172us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444189.335923:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5847 00000100:00080000:3.0:1783444189.335940:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1783444189.335964:0:3634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9368dd15f800, transno 0 00000004:00080000:3.0:1783444189.335970:0:3634:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9368dd15f800/1, rc -2, transno 0 00000100:00100000:3.0:1783444189.335985:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575199360:0@lo:6:osp-syn-1-0.0 00000040:00080000:0.0:1783444189.336537:0:85142:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1783444189.336559:0:85142:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1783444189.337390:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575199488 00000100:00100000:1.0:1783444189.337399:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575199488 00000100:00100000:1.0:1783444189.337448:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:1.0:1783444189.337457:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575199488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444189.337476:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444189.337552:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575199488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.337559:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:1.0:1783444189.337602:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575199232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783444189.337606:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575199488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783444189.337620:0:85121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.337645:0:85121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444189.338868:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575199616:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783444189.338928:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.339219:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444189.343367:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575199616 00000100:00100000:3.0:1783444189.343387:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575199616 00000100:00100000:2.0:1783444189.343530:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783444189.343541:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85121:x1870073575199616:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783444189.343569:0:85128:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783444189.343593:0:85128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783444189.343597:0:85128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783444189.343599:0:85128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783444189.343601:0:85128:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 106 00000100:00100000:2.0:1783444189.343735:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85121:x1870073575199616:12345-0@lo:256:mount.lustre.0 Request processed in 195us (4806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444189.343742:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783444189.343946:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575199616:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783444189.344753:0:85121:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783444189.344781:0:85121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.344840:0:85121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444189.344849:0:85121:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef0cb000 from 1 10000000:01000000:3.0:1783444189.344852:0:85121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783444189.344884:0:85121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.344892:0:85121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.344902:0:85121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444189.344922:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575199744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783444189.344964:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444189.345427:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd300 going to sleep for 11 seconds 00000004:00080000:1.0:1783444189.345767:0:85122:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783444189.346842:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575199744 00000100:00100000:0.0:1783444189.346855:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575199744 00000100:00100000:0.0:1783444189.346903:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783444189.346912:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:85121:x1870073575199744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444189.346928:0:85127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444189.346966:0:85127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05800/0x42cb6883e383160b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831604 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.346992:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05800/0x42cb6883e383160b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831604 expref: 10 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.347011:0:85127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05800/0x42cb6883e383160b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831604 expref: 10 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.347020:0:85127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05800, rc 0) 00000100:00100000:0.0:1783444189.347089:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85121:x1870073575199744:12345-0@lo:101:mount.lustre.0 Request processed in 177us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444189.347096:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783444189.347221:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575199744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444189.347239:0:85121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.347249:0:85121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444189.347320:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575199872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444189.368190:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.368248:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444189.368441:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575199872 00000100:00100000:3.0:1783444189.368451:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575199872 00000100:00100000:3.0:1783444189.368538:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783444189.368549:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85121:x1870073575199872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444189.368721:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85121:x1870073575199872:12345-0@lo:501:mount.lustre.0 Request processed in 174us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.368730:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783444189.368887:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575199872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444189.368953:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575200000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444189.369012:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.369099:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444189.369251:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575200000 00000100:00100000:3.0:1783444189.369255:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575200000 00000100:00100000:3.0:1783444189.369329:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783444189.369337:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85121:x1870073575200000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444189.369439:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85121:x1870073575200000:12345-0@lo:503:mount.lustre.0 Request processed in 102us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.369446:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783444189.369539:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575200000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783444189.370182:0:85144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85144:1870073575200128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444189.370227:0:85144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.389797:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575200128 00000100:00100000:2.0:1783444189.389813:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575200128 00000100:00100000:0.0:1783444189.390630:0:85144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444189.392651:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783444189.392680:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85144:x1870073575200128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444189.393645:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85144:x1870073575200128:12345-0@lo:502:llog_process_th.0 Request processed in 976us (23413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.393655:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783444189.393867:0:85144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85144:1870073575200128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444189.393908:0:85144:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444189.393920:0:85144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444189.393922:0:85144:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783444189.393930:0:85144:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9368ef0cb000 00000020:00000080:0.0:1783444189.393933:0:85144:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783444189.393954:0:85144:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444189.393957:0:85144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444189.393959:0:85144:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783444189.393961:0:85144:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444189.393963:0:85144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444189.393964:0:85144:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783444189.393967:0:85144:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9368ef0cb000 00000020:00000080:0.0:1783444189.393969:0:85144:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783444189.394087:0:85144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85144:1870073575200256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444189.394135:0:85144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.394162:0:85144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.394495:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575200256 00000100:00100000:1.0:1783444189.394505:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575200256 00000100:00100000:1.0:1783444189.394557:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783444189.394566:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85144:x1870073575200256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444189.394677:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85144:x1870073575200256:12345-0@lo:502:llog_process_th.0 Request processed in 111us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.394684:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783444189.394731:0:85144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85144:1870073575200256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444189.394750:0:85144:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444189.394754:0:85144:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444189.394756:0:85144:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783444189.394759:0:85144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783444189.394850:0:85121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783444189.394875:0:85121:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783444189.394891:0:85121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.394901:0:85121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444189.395537:0:85121:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783444189.395542:0:85121:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9368ef0cb000 10000000:01000000:1.0:1783444189.395545:0:85121:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9368ef0cb000 10000000:01000000:1.0:1783444189.395550:0:85121:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783444189.395556:0:85121:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cb000 from 1 10000000:01000000:1.0:1783444189.395559:0:85121:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783444189.395586:0:85121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.395595:0:85121:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.395604:0:85121:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444189.395621:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575200384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444189.395658:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.396643:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9600 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.404839:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575200384 00000100:00100000:1.0:1783444189.404854:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575200384 00000100:00100000:1.0:1783444189.404924:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783444189.404934:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:85121:x1870073575200384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444189.404964:0:85132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444189.404983:0:85132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6a54e00/0x42cb6883e3831619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831612 expref: -99 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.405022:0:85132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a54e00/0x42cb6883e3831619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831612 expref: 11 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.405045:0:85132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6a54e00/0x42cb6883e3831619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831612 expref: 11 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.405055:0:85132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6a54e00, rc 0) 00000100:00100000:1.0:1783444189.405132:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85121:x1870073575200384:12345-0@lo:101:mount.lustre.0 Request processed in 200us (9473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.405139:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783444189.405202:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575200384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444189.405219:0:85121:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.405229:0:85121:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444189.405541:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575200512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444189.405590:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.405663:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9600 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.405680:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575200512 00000100:00100000:1.0:1783444189.405684:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575200512 00000100:00100000:2.0:1783444189.407550:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783444189.407567:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85121:x1870073575200512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444189.407752:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85121:x1870073575200512:12345-0@lo:501:mount.lustre.0 Request processed in 190us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444189.407760:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783444189.409209:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575200512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444189.409325:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575200640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444189.409466:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.409494:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9600 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.409517:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575200640 00000100:00100000:1.0:1783444189.409523:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575200640 00000100:00100000:1.0:1783444189.409558:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783444189.409574:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85121:x1870073575200640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444189.409670:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85121:x1870073575200640:12345-0@lo:503:mount.lustre.0 Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.409678:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783444189.409723:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575200640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444189.413546:0:85147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85147:1870073575200768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444189.413637:0:85147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.413684:0:85147:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.413742:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575200768 00000100:00100000:1.0:1783444189.413750:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575200768 00000100:00100000:1.0:1783444189.413817:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783444189.413827:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85147:x1870073575200768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444189.414502:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85147:x1870073575200768:12345-0@lo:502:llog_process_th.0 Request processed in 674us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.414511:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783444189.424290:0:85147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85147:1870073575200768:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783444189.424614:0:85147:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783444189.424643:0:85147:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9368c507cd40) 00000020:00000080:3.0:1783444189.424674:0:85147:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783444189.424896:0:85147:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368ef0cb000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783444189.424902:0:85147:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ef0cb000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783444189.424905:0:85147:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ef0cb000 4 00010000:00080000:1.0:1783444189.424936:0:85147:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9367c6a4f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1783444189.433336:0:85147:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1783444189.433462:0:85147:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783444189.433521:0:85147:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783444189.433535:0:85147:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42cb6883e3831627 00000100:00080000:1.0:1783444189.433547:0:85147:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783444189.433554:0:85147:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9367c6a4f000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444189.433595:0:85147:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3444e00 x1870073575200896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444189.433643:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575200896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783444189.433717:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.433814:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575200896 00000100:00100000:1.0:1783444189.433821:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575200896 00000100:00100000:1.0:1783444189.433857:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1783444189.433865:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575200896:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783444189.433925:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575200896:12345-0@lo:38:llog_process_th.0 Request processed in 58us (207us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783444189.433933:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1783444189.433992:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783444189.434000:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444189.434012:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783444189.434015:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575200896:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1783444189.434051:0:85147:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783444189.438926:0:85147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85147:1870073575201024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444189.439124:0:85147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.439166:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575201024 00000100:00100000:1.0:1783444189.439174:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575201024 00000100:00100000:1.0:1783444189.439227:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783444189.439236:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85147:x1870073575201024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444189.439824:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85147:x1870073575201024:12345-0@lo:502:llog_process_th.0 Request processed in 587us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.439832:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783444189.443124:0:85147:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.443179:0:85147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85147:1870073575201024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444189.443461:0:85147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85147:1870073575201152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444189.443543:0:85147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.443604:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575201152 00000100:00100000:1.0:1783444189.443612:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575201152 00000100:00100000:1.0:1783444189.443681:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783444189.443691:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85147:x1870073575201152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444189.443832:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85147:x1870073575201152:12345-0@lo:502:llog_process_th.0 Request processed in 142us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.443840:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783444189.443890:0:85147:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444189.443905:0:85147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:85147:1870073575201152:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444189.443930:0:85147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783444189.447819:0:85121:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783444189.447867:0:85121:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444189.447892:0:85121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.447904:0:85121:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783444189.447970:0:85121:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783444189.447972:0:85121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783444189.447974:0:85121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444189.447975:0:85121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444189.447976:0:85121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444189.447977:0:85121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444189.447979:0:85121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783444189.447980:0:85121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783444189.447982:0:85121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444189.447983:0:85121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783444189.447987:0:85121:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1783444189.447989:0:85121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783444189.447991:0:85121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783444189.447992:0:85121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444189.447993:0:85121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444189.447994:0:85121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444189.447995:0:85121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444189.447996:0:85121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783444189.447997:0:85121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783444189.447998:0:85121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444189.448009:0:85121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783444189.448048:0:85121:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783444189.448069:0:85121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575201280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783444189.448138:0:85121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444189.448190:0:85121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491480 going to sleep for 11 seconds 00000100:00100000:2.0:1783444189.450409:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575201280 00000100:00100000:2.0:1783444189.450425:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575201280 00000100:00100000:2.0:1783444189.450495:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783444189.450505:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85121:x1870073575201280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783444189.450537:0:85128:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783444189.450552:0:85128:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783444189.464735:0:85128:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444189.464757:0:85128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783444189.464822:0:85131:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783444189.464828:0:85131:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783444189.464849:0:85131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.464870:0:85131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 11 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.464878:0:85131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.464919:0:85131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 11 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.464933:0:85131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 11 pid: 85127 timeout: 3280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444189.464948:0:85131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85131:1870073575201408:0@lo:104: 00000100:00100000:1.0:1783444189.465027:0:85131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.465084:0:85131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1783444189.465188:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575201408 00000100:00100000:2.0:1783444189.465196:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575201408 00000100:00100000:2.0:1783444189.465259:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1783444189.465268:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:85131:x1870073575201408:12345-0@lo:104: 00010000:00010000:2.0:1783444189.465290:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444189.465377:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783444189.465383:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:85131:x1870073575201408:12345-0@lo:104: Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444189.465390:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1783444189.465464:0:85131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85131:1870073575201408:0@lo:104: 00010000:00010000:0.0:1783444189.465500:0:85131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.466170:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444189.466177:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.466186:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444189.466190:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.466199:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444189.466207:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444189.466213:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444189.466264:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.466270:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444189.466300:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.466308:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6a55200/0x42cb6883e38315f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38315fd expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.466325:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444189.466326:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444189.466328:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444189.466411:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575201536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444189.466417:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:85121:x1870073575201280:12345-0@lo:253:mount.lustre.0 Request processed in 15913us (18279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.466439:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783444189.466445:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444189.466491:0:85121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:85121:1870073575201280:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783444189.466502:0:85121:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783444189.466505:0:85121:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783444189.466507:0:85121:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783444189.466508:0:85121:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444189.466510:0:85121:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1783444189.466510:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575201536 00000020:01000004:1.0:1783444189.466511:0:85121:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444189.466512:0:85121:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444189.466514:0:85121:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:0.0:1783444189.466514:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575201536 00000020:01000004:1.0:1783444189.466516:0:85121:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783444189.466518:0:85121:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444189.466519:0:85121:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783444189.466535:0:85121:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783444189.466535:0:19646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 11 pid: 85127 timeout: 3280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444189.466559:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1783444189.466566:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5935050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:3635:x1870073575201536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444189.466578:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444189.466583:0:19646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 11 pid: 85127 timeout: 3280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466593:0:19646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 11 pid: 85127 timeout: 3280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466607:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26800/0x42cb6883e38315fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38315f6 expref: 11 pid: 85127 timeout: 3280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466620:0:19646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466762:0:19646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444189.466809:0:19646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001981993s 00010000:00010000:0.0:1783444189.466814:0:19646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466822:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466828:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466834:0:19646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466840:0:19646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444189.466844:0:19646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466851:0:19646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466864:0:19646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466874:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444189.466903:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5935050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+10:3635:x1870073575201536:12345-0@lo:103:ldlm_bl.0 Request processed in 336us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444189.466910:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1783444189.466964:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575201536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444189.466983:0:85131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.466996:0:85131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.467148:0:85131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a55000/0x42cb6883e383162e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783444189.483977:0:85121:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:1.0:1783444189.484917:0:85121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1783444189.485327:0:85153:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1783444189.485395:0:85153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1783444189.486329:0:85121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:2.0:1783444189.486649:0:85152:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:2.0:1783444189.486654:0:85152:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000100:00100000:2.0:1783444189.487202:0:85154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85154:1870073575201664:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783444189.487281:0:85154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444189.487320:0:85154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c32036c0 going to sleep for 11 seconds 00000040:01000000:0.0:1783444189.487757:0:85121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783444189.487827:0:85121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783444189.488586:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575201664 00000100:00100000:3.0:1783444189.488597:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575201664 00000100:00100000:3.0:1783444189.488659:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:3.0:1783444189.488670:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85154:x1870073575201664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444189.488777:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85154:x1870073575201664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.488814:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:3.0:1783444189.488879:0:85154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85154:1870073575201664:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783444189.488912:0:85154:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783444189.489443:0:85154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85154:1870073575201792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444189.490764:0:85154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444189.490811:0:85154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab03cc0 going to sleep for 11 seconds 00000040:00080000:1.0:1783444189.492681:0:85153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783444189.492776:0:85153:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1783444189.493370:0:85121:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783444189.493409:0:85121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783444189.493532:0:85121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783444189.495400:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575201792 00000100:00100000:2.0:1783444189.495420:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575201792 00000100:00100000:2.0:1783444189.495497:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:2.0:1783444189.495508:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85154:x1870073575201792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783444189.495697:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85154:x1870073575201792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 191us (4937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444189.495705:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00100000:3.0:1783444189.497381:0:85154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85154:1870073575201792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444189.497517:0:85154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85154:1870073575201920:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444189.497569:0:85154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444189.497607:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575201920 00000100:00100000:3.0:1783444189.497613:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575201920 00000100:00100000:3.0:1783444189.497654:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:3.0:1783444189.497662:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85154:x1870073575201920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444189.497727:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85154:x1870073575201920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.497735:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:3.0:1783444189.497760:0:85154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444189.497773:0:85154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85154:1870073575201920:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783444189.497873:0:85154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783444189.501609:0:85121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783444189.502155:0:85121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783444189.502195:0:85121:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783444189.504126:0:85121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783444189.504841:0:85121:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00000040:00080000:3.0:1783444189.508572:0:85154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783444189.508675:0:85154:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783444189.508680:0:85154:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1783444189.515068:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444189.515212:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557745664 00000100:00100000:1.0:1783444189.515234:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557745664 00000100:00100000:1.0:1783444189.515292:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:1.0:1783444189.515303:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+5:42401:x1870073557745664:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444189.515323:0:85127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444189.515346:0:85127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a2c expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.515386:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a2c expref: 6 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.515416:0:85127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a2c expref: 6 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.515426:0:85127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6a55200, rc 0) 00000100:00100000:1.0:1783444189.515506:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557745664:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 205us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.515514:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00010000:00080000:3.0:1783444189.515598:0:85121:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247809 00010000:00080000:3.0:1783444189.517145:0:85155:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85155 00010000:02000000:3.0:1783444189.517222:0:85155:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1783444189.525093:0:85121:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783444189.525118:0:85121:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783444189.525140:0:85121:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783444189.525173:0:85121:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783444189.528600:0:85121:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783444189.528980:0:85121:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783444189.544111:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00080000:2.0:1783444189.544820:0:85155:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783444189.544825:0:85155:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1783444189.546847:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557745792 00000100:00100000:1.0:1783444189.546863:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557745792 00000100:00100000:1.0:1783444189.548378:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:1.0:1783444189.548394:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557745792:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783444189.548421:0:85129:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1783444189.548446:0:85129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783444189.548450:0:85129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783444189.548453:0:85129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783444189.548455:0:85129:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783444189.548457:0:85129:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:1.0:1783444189.560137:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557745792:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 Request processed in 11737us (16025us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.560151:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:1.0:1783444189.581403:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444189.581445:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444189.581478:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557746048 00000100:00100000:1.0:1783444189.581488:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557746048 00000100:00100000:1.0:1783444189.581545:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1783444189.582474:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557746048:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444189.582504:0:85127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444189.582524:0:85127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6a54200/0x42cb6883e383163c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a33 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.582554:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a54200/0x42cb6883e383163c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a33 expref: 7 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.583443:0:85127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6a54200/0x42cb6883e383163c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a33 expref: 7 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444189.583455:0:85127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6a54200, rc 0) 00000100:00100000:1.0:1783444189.583523:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+7:42401:x1870073557746048:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 1058us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.583531:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1783444189.584470:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557745920 00000100:00100000:1.0:1783444189.584481:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557745920 00000100:00100000:1.0:1783444189.584524:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1059 00000100:00100000:1.0:1783444189.584534:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557745920:12345-192.168.204.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1783444189.585291:0:71469:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '778015c5-4969-44f5-82a5-0f6eadd152d5' at ffff9368dd1ef800, cookie 0x42cb6883e383157f 00010000:00080000:1.0:1783444189.585300:0:71469:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp recovering/t98784247810 exp ffff9368dd1ef800 cur 3180 last 1783444189 00010000:02000400:1.0:1783444189.585309:0:71469:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:3.0:1783444189.596030:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444189.596275:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557746176 00000100:00100000:0.0:1783444189.596287:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557746176 00000100:00100000:0.0:1783444189.596368:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:0.0:1783444189.596379:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+7:42401:x1870073557746176:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444189.596556:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557746176:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 178us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444189.596565:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00010000:00080000:1.0:1783444189.603698:0:71469:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1783444189.603866:0:71469:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783444189.604038:0:71469:0:(import.c:65:import_set_state_nolock()) ffff9368eab70800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444189.604128:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557745920:12345-192.168.204.20@tcp:38:ll_cfg_requeue.0 Request processed in 19593us (22682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.604149:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1059 00000100:00100000:3.0:1783444189.612564:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444189.612719:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557739264 00000100:00100000:3.0:1783444189.612729:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557739264 00000100:00100000:3.0:1783444189.612876:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1060 00000100:00100000:3.0:1783444189.612888:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557739264:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00080000:3.0:1783444189.612908:0:66226:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247810, current: 98784247810, replaying 00000100:00100000:3.0:1783444189.612921:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557739264:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 37us (366us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444189.612928:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1060 00010000:00080000:2.0:1783444189.613606:0:85155:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1783444189.615074:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444189.615270:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557746304 00000100:00100000:2.0:1783444189.615281:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557746304 00000100:00100000:2.0:1783444189.615430:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:2.0:1783444189.615444:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557746304:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444189.615587:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557746304:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 145us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.627415:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444189.627452:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557746432 00000100:00100000:3.0:1783444189.627462:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557746432 00000100:00100000:2.0:1783444189.627566:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1783444189.628063:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1783444189.628076:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557746432:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444189.628097:0:85129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444189.628117:0:85129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26c00/0x42cb6883e3831643 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a3a expref: -99 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.628145:0:85129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26c00/0x42cb6883e3831643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a3a expref: 9 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.628156:0:85129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26c00/0x42cb6883e3831643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a3a expref: 9 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444189.628165:0:85129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26c00, rc 0) 00000100:00100000:3.0:1783444189.628231:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557746432:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 158us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444189.628239:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:2.0:1783444189.652282:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444189.653503:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557746560 00000100:00100000:0.0:1783444189.653518:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557746560 00000100:00100000:0.0:1783444189.653588:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:0.0:1783444189.653599:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557746560:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444189.653768:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557746560:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 170us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444189.653777:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:2.0:1783444189.671685:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444189.671812:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557746688 00000100:00100000:1.0:1783444189.671823:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557746688 00000100:00100000:1.0:1783444189.671881:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:1.0:1783444189.671892:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557746688:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444189.672056:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557746688:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 165us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444189.672065:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:3.0:1783444189.681947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444189.682092:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557746816 00000100:00100000:0.0:1783444189.682104:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557746816 00000100:00100000:0.0:1783444189.682158:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1783444189.682169:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557746816:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444189.682188:0:85132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444189.682207:0:85132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05000/0x42cb6883e383164a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a41 expref: -99 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.682241:0:85132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05000/0x42cb6883e383164a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a41 expref: 10 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.682252:0:85132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05000/0x42cb6883e383164a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a41 expref: 10 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444189.682261:0:85132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05000, rc 0) 00000100:00100000:0.0:1783444189.682325:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557746816:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 158us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444189.682332:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:2.0:1783444189.691991:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444189.695906:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557746944 00000100:00100000:0.0:1783444189.695922:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557746944 00000100:00100000:0.0:1783444189.696000:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:0.0:1783444189.696013:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557746944:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444189.696163:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557746944:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 152us (4178us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444189.696180:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00010000:00010000:3.0:1783444190.112018:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783444190.754190:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783444190.754198:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cb000 from 107 10000000:01000000:1.0:1783444190.754203:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783444190.754258:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.754270:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.754282:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444190.754311:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.754393:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.754449:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d780 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.755400:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575202048 00000100:00100000:2.0:1783444190.755411:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575202048 00000100:00100000:2.0:1783444190.755471:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783444190.755481:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:6503:x1870073575202048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444190.755496:0:85132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444190.755509:0:85132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583ee00/0x42cb6883e3831658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831651 expref: -99 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.755533:0:85132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583ee00/0x42cb6883e3831658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831651 expref: 11 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.755543:0:85132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583ee00/0x42cb6883e3831658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831651 expref: 11 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.755551:0:85132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583ee00, rc 0) 00000100:00100000:2.0:1783444190.755773:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575202048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.755780:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783444190.761450:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444190.761480:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.761494:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444190.761867:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783444190.761935:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444190.762023:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7512e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444190.770182:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575202176 00000100:00100000:1.0:1783444190.770198:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575202176 00000100:00100000:1.0:1783444190.770363:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783444190.770374:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575202176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783444190.770413:0:85128:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783444190.770429:0:85128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783444190.770432:0:85128:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 107 00000100:00100000:1.0:1783444190.770595:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575202176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 222us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.770604:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783444190.771198:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783444190.771266:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783444190.771278:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.771289:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444190.771299:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444190.771301:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 52 10000000:01000000:0.0:1783444190.771305:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444190.771352:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.771361:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.771369:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.771391:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.771428:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.771469:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.771981:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575202304 00000100:00100000:2.0:1783444190.771989:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575202304 00000100:00100000:2.0:1783444190.772034:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783444190.772043:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575202304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444190.772057:0:85127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444190.772071:0:85127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583fe00/0x42cb6883e3831666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383165f expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.772095:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583fe00/0x42cb6883e3831666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383165f expref: 12 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.772107:0:85127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583fe00/0x42cb6883e3831666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383165f expref: 12 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.772115:0:85127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583fe00, rc 0) 00000100:00100000:2.0:1783444190.772155:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575202304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.772161:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783444190.772933:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.772953:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831666 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.772982:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831666 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.773061:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.773103:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.773130:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd600 going to sleep for 11 seconds 00000100:00100000:1.0:1783444190.773357:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575202432 00000100:00100000:1.0:1783444190.773363:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575202432 00000100:00100000:1.0:1783444190.773408:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783444190.773418:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575202432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.773563:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575202432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.773571:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783444190.773765:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.773837:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.773881:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.773905:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.774024:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575202560 00000100:00100000:2.0:1783444190.774029:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575202560 00000100:00100000:2.0:1783444190.774059:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783444190.774066:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575202560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.774158:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575202560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.774166:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783444190.774399:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444190.775322:0:85215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783444190.775596:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783444190.775618:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444190.775630:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831666 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.775642:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831666 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444190.775652:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783444190.775655:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cd800 from 104 10000000:01000000:0.0:1783444190.775657:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783444190.775691:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.775698:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.775718:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.775752:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.775828:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.775860:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.776099:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575202688 00000100:00100000:2.0:1783444190.776106:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575202688 00000100:00100000:2.0:1783444190.776148:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783444190.776156:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575202688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444190.776176:0:85127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444190.776188:0:85127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583f400/0x42cb6883e3831674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383166d expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.776213:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583f400/0x42cb6883e3831674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383166d expref: 13 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.776222:0:85127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583f400/0x42cb6883e3831674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383166d expref: 13 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.776230:0:85127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f400, rc 0) 00000100:00100000:2.0:1783444190.776274:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575202688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.776280:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783444190.776533:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444190.776547:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831674 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.776556:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831674 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444190.776620:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.776656:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.776678:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.776898:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575202816 00000100:00100000:0.0:1783444190.776903:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575202816 00000100:00100000:0.0:1783444190.776930:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783444190.776937:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575202816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783444190.776951:0:85132:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783444190.776970:0:85132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783444190.776975:0:85132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783444190.776978:0:85132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783444190.776981:0:85132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783444190.776984:0:85132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:0.0:1783444190.777076:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575202816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.777083:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783444190.777152:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783444190.777232:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783444190.777240:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831674 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.777249:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831674 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444190.777258:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783444190.777260:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783444190.777263:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783444190.777283:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.777290:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.777306:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444190.777320:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.777363:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444190.777395:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3203480 going to sleep for 11 seconds 00000100:00100000:1.0:1783444190.777456:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575202944 00000100:00100000:1.0:1783444190.777461:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575202944 00000100:00100000:1.0:1783444190.777496:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783444190.777504:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575202944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444190.777519:0:85128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444190.777530:0:85128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6a55600/0x42cb6883e3831682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383167b expref: -99 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.777548:0:85128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a55600/0x42cb6883e3831682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383167b expref: 14 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.777559:0:85128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6a55600/0x42cb6883e3831682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383167b expref: 14 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.777568:0:85128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6a55600, rc 0) 00000100:00100000:1.0:1783444190.777612:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575202944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.777619:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783444190.777664:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575202944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444190.777674:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831682 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.777684:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831682 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444190.777884:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.777909:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.777921:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444190.777932:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575203072 00000100:00100000:1.0:1783444190.777935:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575203072 00000100:00100000:1.0:1783444190.777951:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783444190.777956:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575203072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.778097:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575203072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.778104:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783444190.778135:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.778165:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.778205:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.778219:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444190.778230:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575203200 00000100:00100000:1.0:1783444190.778234:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575203200 00000100:00100000:1.0:1783444190.778252:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783444190.778258:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575203200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.782442:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575203200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4175us (4227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.782457:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783444190.782586:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444190.784613:0:85216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1783444190.785099:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1783444190.785122:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783444190.785134:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831682 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.785147:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831682 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444190.785157:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1783444190.785160:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ef0cd800 from 1 10000000:01000000:1.0:1783444190.785163:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783444190.785201:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.785221:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.785233:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444190.785258:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.785319:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.785372:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d480 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.786418:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575203328 00000100:00100000:2.0:1783444190.786430:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575203328 00000100:00100000:2.0:1783444190.786500:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783444190.786510:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575203328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444190.786527:0:85132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444190.786553:0:85132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583ec00/0x42cb6883e3831690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831689 expref: -99 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.786590:0:85132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583ec00/0x42cb6883e3831690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831689 expref: 15 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.786601:0:85132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583ec00/0x42cb6883e3831690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831689 expref: 15 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.786609:0:85132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583ec00, rc 0) 00000100:00100000:2.0:1783444190.786660:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575203328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.786667:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783444190.787034:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444190.787052:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831690 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.787060:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831690 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444190.787078:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783444190.787082:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831690 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.787089:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831690 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444190.787096:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783444190.787098:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef0cd800 from 7 10000000:01000000:1.0:1783444190.787101:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783444190.787123:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.787141:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.787148:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444190.787165:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.787199:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.787230:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d480 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.787287:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575203456 00000100:00100000:2.0:1783444190.787292:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575203456 00000100:00100000:2.0:1783444190.787325:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783444190.787344:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575203456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444190.787353:0:85129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444190.787363:0:85129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583f000/0x42cb6883e383169e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831697 expref: -99 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.787377:0:85129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583f000/0x42cb6883e383169e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831697 expref: 16 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.787385:0:85129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583f000/0x42cb6883e383169e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831697 expref: 16 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.787392:0:85129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f000, rc 0) 00000100:00100000:2.0:1783444190.787498:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575203456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.787505:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783444190.792028:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.792061:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383169e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.792077:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383169e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.792167:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.792246:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.792350:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.802196:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575203584 00000100:00100000:2.0:1783444190.802212:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575203584 00000100:00100000:2.0:1783444190.802358:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783444190.802370:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575203584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.802549:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575203584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (10302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.802557:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783444190.806274:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.806360:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.806434:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.806532:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.808444:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575203712 00000100:00100000:2.0:1783444190.808460:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575203712 00000100:00100000:2.0:1783444190.808536:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783444190.810524:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575203712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.811978:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575203712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3427us (5538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.811992:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783444190.812251:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444190.822323:0:85218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444190.823002:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444190.823030:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444190.823043:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383169e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.823058:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383169e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444190.823068:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444190.823071:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 52 10000000:01000000:0.0:1783444190.823074:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444190.823113:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.823122:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.823133:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.823164:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.823250:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.823307:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444190.823375:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575203840 00000100:00100000:3.0:1783444190.823383:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575203840 00000100:00100000:3.0:1783444190.823434:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783444190.823443:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575203840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444190.823456:0:85127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444190.823469:0:85127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26e00/0x42cb6883e38316ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38316a5 expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.823492:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26e00/0x42cb6883e38316ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38316a5 expref: 17 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.823516:0:85127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26e00/0x42cb6883e38316ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38316a5 expref: 17 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.823525:0:85127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26e00, rc 0) 00000100:00100000:3.0:1783444190.823564:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb859c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575203840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444190.823583:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783444190.824840:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.824862:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.824873:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38316ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.824947:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.824990:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.825027:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444190.825696:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575203968 00000100:00100000:3.0:1783444190.825705:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575203968 00000100:00100000:3.0:1783444190.825830:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783444190.825841:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575203968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444190.825973:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575203968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444190.825981:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783444190.826903:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575203968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.826957:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.827012:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.827087:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444190.830916:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575204096 00000100:00100000:3.0:1783444190.830930:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575204096 00000100:00100000:2.0:1783444190.832962:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783444190.832976:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb859050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575204096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.833946:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb859050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575204096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 970us (6931us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.833957:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783444190.839288:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444190.856278:0:85219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783444190.856513:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783444190.856538:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444190.856552:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.856565:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444190.856585:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783444190.856603:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783444190.856607:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444190.856648:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.856656:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.856667:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444190.856693:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444190.856763:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444190.856826:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368caa406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.857112:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575204224 00000100:00100000:0.0:1783444190.857120:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575204224 00000100:00100000:0.0:1783444190.857203:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783444190.857212:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575204224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.857227:0:85132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444190.857240:0:85132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04200/0x42cb6883e38316ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38316b3 expref: -99 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.857264:0:85132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04200/0x42cb6883e38316ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38316b3 expref: 18 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.857285:0:85132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04200/0x42cb6883e38316ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38316b3 expref: 18 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.857293:0:85132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04200, rc 0) 00000100:00100000:0.0:1783444190.857353:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb858050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575204224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.857360:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783444190.857447:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444190.857463:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316ba expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.857472:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38316ba expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444190.857540:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.857568:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444190.861614:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff936901f09cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444190.861963:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575204352 00000100:00100000:3.0:1783444190.861974:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575204352 00000100:00100000:0.0:1783444190.871953:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783444190.884051:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575204352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.884287:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575204352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 12319us (26717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.884298:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783444190.884432:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444190.884490:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444190.884539:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444190.884595:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368caa403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.884695:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575204480 00000100:00100000:0.0:1783444190.884702:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575204480 00000100:00100000:0.0:1783444190.884759:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783444190.884769:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb858450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575204480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.887415:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb858450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575204480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2635us (2863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.887431:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783444190.887728:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444190.889598:0:85222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783444190.889741:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783444190.889769:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783444190.889781:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316ba expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.889815:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316ba expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444190.889844:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783444190.889847:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368f9acf800 from 7 10000000:01000000:3.0:1783444190.889850:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783444190.889893:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.889902:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.889914:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444190.889942:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444190.890009:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444190.890054:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368caa403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.891521:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575204608 00000100:00100000:0.0:1783444190.891534:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575204608 00000100:00100000:0.0:1783444190.891606:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783444190.891621:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb858c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575204608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.891639:0:85128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444190.891656:0:85128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04000/0x42cb6883e38316c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38316c1 expref: -99 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.891689:0:85128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04000/0x42cb6883e38316c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38316c1 expref: 19 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.891701:0:85128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04000/0x42cb6883e38316c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38316c1 expref: 19 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.891719:0:85128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04000, rc 0) 00000100:00100000:0.0:1783444190.891829:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb858c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575204608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.891838:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783444190.891875:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444190.891899:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316c8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.891910:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38316c8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444190.891990:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.892025:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.892066:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.893137:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575204736 00000100:00100000:0.0:1783444190.893152:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575204736 00000100:00100000:0.0:1783444190.893199:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783444190.893209:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575204736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.893377:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575204736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.893386:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783444190.893690:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.893750:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.893822:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.893860:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.894399:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575204864 00000100:00100000:0.0:1783444190.894407:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575204864 00000100:00100000:0.0:1783444190.894452:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783444190.894465:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575204864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.894580:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575204864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.894587:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783444190.894628:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444190.895521:0:85224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444190.895668:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444190.895694:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444190.895704:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316c8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.895715:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316c8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444190.895734:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444190.895737:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 52 10000000:01000000:0.0:1783444190.895739:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444190.895772:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.895780:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.895807:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.895841:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.895886:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.895926:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dda80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444190.895933:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575204992 00000100:00100000:1.0:1783444190.895941:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575204992 00000100:00100000:1.0:1783444190.895984:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783444190.895993:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575204992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444190.896006:0:85129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444190.896019:0:85129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6a55c00/0x42cb6883e38316d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38316cf expref: -99 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.896044:0:85129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6a55c00/0x42cb6883e38316d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38316cf expref: 20 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.896056:0:85129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6a55c00/0x42cb6883e38316d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38316cf expref: 20 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.896068:0:85129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6a55c00, rc 0) 00000100:00100000:1.0:1783444190.896116:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5356c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575204992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.896123:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783444190.896402:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575204992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.896417:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.896427:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38316d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.896487:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.896515:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.896546:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dda80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444190.896957:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575205120 00000100:00100000:1.0:1783444190.896963:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575205120 00000100:00100000:1.0:1783444190.897002:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783444190.897010:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c593c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575205120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.897150:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c593c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575205120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.897157:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783444190.897971:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.898016:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.898063:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444190.898097:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff936901f09840 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.898525:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575205248 00000100:00100000:0.0:1783444190.898533:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575205248 00000100:00100000:0.0:1783444190.898590:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783444190.898599:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575205248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.898718:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575205248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.898727:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783444190.898771:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444190.899992:0:85225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783444190.900289:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783444190.900316:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783444190.900345:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.900358:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444190.900369:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783444190.900372:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783444190.900376:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783444190.900414:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.900422:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.900434:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444190.900458:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.907021:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.907075:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.907408:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575205376 00000100:00100000:0.0:1783444190.907418:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575205376 00000100:00100000:0.0:1783444190.907479:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783444190.907489:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575205376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.907506:0:85128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444190.907525:0:85128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05600/0x42cb6883e38316e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38316dd expref: -99 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.907561:0:85128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05600/0x42cb6883e38316e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38316dd expref: 21 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.907574:0:85128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05600/0x42cb6883e38316e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38316dd expref: 21 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.907584:0:85128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05600, rc 0) 00000100:00100000:0.0:1783444190.907632:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575205376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.907639:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783444190.907688:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.907707:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316e4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.907716:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38316e4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.907828:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.907859:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.907872:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444190.908691:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575205504 00000100:00100000:1.0:1783444190.908700:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575205504 00000100:00100000:1.0:1783444190.908760:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783444190.908771:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575205504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.908947:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575205504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444190.908955:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783444190.909557:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.909605:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.909653:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.909683:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dde40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.909697:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575205632 00000100:00100000:0.0:1783444190.909701:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575205632 00000100:00100000:0.0:1783444190.909730:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783444190.909738:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575205632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.912418:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575205632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2671us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.912432:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783444190.912503:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444190.919242:0:85227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783444190.920306:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783444190.920351:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783444190.920364:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316e4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.920377:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316e4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444190.920389:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783444190.920408:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef29c800 from 7 10000000:01000000:0.0:1783444190.920411:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783444190.920457:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.920466:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.920478:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.920505:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.920577:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.920634:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dde40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444190.920764:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575205760 00000100:00100000:3.0:1783444190.920772:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575205760 00000100:00100000:3.0:1783444190.920871:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783444190.920883:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575205760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444190.920897:0:85127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444190.920911:0:85127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26200/0x42cb6883e38316f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38316eb expref: -99 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.920936:0:85127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26200/0x42cb6883e38316f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38316eb expref: 22 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.920947:0:85127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26200/0x42cb6883e38316f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38316eb expref: 22 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444190.920965:0:85127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26200, rc 0) 00000100:00100000:3.0:1783444190.921009:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575205760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444190.921018:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783444190.921414:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.921432:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.921441:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38316f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444190.921500:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.921544:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444190.921567:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dde40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.921580:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575205888 00000100:00100000:0.0:1783444190.921583:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575205888 00000100:00100000:0.0:1783444190.921610:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783444190.921617:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575205888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.921738:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575205888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.921754:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783444190.923631:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575205888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.923690:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575206016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.924040:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.924080:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696db40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444190.924131:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575206016 00000100:00100000:2.0:1783444190.924138:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575206016 00000100:00100000:2.0:1783444190.924195:0:85127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783444190.924205:0:85127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575206016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.924317:0:85127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575206016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444190.924325:0:85127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783444190.924379:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575206016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444190.930411:0:85228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783444190.930602:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783444190.930627:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783444190.930637:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.930648:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38316f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444190.930658:0:6503:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1783444190.930661:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9368c507b380 from 1 10000000:01000000:2.0:1783444190.930663:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783444190.930702:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.930711:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.930723:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444190.930764:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575206144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.930869:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444190.930910:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff936901f09f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.933775:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575206144 00000100:00100000:0.0:1783444190.933806:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575206144 00000100:00100000:0.0:1783444190.933884:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783444190.933894:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575206144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.933912:0:85132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444190.933934:0:85132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04400/0x42cb6883e3831700 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38316f9 expref: -99 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.933961:0:85132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04400/0x42cb6883e3831700 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38316f9 expref: 23 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.933971:0:85132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04400/0x42cb6883e3831700 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38316f9 expref: 23 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.933981:0:85132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04400, rc 0) 00000100:00100000:0.0:1783444190.934062:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575206144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (3192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.934068:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783444190.934152:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575206144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444190.934171:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831700 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.934182:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831700 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444190.934204:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783444190.934210:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831700 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.934216:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831700 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444190.934224:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783444190.934227:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:2.0:1783444190.934229:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783444190.934255:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.934263:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444190.934271:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444190.934306:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575206272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444190.934353:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444190.934398:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff936901f09f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.936195:0:85127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575206272 00000100:00100000:0.0:1783444190.936211:0:85127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575206272 00000100:00100000:0.0:1783444190.936269:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783444190.936279:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575206272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444190.936309:0:85129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444190.936339:0:85129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04c00/0x42cb6883e383170e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831707 expref: -99 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.936366:0:85129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04c00/0x42cb6883e383170e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831707 expref: 24 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.936389:0:85129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04c00/0x42cb6883e383170e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831707 expref: 24 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444190.936399:0:85129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04c00, rc 0) 00000100:00100000:0.0:1783444190.936474:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575206272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444190.936481:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783444190.936529:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575206272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444190.936558:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383170e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.936568:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383170e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444190.936656:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575206400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444190.936690:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444190.936726:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d240 going to sleep for 11 seconds 00000100:00100000:0.0:1783444190.939019:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575206400 00000100:00100000:0.0:1783444190.939037:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575206400 00000100:00100000:0.0:1783444190.939102:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783444190.939113:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575206400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444190.939260:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575206400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (2568us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444190.939268:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783444190.939384:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f69500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575206400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783444190.939434:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783444190.939446:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383170e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444190.939458:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383170e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444191.132992:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444192.157899:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444193.181088:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444193.359309:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444193.359356:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444193.359443:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557747072 00000100:00100000:0.0:1783444193.359454:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557747072 00000100:00100000:0.0:1783444193.359522:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:0.0:1783444193.359533:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557747072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444193.359607:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557747072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444193.359615:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1783444193.359875:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557747200 00000100:00100000:3.0:1783444193.359881:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557747200 00000100:00100000:3.0:1783444193.359932:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 785 00000100:00100000:3.0:1783444193.359950:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557747200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444193.359989:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557747200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 51us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444193.359995:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 785 00000100:00080000:0.0:1783444193.360213:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444194.077222:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575206528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444194.077312:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444194.077428:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575206656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444194.077457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444194.077503:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575206528 00000100:00100000:3.0:1783444194.077510:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575206528 00000100:00100000:3.0:1783444194.077562:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575206656 00000100:00100000:3.0:1783444194.077566:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575206656 00000100:00100000:3.0:1783444194.077587:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774 00000100:00100000:3.0:1783444194.077595:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575206528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444194.077626:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444194.077670:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575206528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444194.077684:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774 00000100:00100000:3.0:1783444194.077702:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:3.0:1783444194.077709:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575206656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444194.077724:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444194.077756:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575206656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444194.077762:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00080000:3.0:1783444194.078001:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444194.078006:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444194.078045:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575206656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444194.078173:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575206528:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783444194.206963:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444194.404422:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444194.404483:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444194.404533:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557747328 00000100:00100000:0.0:1783444194.404549:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557747328 00000100:00100000:0.0:1783444194.404600:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:0.0:1783444194.404610:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557747328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444194.404682:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557747328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.404690:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:3.0:1783444194.404902:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557747456 00000100:00100000:3.0:1783444194.404908:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557747456 00000100:00100000:3.0:1783444194.404948:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 786 00000100:00100000:3.0:1783444194.405033:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557747456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444194.405075:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557747456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 44us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444194.405083:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 786 00000100:00080000:1.0:1783444194.589921:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444194.589942:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444194.589947:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444194.589962:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444194.589988:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368c9f68a80 x1870073575206912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444194.590026:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444194.590029:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444194.590031:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444194.590036:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444194.590046:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368c9f69180 x1870073575207168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444194.590061:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444194.590064:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444194.590066:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444194.590070:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444194.590081:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368c9f68000 x1870073575207424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444194.590090:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444194.590093:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444194.590094:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444194.590099:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444194.590110:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fc700 x1870073575207552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444194.590137:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783444194.590145:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444194.590147:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444194.590152:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9367c6a4f000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444194.590163:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ff800 x1870073575208064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444194.590193:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575206912:0@lo:38:kworker.0 00000100:00100000:1.0:1783444194.590278:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444194.590315:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575207168:0@lo:38:kworker.0 00000100:00100000:1.0:1783444194.590338:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444194.590369:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575207424:0@lo:38:kworker.0 00000100:00100000:1.0:1783444194.590394:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444194.590413:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575207552:0@lo:38:kworker.0 00000100:00100000:1.0:1783444194.590433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444194.590450:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575208064:0@lo:38:kworker.0 00000100:00100000:1.0:1783444194.590471:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444194.590510:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575207424 00000100:00100000:1.0:1783444194.590518:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575207424 00000100:00100000:1.0:1783444194.590567:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:1.0:1783444194.590575:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575207424:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783444194.590604:0:8431:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9368dd1e8800, cookie 0x42cb6883e3831586 00010000:00080000:1.0:1783444194.590608:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9368dd1e8800 cur 3185 last 1783444189 00000004:00100000:1.0:1783444194.590627:0:8431:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783444194.590750:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9368c88cb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444194.590953:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575207040:0@lo:400:kworker.0 00000100:00100000:0.0:1783444194.590987:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444194.591010:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575207936:0@lo:400:kworker.0 00000100:00100000:0.0:1783444194.591032:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444194.591052:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783444194.591059:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575207296:0@lo:400:kworker.0 00000100:00100000:0.0:1783444194.591080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444194.591094:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575208192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444194.591115:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444194.591145:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575206912 00000100:00100000:0.0:1783444194.591150:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575206912 00000100:00100000:0.0:1783444194.591169:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575207168 00000100:00100000:0.0:1783444194.591171:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575207168 00000100:00100000:0.0:1783444194.591179:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575207552 00000100:00100000:0.0:1783444194.591181:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575207552 00000100:00100000:0.0:1783444194.591188:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575208064 00000100:00100000:0.0:1783444194.591190:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575208064 00000100:00100000:0.0:1783444194.591197:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575207040 00000100:00100000:0.0:1783444194.591199:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575207040 00000100:00100000:0.0:1783444194.591228:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575207296 00000100:00100000:0.0:1783444194.591231:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575207296 00000100:00100000:0.0:1783444194.591249:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1783444194.591280:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575207040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444194.591334:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575207040:12345-0@lo:400:kworker.0 Request processed in 56us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.591341:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1783444194.591358:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1783444194.591364:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575207296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444194.591391:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575207296:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.591398:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1783444194.591410:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1783444194.591413:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575206912:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444194.591430:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3185 last 0 00000020:00000080:0.0:1783444194.591471:0:67017:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42cb6883e3831715 00000004:00100000:0.0:1783444194.591479:0:67017:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444194.591500:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368c9a10800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444194.591550:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1870073575206912:12345-0@lo:38:kworker.0 Request processed in 133us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.591556:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1783444194.591571:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1783444194.591576:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575207168:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444194.591589:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3185 last 0 00000020:00000080:0.0:1783444194.591611:0:67017:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42cb6883e383171c 00000004:00100000:0.0:1783444194.591616:0:67017:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444194.591632:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368c6bc8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444194.591659:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1870073575207168:12345-0@lo:38:kworker.0 Request processed in 81us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.591672:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1783444194.591687:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1783444194.591690:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575207552:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444194.591704:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3185 last 0 00000020:00000080:0.0:1783444194.591724:0:67017:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x42cb6883e3831723 00000004:00100000:0.0:1783444194.591730:0:67017:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444194.591744:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368ff64c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444194.591772:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1870073575207552:12345-0@lo:38:kworker.0 Request processed in 80us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.591777:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1783444194.591942:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1783444194.591947:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575208064:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444194.591960:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3185 last 0 00000020:00000080:0.0:1783444194.591982:0:67017:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42cb6883e383172a 00000004:00100000:0.0:1783444194.591990:0:67017:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444194.592004:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368ff64a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444194.592033:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575208064:12345-0@lo:38:kworker.0 Request processed in 84us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.592038:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1783444194.592062:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575207936 00000100:00100000:0.0:1783444194.592066:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575207936 00000100:00100000:0.0:1783444194.592098:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259 00000100:00100000:0.0:1783444194.592105:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575207936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444194.592136:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575207936:12345-0@lo:400:kworker.0 Request processed in 32us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.592153:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259 00000100:00100000:0.0:1783444194.592174:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575208192 00000100:00100000:0.0:1783444194.592178:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575208192 00000100:00100000:0.0:1783444194.592209:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:0.0:1783444194.592215:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575208192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444194.592240:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:0.0:1783444194.592282:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575208192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.592289:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00080000:0.0:1783444194.592307:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444194.592311:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444194.592347:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575207296:0@lo:400:kworker.0 00000100:00100000:0.0:1783444194.592364:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575208192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444194.592373:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575207040:0@lo:400:kworker.0 00000100:00100000:0.0:1783444194.592382:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575207936:0@lo:400:kworker.0 00010000:00080000:0.0:1783444194.592427:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368c9f68a80 x1870073575206912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444194.592440:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00100000:3.0:1783444194.594059:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575206784:0@lo:400:kworker.0 00000100:00100000:3.0:1783444194.594140:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444194.594200:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575207808:0@lo:400:kworker.0 00000100:00100000:3.0:1783444194.594237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444194.594437:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9368c9f68a80 x1870073575206912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444219 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444194.594449:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444194.594454:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444194.594459:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444194.594464:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575206912:0@lo:38:kworker.0 00010000:00080000:0.0:1783444194.594508:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368c9f69180 x1870073575207168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444194.594525:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00100000:3.0:1783444194.594624:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444194.594640:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575207680:0@lo:400:kworker.0 00000100:00100000:3.0:1783444194.594668:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444194.594728:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575207808 00000100:00100000:3.0:1783444194.594734:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575207808 00000100:00100000:3.0:1783444194.594782:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1783444194.594888:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575207808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444194.594939:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575207808:12345-0@lo:400:kworker.0 Request processed in 148us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444194.594947:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1783444194.594979:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575207808:0@lo:400:kworker.0 00000100:00100000:3.0:1783444194.597410:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575206784 00000100:00100000:3.0:1783444194.597426:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575206784 00000100:00100000:3.0:1783444194.597487:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783444194.597497:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575206784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444194.598041:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575206784:12345-0@lo:400:kworker.0 Request processed in 545us (3900us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444194.598051:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783444194.598109:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575206784:0@lo:400:kworker.0 00000100:00080000:3.0:1783444194.598138:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444194.598151:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575207680 00000100:00100000:3.0:1783444194.598155:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575207680 00000100:00100000:3.0:1783444194.598183:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1783444194.598189:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575207680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444194.598229:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575207680:12345-0@lo:400:kworker.0 Request processed in 40us (3559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444194.598235:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:3.0:1783444194.598289:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575207680:0@lo:400:kworker.0 00000100:00080000:0.0:1783444194.599651:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9368c9f69180 x1870073575207168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444219 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444194.599665:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444194.599670:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444194.599675:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444194.599680:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575207168:0@lo:38:kworker.0 00010000:00080000:0.0:1783444194.599711:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368e69fc700 x1870073575207552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444194.599726:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00100000:1.0:1783444194.600029:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575207424:12345-0@lo:38:kworker.0 Request processed in 9450us (9631us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444194.600047:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00010000:00080000:2.0:1783444194.600692:0:85155:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783444194.600699:0:85155:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 98784247810 00000020:00080000:2.0:1783444194.600706:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783444194.600709:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247810, next_transno: 98784247810 00010000:00080000:2.0:1783444194.600713:0:85155:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247810) 00000020:00080000:2.0:1783444194.600715:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783444194.600726:0:85155:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557739264 t98784247810 from 192.168.204.20@tcp req@ffff9369018a9180 x1870073557739264/t0(98784247810) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:565/0 lens 528/0 e 0 to 0 dl 1783444200 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444194.602194:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9368e69fc700 x1870073575207552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444219 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444194.602209:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444194.602215:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444194.602219:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444194.602225:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575207552:0@lo:38:kworker.0 00010000:00080000:0.0:1783444194.602297:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368e69ff800 x1870073575208064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444194.602312:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:0.0:1783444194.602321:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783444194.602325:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783444194.602335:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783444194.602339:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575208064:0@lo:38:kworker.0 00000100:00080000:0.0:1783444194.602380:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:0.0:1783444194.602388:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783444194.602392:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783444194.602394:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:0.0:1783444194.602399:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368f8ca7800 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:0.0:1783444194.602402:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1783444194.602561:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575207424:0@lo:38:kworker.0 00010000:00080000:0.0:1783444194.602583:0:85368:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1783444194.602587:0:85368:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1783444194.602592:0:85368:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1783444194.603050:0:85368:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1783444194.603099:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575208320:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783444194.603168:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444194.603218:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575208320 00000100:00100000:0.0:1783444194.603226:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575208320 00000100:00100000:0.0:1783444194.603281:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:0.0:1783444194.603290:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575208320:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1783444194.603309:0:8430:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9368dd15df80 x1870073575208320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:570/0 lens 224/0 e 0 to 0 dl 1783444205 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444194.603320:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575208320:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 31us (153us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444194.603326:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000004:00080000:3.0:1783444194.609977:0:85155:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9092us 00010000:00010000:1.0:1783444194.638758:0:85155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.638782:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.638827:0:85155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.638841:0:85155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.638848:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.638855:0:85155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641398:0:85155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641415:0:85155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641422:0:85155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641428:0:85155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444194.641433:0:85155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641451:0:85155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641468:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7860100) 00010000:00010000:1.0:1783444194.641471:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444194.641476:0:85155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641482:0:85155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a55e00/0x42cb6883e3831731 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444194.641503:0:85155:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffa7cf70 reply state 0000000033d2fb2b transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641515:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.641522:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7860f00) 00010000:00010000:1.0:1783444194.641525:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444194.641530:0:85155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1783444194.642447:0:85155:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1783444194.642471:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444194.642475:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000020:00080000:1.0:1783444194.642479:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444194.642481:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000001:00080000:0.0:1783444194.646420:0:85122:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247810 is committed 00010000:00010000:1.0:1783444194.646742:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.646757:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.646782:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.648901:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444194.648908:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.648921:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.648941:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7860f00) 00010000:00010000:1.0:1783444194.648944:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444194.648949:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.648956:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6a54000/0x42cb6883e3831738 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444194.654515:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444194.657276:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557739776 00000100:00100000:3.0:1783444194.657293:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557739776 00000100:00100000:3.0:1783444194.657378:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1065 00000100:00100000:3.0:1783444194.657390:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557739776:12345-192.168.204.20@tcp:36:rm.0 00010000:00080000:3.0:1783444194.657415:0:67017:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247811, current: 98784247811, replaying 00000100:00100000:3.0:1783444194.657434:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557739776:12345-192.168.204.20@tcp:36:rm.0 Request processed in 47us (2930us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444194.657441:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1065 00000020:00080000:3.0:1783444194.657472:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.657476:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247811, next_transno: 98784247811 00010000:00080000:3.0:1783444194.657480:0:85155:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247811) 00000020:00080000:3.0:1783444194.657483:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.657492:0:85155:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557739776 t98784247811 from 192.168.204.20@tcp req@ffff9368e69ff800 x1870073557739776/t0(98784247811) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:570/0 lens 512/0 e 0 to 0 dl 1783444205 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783444194.657786:0:85155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.657844:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.657857:0:85155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.657872:0:85155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.657895:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.657904:0:85155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658005:0:85155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658014:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658021:0:85155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658307:0:85155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658315:0:85155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658322:0:85155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658328:0:85155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444194.658331:0:85155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658339:0:85155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658350:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:3.0:1783444194.658359:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783444194.658364:0:85155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658371:0:85155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e383174d lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658393:0:85155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658399:0:85155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658405:0:85155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658411:0:85155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444194.658414:0:85155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658420:0:85155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658427:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:3.0:1783444194.658430:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444194.658433:0:85155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658438:0:85155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27200/0x42cb6883e383173f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444194.658449:0:85155:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e117523 reply state 000000004cc34b46 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658471:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.658478:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368f57c6400) 00010000:00010000:3.0:1783444194.658480:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444194.658483:0:85155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783444194.659003:0:85155:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444194.659021:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.659024:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000020:00080000:3.0:1783444194.659027:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.659029:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000100:00100000:0.0:1783444194.665516:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444194.665658:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557740928 00000100:00100000:3.0:1783444194.665670:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557740928 00000100:00100000:3.0:1783444194.665736:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1066 00000100:00100000:3.0:1783444194.665746:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557740928:12345-192.168.204.20@tcp:101:lfs.0 00010000:00080000:3.0:1783444194.665770:0:66226:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247812, current: 98784247812, replaying 00000100:00100000:3.0:1783444194.665786:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557740928:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 42us (281us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444194.665977:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1066 00000020:00080000:3.0:1783444194.665997:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.666001:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247812, next_transno: 98784247812 00010000:00080000:3.0:1783444194.666005:0:85155:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247812) 00000020:00080000:3.0:1783444194.666008:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.666017:0:85155:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557740928 t98784247812 from 192.168.204.20@tcp req@ffff9368e69fc700 x1870073557740928/t0(98784247812) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:570/0 lens 536/0 e 0 to 0 dl 1783444205 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1783444194.666042:0:85155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444194.666087:0:85155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831754 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a1e expref: -99 pid: 85155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.666354:0:85155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.666374:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.666386:0:85155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.666399:0:85155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.666406:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.666412:0:85155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444194.667167:0:85155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:3.0:1783444194.667187:0:85155:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x42cb6883e38314d7 00000004:00080000:3.0:1783444194.667189:0:85155:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x42cb6883e38314d7 in new mfd 00010000:00010000:3.0:1783444194.667199:0:85155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.667208:0:85155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.667215:0:85155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.669317:0:85155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444194.669327:0:85155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.669339:0:85155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.669359:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6f00) 00010000:00010000:3.0:1783444194.669362:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444194.669367:0:85155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.669374:0:85155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383175b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444194.669401:0:85155:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f78f47b8 reply state 000000007bf3105e transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.669415:0:85155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.669423:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9368f57c6500) 00010000:00010000:3.0:1783444194.669425:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444194.669429:0:85155:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783444194.669483:0:85155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831754 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 10 pid: 85155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.669495:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f57c6f00) 00010000:00010000:3.0:1783444194.669498:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444194.669512:0:85155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831754 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a1e expref: 10 pid: 85155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.669530:0:85155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26000, rc 0) 00010000:00080000:3.0:1783444194.671413:0:85155:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444194.671444:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.671448:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000020:00080000:3.0:1783444194.671453:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.671455:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000100:00100000:0.0:1783444194.710400:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444194.710469:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557741184 00000100:00100000:3.0:1783444194.710481:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557741184 00000100:00100000:3.0:1783444194.710582:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1067 00000100:00100000:3.0:1783444194.710595:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557741184:12345-192.168.204.20@tcp:101:lfs.0 00010000:00080000:3.0:1783444194.710616:0:80475:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:3.0:1783444194.710639:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557741184:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 48us (252us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444194.710647:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1067 00000020:00080000:1.0:1783444194.710683:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444194.710688:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:1.0:1783444194.710692:0:85155:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:1.0:1783444194.710695:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444194.710705:0:85155:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557741184 t98784247813 from 192.168.204.20@tcp req@ffff9368e69fce00 x1870073557741184/t0(98784247813) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:570/0 lens 736/0 e 0 to 0 dl 1783444205 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783444194.710729:0:85155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444194.710763:0:85155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e3831770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a25 expref: -99 pid: 85155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444194.710919:0:85155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:1.0:1783444194.711097:0:85155:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x42cb6883e38314ec 00000004:00080000:1.0:1783444194.711101:0:85155:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x42cb6883e38314ec in new mfd 00010000:00010000:1.0:1783444194.711135:0:85155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e3831770 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a25 expref: 12 pid: 85155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.711149:0:85155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7860f00) 00010000:00010000:1.0:1783444194.711152:0:85155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444194.711157:0:85155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e3831770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a25 expref: 12 pid: 85155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.711172:0:85155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70400, rc 0) 00010000:00080000:1.0:1783444194.711248:0:85155:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783444194.711276:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444194.711279:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:1.0:1783444194.711283:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444194.711285:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:0.0:1783444194.722844:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444194.723016:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557741568 00000100:00100000:3.0:1783444194.723027:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557741568 00000100:00100000:3.0:1783444194.723082:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:3.0:1783444194.723092:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2400:x1870073557741568:12345-192.168.204.20@tcp:35:lfs.0 00010000:00080000:3.0:1783444194.723113:0:66228:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:3.0:1783444194.723127:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2400:x1870073557741568:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 38us (293us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444194.723135:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 216 00000020:00080000:3.0:1783444194.723152:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.723164:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:3.0:1783444194.723168:0:85155:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:3.0:1783444194.723172:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.723181:0:85155:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557741568 t98784247814 from 192.168.204.20@tcp req@ffff9368e69fe300 x1870073557741568/t0(98784247814) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:570/0 lens 392/0 e 0 to 0 dl 1783444205 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444194.723431:0:85155:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444194.723448:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.723452:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:3.0:1783444194.723454:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.723456:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:0.0:1783444194.728412:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444194.728691:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557741824 00000100:00100000:3.0:1783444194.728701:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557741824 00000100:00100000:3.0:1783444194.728767:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:3.0:1783444194.728777:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2400:x1870073557741824:12345-192.168.204.20@tcp:35:lfs.0 00010000:00080000:3.0:1783444194.728827:0:76566:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:3.0:1783444194.728844:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2400:x1870073557741824:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 69us (443us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444194.728851:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 217 00000020:00080000:3.0:1783444194.728870:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.728875:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:3.0:1783444194.728879:0:85155:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:3.0:1783444194.728882:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.728891:0:85155:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557741824 t98784247815 from 192.168.204.20@tcp req@ffff9368e69fc380 x1870073557741824/t0(98784247815) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:570/0 lens 392/0 e 0 to 0 dl 1783444205 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444194.729125:0:85155:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444194.729141:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.729157:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:3.0:1783444194.729160:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.729162:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:3.0:1783444194.733725:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444194.733959:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557747584 00000100:00100000:1.0:1783444194.733969:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557747584 00000100:00100000:1.0:1783444194.734033:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 789 00000100:00100000:1.0:1783444194.734042:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2400:x1870073557747584:12345-192.168.204.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783444194.734068:0:67017:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9369018a8e00 x1870073557747584/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:570/0 lens 224/0 e 0 to 0 dl 1783444205 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444194.734084:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2400:x1870073557747584:12345-192.168.204.20@tcp:400:ldlm_lock_repla.0 Request processed in 44us (372us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444194.734110:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 789 00000020:00080000:3.0:1783444194.734265:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.734270:0:85155:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00080000:3.0:1783444194.734274:0:85155:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1783444194.734276:0:85155:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444194.734285:0:85155:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783444194.734288:0:85155:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1783444194.734404:0:85155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:1.0:1783444194.736639:0:85122:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00100000:1.0:1783444194.736650:0:85122:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1783444194.736676:0:85122:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:2.0:1783444194.736764:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736778:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736786:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736819:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444194.736825:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736832:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736852:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736869:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3831746 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736898:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736905:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736910:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736915:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444194.736918:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736924:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736933:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.736938:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e3831762 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85155 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444194.737171:0:85155:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783444194.737212:0:85155:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783444194.737238:0:85155:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9368dd15df80 x1870073575208320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:570/0 lens 224/0 e 0 to 0 dl 1783444205 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783444194.737363:0:85155:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.20@tcp: req@ffff9369018a8e00 x1870073557747584/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:570/0 lens 224/0 e 0 to 0 dl 1783444205 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444194.737434:0:85155:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1783444194.739126:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783444194.739140:0:3632:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9368dd15f800 x1870073575208320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444210 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444194.739151:0:3632:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9368dd15f800 x1870073575208320/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444210 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444194.739158:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783444194.739172:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1783444194.739178:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e4e5ee80): req@ffff9368dcf3ce00 x1870073575186304/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444174 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444194.739199:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575208320:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1783444194.739298:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575208448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444194.739350:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444194.739397:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575208448 00000100:00100000:1.0:1783444194.739404:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575208448 00000100:00100000:1.0:1783444194.739449:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:1.0:1783444194.739459:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575208448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444194.739487:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:1.0:1783444194.739528:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575208448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444194.739535:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:1.0:1783444194.739584:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575208448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444194.740989:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444194.742191:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575186304 00000100:00100000:0.0:1783444194.742200:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575186304 00000100:00100000:0.0:1783444194.743337:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:0.0:1783444194.743350:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575186304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783444194.743385:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:0.0:1783444194.743466:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575186304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.743473:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:2.0:1783444194.750718:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575186304:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1783444194.795326:0:85155:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac1c47d53e10 00100000:10000000:0.0:1783444194.795341:0:85155:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1783444194.797376:0:85141:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1783444194.797429:0:85141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85141:1870073575208576:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783444194.797497:0:85141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444194.797526:0:85141:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c170e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444194.797563:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575208576 00000100:00100000:0.0:1783444194.797570:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575208576 00000100:00100000:0.0:1783444194.797613:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5848 00000100:00100000:0.0:1783444194.797622:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:85141:x1870073575208576:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783444194.797651:0:26201:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -561 00002000:02000040:0.0:1783444194.797655:0:26201:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:737) 00000004:00080000:2.0:1783444194.802095:0:85143:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:2.0:1783444194.802145:0:85143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85143:1870073575208704:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783444194.803069:0:85143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444194.803153:0:85143:0:(client.c:2702:ptlrpc_set_wait()) set ffff936901f09b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444194.808726:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575208704 00000100:00100000:1.0:1783444194.808743:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575208704 00000100:00100000:1.0:1783444194.809681:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5849 00000100:00100000:1.0:1783444194.809693:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:85143:x1870073575208704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783444194.809728:0:26200:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -63 00002000:02000040:1.0:1783444194.809733:0:26200:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:737) 00002000:00010000:2.0:1783444194.816366:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.816379:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.816397:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.816402:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.816408:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.816425:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.816434:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.816442:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.816461:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444194.817661:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.817670:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.817681:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.817684:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.817696:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.817707:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.817715:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.817723:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.817737:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444194.817898:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444194.817911:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.817921:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583ea00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444194.817925:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.817934:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.817951:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.817958:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da5bb42c/0x42cb6883e383177e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.817975:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444194.817978:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.817984:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fa00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444194.817987:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.817994:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.818015:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.818022:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056b83bc1/0x42cb6883e3831785 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.818036:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444194.818038:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444194.818040:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444194.818055:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444194.818360:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.818366:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.818375:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.818378:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.818382:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.818391:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.818399:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.818418:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.818434:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444194.825535:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.825553:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825570:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.825575:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.825582:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825599:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825609:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825618:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825639:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444194.825657:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444194.825664:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825673:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.825678:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825687:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825707:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825715:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4f7b532/0x42cb6883e383178c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825737:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444194.825741:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825748:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.825751:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825757:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825782:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825823:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3831793 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825840:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.825842:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.825845:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444194.825982:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.825988:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.825996:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.825999:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.826003:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826012:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826019:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826027:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826052:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444194.826062:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444194.826067:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826074:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.826078:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826085:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826097:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826104:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e383179a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826122:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826124:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826127:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444194.826175:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.826180:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826188:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.826197:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.826201:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826211:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826219:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826226:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826245:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444194.826277:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444194.826285:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826296:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444194.826300:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444194.826305:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.826315:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826317:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826331:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.826336:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.826342:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826343:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826364:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38317a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826368:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826384:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826387:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826400:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826414:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444194.826424:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444194.826427:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826435:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.826438:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826445:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826455:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826462:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e38317a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826474:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826476:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826477:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444194.826519:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.826531:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826539:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.826542:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.826546:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826552:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444194.826556:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826557:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826567:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826575:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826593:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444194.826641:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.826647:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826655:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.826658:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.826662:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826670:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826678:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444194.826685:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826692:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826698:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444194.826705:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.826705:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826707:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826725:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826736:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444194.826739:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826747:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444194.826749:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e38317af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826753:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826764:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.826771:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826782:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826782:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.826785:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444194.826808:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826824:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826833:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e38317b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.826849:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826858:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.826860:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444194.828408:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.828418:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.828450:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.828455:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.828462:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444194.828612:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.828613:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828622:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.828627:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828637:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.828641:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.828649:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.828653:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828667:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828677:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.828681:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444194.828690:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828707:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783444194.828745:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.828761:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444194.828775:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.828776:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.828785:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.828813:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828816:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.828833:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.828857:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828858:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.828866:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.828874:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828876:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828899:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.828917:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783444194.828918:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828930:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.828947:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1783444194.828970:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.828977:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.828985:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.828988:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.828993:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444194.829000:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.829004:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829007:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829027:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829031:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.829032:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829037:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.829048:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829054:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.829060:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1783444194.829078:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829086:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829097:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1783444194.829118:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.829125:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.829133:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.829136:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.829141:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444194.829145:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.829151:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829153:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.829174:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829175:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829181:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829185:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829194:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829202:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829209:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829246:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1783444194.829293:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.829299:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829307:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829309:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829313:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829323:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829331:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829338:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829347:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1783444194.829381:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.829386:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829394:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829402:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829407:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829416:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829424:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829432:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829439:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1783444194.829473:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.829477:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829484:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829488:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829491:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829500:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829508:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829521:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829529:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1783444194.829564:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.829568:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829576:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829579:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829583:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829592:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829601:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829608:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829615:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1783444194.829644:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.829650:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829662:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829665:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829669:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829678:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829686:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829694:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829702:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1783444194.829735:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.829739:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829747:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829750:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829754:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829762:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829781:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829807:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829818:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1783444194.829864:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.829869:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829877:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829880:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829883:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829893:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829901:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829909:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829928:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1783444194.829977:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.829983:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.829991:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.829994:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.829998:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830007:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830015:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830023:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830030:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1783444194.830057:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830062:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830069:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830077:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.830082:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830091:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830099:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830107:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830115:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1783444194.830148:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830153:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830160:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830163:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.830167:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830176:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830183:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830196:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830205:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1783444194.830236:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830242:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830250:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830264:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.830270:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830280:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.830292:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830295:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830315:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830335:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00010000:00010000:2.0:1783444194.830340:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1783444194.830377:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830384:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830396:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830399:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1783444194.830403:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830404:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.830415:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830419:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830432:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830440:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830447:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:3.0:1783444194.830479:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830484:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830491:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830493:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.830497:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830506:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830523:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830531:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830539:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:3.0:1783444194.830567:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830572:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830579:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830582:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.830585:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830593:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830601:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830608:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830626:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:3.0:1783444194.830657:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830662:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830669:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830672:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.830676:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830685:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830693:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830700:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830707:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:3.0:1783444194.830731:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830735:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.830749:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830750:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.830755:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.830759:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.830763:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830766:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.830786:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830811:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.830814:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.830835:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830836:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.830857:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00010000:00010000:3.0:1783444194.830858:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830872:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:3.0:1783444194.830914:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.830919:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830926:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.830929:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.830933:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830942:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830949:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830961:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.830970:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:2.0:1783444194.830984:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.830992:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831002:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=3185s v=(0 0) 00002000:00010000:3.0:1783444194.831011:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.831013:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.831021:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831022:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831042:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.831046:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.831047:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831048:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:3.0:1783444194.831051:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831058:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831072:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831079:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831085:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fa00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444194.831093:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831098:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831104:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831110:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831117:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831141:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00010000:00010000:3.0:1783444194.831142:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00010000:00010000:0.0:1783444194.831147:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831157:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056b83bc1/0x42cb6883e38317bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444194.831179:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.831186:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831191:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:0.0:1783444194.831198:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831205:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:0.0:1783444194.831209:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444194.831210:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444194.831214:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831217:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831232:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831237:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831265:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831266:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831287:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066544d8a/0x42cb6883e38317c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831289:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831314:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00010000:00010000:0.0:1783444194.831320:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:0.0:1783444194.831325:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.831334:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583ea00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444194.831338:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444194.831351:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444194.831360:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831361:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831385:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:0.0:1783444194.831386:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831390:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.831400:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831409:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831428:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831435:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831443:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:3.0:1783444194.831475:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.831480:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831488:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.831491:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.831495:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831504:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831511:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831519:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831536:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:3.0:1783444194.831564:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.831569:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831577:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.831580:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.831584:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831593:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.831601:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.831602:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831612:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831615:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831635:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00010000:3.0:1783444194.831675:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.831680:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831687:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.831694:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.831698:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831711:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831712:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.831721:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.831728:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831731:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831740:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831754:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00010000:00010000:2.0:1783444194.831754:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831769:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.831806:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444194.831813:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.831818:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/31 locks to regular blp list, 31 blwis in pool 00010000:00010000:3.0:1783444194.831821:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831830:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.831833:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.831837:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831848:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831856:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831869:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.831870:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.831882:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831885:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/32 locks to regular blp list, 32 blwis in pool 00002000:00010000:3.0:1783444194.831920:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444194.831925:0:26201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831933:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:3.0:1783444194.831935:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444194.831940:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831948:0:26201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831955:0:26201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831962:0:26201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444194.831969:0:26201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/33 locks to regular blp list, 33 blwis in pool 00010000:00010000:0.0:1783444194.832116:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da5bb42c/0x42cb6883e38317cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832138:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 32 total in blp. (32 blwis in pool) 00010000:00010000:2.0:1783444194.832142:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:0.0:1783444194.832144:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.832150:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444194.832160:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.832161:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832166:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832183:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832197:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832206:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38317d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832234:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 31 total in blp. (31 blwis in pool) 00010000:00010000:0.0:1783444194.832239:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.832246:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832248:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444194.832265:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.832274:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832276:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.832299:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832302:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832320:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce2bf87a/0x42cb6883e38317d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.832321:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/32 locks to regular blp list, 32 blwis in pool 00010000:00010000:0.0:1783444194.832337:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 31 total in blp. (31 blwis in pool) 00010000:00010000:0.0:1783444194.832342:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832349:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444194.832353:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832371:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.832373:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.832385:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832390:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832407:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e38317e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.832414:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.832419:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444194.832422:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 30 total in blp. (30 blwis in pool) 00010000:00010000:2.0:1783444194.832425:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832427:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832446:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.832450:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832451:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832470:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832479:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832485:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c633c80/0x42cb6883e38317ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832505:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:0.0:1783444194.832508:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832514:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444194.832517:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832524:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832550:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832557:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38317f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832567:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:0.0:1783444194.832570:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832575:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444194.832578:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832593:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444194.832602:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.832993:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833001:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833012:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00010000:2.0:1783444194.833058:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.833063:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833072:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.833075:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.833079:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833088:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833114:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833121:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833129:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00002000:00010000:2.0:1783444194.833166:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.833171:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833243:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.833248:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.833252:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833272:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833280:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833286:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833306:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/31 locks to regular blp list, 31 blwis in pool 00002000:00010000:2.0:1783444194.833349:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.833355:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833363:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.833366:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.833370:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833377:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833384:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833391:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833400:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/32 locks to regular blp list, 32 blwis in pool 00002000:00010000:2.0:1783444194.833438:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.833443:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833451:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.833459:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.833464:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833545:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833553:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833560:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833569:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/33 locks to regular blp list, 33 blwis in pool 00002000:00010000:2.0:1783444194.833609:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.833619:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833627:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.833630:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.833696:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833707:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833716:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833730:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833739:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/34 locks to regular blp list, 34 blwis in pool 00002000:00010000:2.0:1783444194.833778:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.833783:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833823:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.833827:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.833832:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833842:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833851:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833860:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.833869:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/35 locks to regular blp list, 35 blwis in pool 00010000:00010000:1.0:1783444194.833896:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 34 total in blp. (34 blwis in pool) 00010000:00010000:1.0:1783444194.833904:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.833914:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.833918:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.833928:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.833942:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.833949:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e3831803 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.833967:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 33 total in blp. (33 blwis in pool) 00010000:00010000:1.0:1783444194.833971:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.833973:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.833983:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.833985:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.833988:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834009:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.834013:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.834021:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834029:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834035:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834045:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834046:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834067:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834069:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000959f2509/0x42cb6883e383180a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834089:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/34 locks to regular blp list, 34 blwis in pool 00010000:00010000:1.0:1783444194.834096:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 33 total in blp. (33 blwis in pool) 00010000:00010000:1.0:1783444194.834101:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834107:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834110:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834119:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834130:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.834134:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.834139:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e14e1789/0x42cb6883e3831811 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834142:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834157:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.834164:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.834172:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834181:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 32 total in blp. (32 blwis in pool) 00010000:00010000:1.0:1783444194.834186:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834193:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834196:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834205:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834216:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834223:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e3831818 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834235:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 31 total in blp. (31 blwis in pool) 00010000:00010000:1.0:1783444194.834239:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834245:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834250:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834251:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834300:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834302:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834317:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834324:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834329:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/32 locks to regular blp list, 32 blwis in pool 00010000:00010000:1.0:1783444194.834337:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e383181f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834352:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 31 total in blp. (31 blwis in pool) 00010000:00010000:1.0:1783444194.834357:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834363:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834366:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.834374:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.834374:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834385:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834392:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834397:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.834405:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.834407:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831826 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834413:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834429:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834439:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834441:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 30 total in blp. (30 blwis in pool) 00010000:00010000:1.0:1783444194.834448:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834452:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834463:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834468:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834476:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834486:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834493:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383182d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834505:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:1.0:1783444194.834509:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834516:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834519:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834537:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834562:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00010000:00010000:1.0:1783444194.834562:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834574:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831834 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834587:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:1.0:1783444194.834590:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834596:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834600:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.834608:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.834608:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834619:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834624:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834631:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.834636:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383183b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834673:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:1.0:1783444194.834678:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834685:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834689:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834696:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834705:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.834712:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834714:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834734:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b77da470/0x42cb6883e38317e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834736:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834753:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834758:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:2.0:1783444194.834761:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834764:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834781:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.834782:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00010000:00010000:1.0:1783444194.834786:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834831:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.834843:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.834844:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834854:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834858:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831842 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834870:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.834879:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:2.0:1783444194.834881:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.834884:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834887:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834895:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834898:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834905:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834915:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834921:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831850 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834943:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:1.0:1783444194.834946:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834951:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.834954:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834971:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834974:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.834990:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.834991:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835013:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831857 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835014:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835040:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00010000:00010000:1.0:1783444194.835045:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:1.0:1783444194.835050:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835057:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835061:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835082:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.835083:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.835094:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835101:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835104:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.835112:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.835117:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e383185e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835119:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835142:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835149:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:2.0:1783444194.835151:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835154:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835178:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.835179:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835182:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835189:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835198:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835205:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d04b4e7/0x42cb6883e3831849 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835230:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:1.0:1783444194.835234:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835242:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835248:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835268:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00010000:00010000:1.0:1783444194.835270:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835284:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835292:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831865 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835306:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00002000:00010000:2.0:1783444194.835310:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.835310:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835321:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835323:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835329:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835336:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.835341:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.835348:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835361:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835365:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835383:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835386:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835395:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835400:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e383186c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835409:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00010000:00010000:1.0:1783444194.835420:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:1.0:1783444194.835426:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835433:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835437:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835445:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.835449:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.835457:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835458:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835471:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a40accfb/0x42cb6883e3831873 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835500:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:1.0:1783444194.835504:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835510:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835513:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835521:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835530:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835548:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.835548:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383187a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835557:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.835565:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835574:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:2.0:1783444194.835577:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835580:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835594:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835595:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835601:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835610:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835624:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00010000:00010000:1.0:1783444194.835630:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835645:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835653:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831881 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835670:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:1.0:1783444194.835673:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835679:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835683:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835691:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835701:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835708:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.835736:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.835739:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:2.0:1783444194.835744:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835745:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835765:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.835766:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.835772:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444194.835773:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835780:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835811:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835812:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835837:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835849:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835851:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383188f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.835871:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835878:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:2.0:1783444194.835883:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00010000:00010000:1.0:1783444194.835884:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835894:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835899:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835919:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835930:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835938:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831896 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835949:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:1.0:1783444194.835953:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835958:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1a000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.835962:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835969:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835980:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.835988:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba45d253/0x42cb6883e38318a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.835999:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444194.836010:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836019:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:2.0:1783444194.836021:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:1.0:1783444194.836025:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836026:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.836035:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836040:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836046:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836053:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836060:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836068:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836078:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836079:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836102:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383189d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836129:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00010000:00010000:1.0:1783444194.836131:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:1.0:1783444194.836136:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836143:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1a600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836148:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836169:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444194.836179:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444194.836182:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836191:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2f125e0/0x42cb6883e38318ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836206:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:1.0:1783444194.836210:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836217:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1b400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836220:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836228:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836238:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836249:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836250:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff5959e/0x42cb6883e38318b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836274:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=3185s v=(0 0) 00010000:00010000:2.0:1783444194.836278:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444194.836286:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836300:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836302:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:1.0:1783444194.836310:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836316:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836328:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.836332:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836335:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.836355:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00010000:00010000:1.0:1783444194.836356:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836371:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836381:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a2a0825/0x42cb6883e38318b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836398:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:1.0:1783444194.836402:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836410:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836414:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836447:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836460:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836469:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7973f43/0x42cb6883e38318c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836483:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:1.0:1783444194.836487:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836493:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836496:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836503:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836513:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836520:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38318c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836544:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:1.0:1783444194.836549:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836556:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836559:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836569:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836582:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836591:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b62771/0x42cb6883e38318ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836603:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:1.0:1783444194.836608:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836615:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836618:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836638:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836648:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836656:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6ff54e/0x42cb6883e38318d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836669:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1783444194.836673:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836679:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836682:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836690:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836701:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836709:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f285823/0x42cb6883e38318dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836734:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1783444194.836737:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836745:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836748:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836757:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836767:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836774:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb950db/0x42cb6883e38318e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836822:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1783444194.836827:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836836:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757c00 already unused, calling callback (ffffffffc0c36f90) 00002000:00080000:2.0:1783444194.836837:0:26200:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00010000:00010000:1.0:1783444194.836840:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836860:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836872:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836880:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074cfe0e5/0x42cb6883e38318ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836898:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1783444194.836902:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836910:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836913:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836920:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836930:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836937:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e38318f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836960:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1783444194.836963:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836970:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.836974:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836983:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.836998:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444194.837004:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:85143:x1870073575208704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27307us (34781us total) trans 0 rc 0/0 00010000:00010000:1.0:1783444194.837014:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e38318f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444194.837021:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5849 00010000:00010000:1.0:1783444194.837040:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1783444194.837045:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837054:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.837058:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837080:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837093:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837102:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e38318ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837121:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1783444194.837126:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837135:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.837140:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837148:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837161:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837170:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3831906 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837173:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783444194.837204:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783444194.837209:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837217:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444194.837220:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837227:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837237:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444194.837245:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e3831914 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837251:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837270:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.837274:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837284:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837299:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837309:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e383190d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837330:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783444194.837335:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837345:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.837349:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837359:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837386:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837396:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e383191b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837414:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783444194.837418:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837427:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.837432:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837442:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837455:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837464:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3831922 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837546:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444194.837551:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837566:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.837570:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837581:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837596:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837605:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e3831929 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837619:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444194.837623:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837695:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.837701:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837712:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837726:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837741:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3831930 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837758:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444194.837762:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837769:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444194.837773:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837782:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837817:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837826:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3831937 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444194.837838:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444194.837840:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444194.837842:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444194.837892:0:85143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85143:1870073575208704:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783444194.837978:0:85143:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2e1:0x0] from OST, last_created [0x2c0000401:0x2e1:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00010000:00010000:0.0:1783444194.838015:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38317fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444194.838068:0:85143:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85143:1870073575208960:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1783444194.838074:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.838079:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.838081:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444194.838122:0:85143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783444194.838123:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.838128:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444194.838132:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444194.838153:0:85143:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5919600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444194.838275:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575208832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444194.838306:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444194.838353:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575208960 00000100:00100000:2.0:1783444194.838379:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575208960 00000100:00100000:2.0:1783444194.838426:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5850 00000100:00100000:2.0:1783444194.838438:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:85143:x1870073575208960:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783444194.838547:0:8421:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00010000:00010000:1.0:1783444194.838843:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444194.841885:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575208832 00000100:00100000:0.0:1783444194.841899:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575208832 00000100:00100000:0.0:1783444194.841965:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1783444194.841977:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3634:x1870073575208832:12345-0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1783444194.841990:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00000024:0.0:1783444194.842002:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444194.842085:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3634:x1870073575208832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444194.842093:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1783444194.842273:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575208832:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1783444194.842384:0:26201:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:3.0:1783444194.842440:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:85141:x1870073575208576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44818us (44942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444194.842455:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5848 00000100:00100000:0.0:1783444194.843218:0:85141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85141:1870073575208576:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783444194.843230:0:85141:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2e1:0x0] from OST, last_created [0x280000401:0x2e1:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1783444194.843311:0:85141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85141:1870073575209216:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783444194.843350:0:85141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444194.843372:0:85141:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c170e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444194.843397:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575209216 00000100:00100000:0.0:1783444194.843403:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575209216 00000100:00100000:0.0:1783444194.843434:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5851 00000100:00100000:3.0:1783444194.843561:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575209088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444194.843595:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444194.843631:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575209088 00000100:00100000:3.0:1783444194.843635:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575209088 00000100:00100000:3.0:1783444194.843661:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:3.0:1783444194.843668:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1870073575209088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444194.843684:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444194.843717:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1870073575209088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444194.843723:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1783444194.844018:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:85141:x1870073575209216:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783444194.844021:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575209088:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1783444194.844054:0:8824:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 738 00000001:00100000:2.0:1783444194.845523:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783444194.847063:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969451 is committed 00000100:00100000:2.0:1783444194.855495:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:85143:x1870073575208960:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17049us (17363us total) trans 4294969451 rc 0/0 00000100:00100000:2.0:1783444194.855509:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5850 00000100:00100000:3.0:1783444194.856347:0:85143:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:3.0:1783444194.856357:0:85143:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85143:1870073575208960:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783444194.856375:0:85143:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2e1:0x0]-[0x2c0000401:0x301:0x0] 00000100:00100000:0.0:1783444194.857762:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:85141:x1870073575209216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13744us (14406us total) trans 4294969447 rc 0/0 00000100:00100000:0.0:1783444194.857773:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5851 00000100:00100000:2.0:1783444194.857846:0:85141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85141:1870073575209216:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783444194.857860:0:85141:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2e1:0x0]-[0x280000401:0x301:0x0] 00000001:02000400:2.0:1783444195.102164:0:85409:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:1.0:1783444195.121378:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783444195.231527:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783444196.139694:0:85461:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444196.139981:0:85461:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783444196.253346:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444197.283771:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783444197.329646:0:85511:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444197.338560:0:85511:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783444198.301367:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444199.197433:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444199.197467:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575209344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444199.197570:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444199.198031:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575209344 00000100:00100000:3.0:1783444199.198044:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575209344 00000100:00100000:2.0:1783444199.198270:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:2.0:1783444199.198287:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575209344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444199.198351:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444199.198429:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575209344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444199.198437:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:2.0:1783444199.198519:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575209344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783444199.198692:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444199.208396:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444199.208430:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575209472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444199.208531:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444199.209292:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575209472 00000100:00100000:1.0:1783444199.209306:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575209472 00000100:00100000:1.0:1783444199.209407:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:1.0:1783444199.209422:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575209472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444199.209467:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444199.209554:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575209472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.209562:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:00080000:0.0:1783444199.212329:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444199.212550:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575209472:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783444199.325018:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444199.332982:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444199.333109:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557747712 00000100:00100000:0.0:1783444199.333122:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557747712 00000100:00100000:0.0:1783444199.333253:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1068 00000100:00100000:0.0:1783444199.333266:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65241:x1870073557747712:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444199.333298:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444199.333337:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e383193e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a48 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444199.333444:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831945 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444199.333462:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444199.333481:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444199.333573:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444199.333577:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444199.333606:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444199.333636:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e383193e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a48 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444199.333668:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a48 expref: 7 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444199.333679:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96f00) 00010000:00010000:0.0:1783444199.333683:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444199.333687:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05400, rc 0) 00000100:00100000:0.0:1783444199.333760:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65241:x1870073557747712:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 496us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444199.333768:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1068 00000100:00080000:0.0:1783444199.345869:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444199.354629:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444199.355945:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557747840 00000100:00100000:0.0:1783444199.355963:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557747840 00000100:00100000:0.0:1783444199.356046:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1069 00000100:00100000:0.0:1783444199.356059:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65241:x1870073557747840:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1783444199.356115:0:66223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:0.0:1783444199.356987:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65241:x1870073557747840:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 923us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444199.357001:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1069 00000100:00100000:3.0:1783444199.366709:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444199.374298:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557747968 00000100:00100000:1.0:1783444199.374314:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557747968 00000100:00100000:1.0:1783444199.374410:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1070 00000100:00100000:1.0:1783444199.374423:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65241:x1870073557747968:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1783444199.374465:0:67017:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444199.374572:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65241:x1870073557747968:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 152us (7875us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.374579:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1070 00000100:00080000:0.0:1783444199.375620:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444199.380710:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444199.380888:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557748096 00000100:00100000:2.0:1783444199.380902:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557748096 00000100:00100000:2.0:1783444199.380960:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5852 00000100:00100000:2.0:1783444199.380972:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2400:x1870073557748096:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:2.0:1783444199.381021:0:26199:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp t0 exp 0000000000000000 cur 3190 last 0 00000020:00000080:2.0:1783444199.381068:0:26199:0:(genops.c:1406:class_connect()) connect: client 778015c5-4969-44f5-82a5-0f6eadd152d5, cookie 0x42cb6883e383194c 00002000:00100000:2.0:1783444199.381085:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 778015c5-4969-44f5-82a5-0f6eadd152d5/ffff9368c92d7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783444199.381100:0:26199:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783444199.381215:0:26199:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783444199.381255:0:26199:0:(import.c:65:import_set_state_nolock()) ffff9368c92d0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444199.381414:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557748096:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 441us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444199.381423:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5852 00000100:00100000:3.0:1783444199.386745:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444199.388472:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557748224 00000100:00100000:1.0:1783444199.388491:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557748224 00000100:00100000:1.0:1783444199.388608:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1780 00000100:00100000:1.0:1783444199.388621:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65241:x1870073557748224:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:1.0:1783444199.388670:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783444199.388818:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444199.397297:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65241:x1870073557748224:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 8658us (10547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.397340:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1780 00000100:00100000:3.0:1783444199.405871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444199.414124:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557748352 00000100:00100000:2.0:1783444199.414148:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557748352 00000100:00100000:2.0:1783444199.414316:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5853 00000100:00100000:2.0:1783444199.414328:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2400:x1870073557748352:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:2.0:1783444199.414379:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp t0 exp 0000000000000000 cur 3190 last 0 00000020:00000080:2.0:1783444199.414445:0:26209:0:(genops.c:1406:class_connect()) connect: client 778015c5-4969-44f5-82a5-0f6eadd152d5, cookie 0x42cb6883e3831953 00002000:00100000:2.0:1783444199.414460:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 778015c5-4969-44f5-82a5-0f6eadd152d5/ffff9368dd11c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783444199.414476:0:26209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783444199.414590:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783444199.414635:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9368dd11f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444199.414750:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557748352:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 422us (8892us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444199.414760:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5853 00000100:00100000:1.0:1783444199.421021:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444199.421136:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557748480 00000100:00100000:3.0:1783444199.421149:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557748480 00000100:00100000:3.0:1783444199.421264:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1781 00000100:00100000:3.0:1783444199.421276:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65241:x1870073557748480:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:3.0:1783444199.421313:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444199.421409:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65241:x1870073557748480:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 135us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444199.421417:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1781 00000100:00080000:1.0:1783444199.422504:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444199.502206:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444199.503201:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557748608 00000100:00100000:2.0:1783444199.503216:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557748608 00000100:00100000:2.0:1783444199.503302:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:2.0:1783444199.503314:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557748608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444199.503542:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557748608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 229us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444199.503552:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:2.0:1783444199.710237:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575209984:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.710244:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575209856:0@lo:400:kworker.0 00000100:00100000:3.0:1783444199.710439:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575209600:0@lo:400:kworker.0 00000100:00100000:0.0:1783444199.711372:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575209728:0@lo:400:kworker.0 00000100:00100000:2.0:1783444199.712619:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444199.712869:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575210496:0@lo:400:kworker.0 00000100:00100000:2.0:1783444199.712916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444199.712956:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575211008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444199.712979:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444199.714266:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575210496 00000100:00100000:2.0:1783444199.714279:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575210496 00000100:00100000:2.0:1783444199.714347:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575211008 00000100:00100000:2.0:1783444199.714351:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575211008 00000100:00100000:2.0:1783444199.714394:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:2.0:1783444199.714404:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575210496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.726631:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444199.726732:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575210368:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.726777:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444199.726820:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575210880:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.726854:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444199.726935:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1783444199.726952:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575211008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444199.726993:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444199.727055:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575211008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (14073us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.727062:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1783444199.727099:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575209984 00000100:00100000:1.0:1783444199.727108:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575209984 00000100:00100000:1.0:1783444199.727175:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575209856 00000100:00100000:1.0:1783444199.727179:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575209856 00000100:00100000:1.0:1783444199.727202:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575210368 00000100:00100000:1.0:1783444199.727205:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575210368 00000100:00100000:1.0:1783444199.727216:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575210880 00000100:00100000:1.0:1783444199.727218:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575210880 00000100:00100000:1.0:1783444199.727231:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1783444199.727237:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575209984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.727297:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575209984:12345-0@lo:400:kworker.0 Request processed in 60us (14686us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.727305:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1783444199.727322:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1783444199.727329:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575209856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.727362:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575209856:12345-0@lo:400:kworker.0 Request processed in 33us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.727369:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1783444199.727380:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1783444199.727385:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575210368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.727413:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575210368:12345-0@lo:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.727419:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1783444199.727430:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1783444199.727436:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575210880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.727463:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575210880:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.727469:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00080000:1.0:1783444199.727494:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444199.727499:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444199.727563:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575209856:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.727576:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575210368:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.727587:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575210880:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.727722:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575211008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444199.727750:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575209984:0@lo:400:kworker.0 00000100:00100000:3.0:1783444199.731615:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444199.731858:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575209600 00000100:00100000:3.0:1783444199.731868:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575209600 00000100:00100000:3.0:1783444199.731919:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783444199.731929:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575209600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444199.732013:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575209600:12345-0@lo:400:kworker.0 Request processed in 75us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444199.732021:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783444199.732176:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444199.732234:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575209728 00000100:00100000:0.0:1783444199.732242:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575209728 00000100:00100000:0.0:1783444199.732310:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1783444199.732322:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575209728:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783444199.732557:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444199.732587:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575210240:0@lo:400:kworker.0 00000100:00100000:3.0:1783444199.732692:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575209600:0@lo:400:kworker.0 00000100:00100000:3.0:1783444199.732702:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575210112:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.736149:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444199.736235:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575210240 00000100:00100000:1.0:1783444199.736244:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575210240 00000100:00100000:3.0:1783444199.736558:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444199.736594:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575210112 00000100:00100000:3.0:1783444199.736598:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575210112 00000100:00100000:3.0:1783444199.736646:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1783444199.736656:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575210112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444199.736717:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575210112:12345-0@lo:400:kworker.0 Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444199.736724:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00080000:3.0:1783444199.736760:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444199.736811:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575210112:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.736919:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:1.0:1783444199.736929:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575210240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.737566:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575210240:12345-0@lo:400:kworker.0 Request processed in 230us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.737578:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:1.0:1783444199.737632:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575210240:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.737645:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575210752:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.737690:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444199.737725:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575210752 00000100:00100000:1.0:1783444199.737730:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575210752 00000100:00100000:1.0:1783444199.737775:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:1.0:1783444199.737782:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575210752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.738132:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575210752:12345-0@lo:400:kworker.0 Request processed in 349us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.738139:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00100000:1.0:1783444199.738183:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575210752:0@lo:400:kworker.0 00000100:00080000:1.0:1783444199.738251:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444199.738392:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575210624:0@lo:400:kworker.0 00000100:00100000:3.0:1783444199.738424:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444199.738898:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575210496:12345-0@lo:400:kworker.0 Request processed in 24485us (25971us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444199.738915:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:1.0:1783444199.739236:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575210624 00000100:00100000:1.0:1783444199.739245:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575210624 00000100:00100000:1.0:1783444199.739362:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262 00000100:00100000:3.0:1783444199.739372:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575210496:0@lo:400:kworker.0 00000100:00100000:1.0:1783444199.739374:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575210624:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783444199.739469:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444199.739593:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575210624:12345-0@lo:400:kworker.0 Request processed in 221us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444199.739602:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262 00000100:00100000:3.0:1783444199.740035:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575210624:0@lo:400:kworker.0 00000100:00100000:0.0:1783444199.740114:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575209728:12345-0@lo:400:kworker.0 Request processed in 7790us (7951us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444199.740126:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1783444199.740218:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575209728:0@lo:400:kworker.0 00000100:00100000:2.0:1783444200.226376:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575211136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444200.226448:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444200.226552:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575211136 00000100:00100000:1.0:1783444200.226562:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575211136 00000100:00100000:1.0:1783444200.226625:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:1.0:1783444200.226636:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575211136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444200.226671:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:1.0:1783444200.226729:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575211136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444200.226736:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1783444200.226770:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575211136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444200.229603:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575211264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444200.229613:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575211392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444200.229677:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444200.229847:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575211264 00000100:00100000:0.0:1783444200.229855:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575211264 00000100:00100000:0.0:1783444200.230517:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782 00000100:00100000:0.0:1783444200.230530:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575211264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444200.230553:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444200.230601:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575211264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444200.230608:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782 00000100:00100000:2.0:1783444200.231382:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444200.231568:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575211392 00000100:00100000:3.0:1783444200.231576:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575211392 00000100:00100000:3.0:1783444200.231649:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1783 00000100:00100000:3.0:1783444200.231663:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575211392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444200.231684:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444200.231734:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575211392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444200.231741:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1783 00000100:00100000:1.0:1783444200.240551:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575211264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444200.248957:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575211392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783444200.350248:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783444200.748162:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:0.0:1783444200.748179:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969447 is committed 00000001:00100000:0.0:1783444200.749305:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00010000:00010000:2.0:1783444201.373074:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444202.397005:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444203.421006:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444204.317505:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575211520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444204.317571:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444204.317628:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575211520 00000100:00100000:2.0:1783444204.317635:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575211520 00000100:00100000:2.0:1783444204.317684:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:2.0:1783444204.317692:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575211520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444204.317719:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444204.317756:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575211520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444204.317763:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00080000:2.0:1783444204.317780:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444204.317847:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575211520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444204.318013:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575211648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444204.318040:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.318107:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575211648 00000100:00100000:1.0:1783444204.318112:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575211648 00000100:00100000:1.0:1783444204.318146:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1783444204.318152:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575211648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444204.318168:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444204.318202:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575211648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.318208:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1783444204.318241:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575211648:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783444204.318779:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783444204.445007:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444204.628188:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444204.628319:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557748736 00000100:00100000:0.0:1783444204.628336:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557748736 00000100:00100000:0.0:1783444204.628420:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:0.0:1783444204.628432:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557748736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444204.628728:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557748736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 297us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444204.628738:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:1.0:1783444204.637166:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444204.637308:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557748864 00000100:00100000:0.0:1783444204.637319:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557748864 00000100:00100000:0.0:1783444204.637396:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 796 00000100:00100000:0.0:1783444204.637406:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557748864:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444204.637494:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557748864:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444204.637501:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 796 00000100:00080000:2.0:1783444204.637610:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444204.638447:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444204.638494:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444204.638531:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444204.638601:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557749120 00000100:00100000:1.0:1783444204.638608:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557749120 00000100:00100000:1.0:1783444204.638653:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557749248 00000100:00100000:1.0:1783444204.638656:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557749248 00000100:00100000:1.0:1783444204.638677:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2263 00000100:00100000:1.0:1783444204.638685:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557749120:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444204.638742:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557749120:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.638750:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2263 00000100:00100000:1.0:1783444204.638766:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2264 00000100:00100000:1.0:1783444204.638772:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557749248:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444204.638814:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557749248:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.638820:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2264 00000100:00100000:3.0:1783444204.639177:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557748992 00000100:00100000:3.0:1783444204.639182:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557748992 00000100:00100000:3.0:1783444204.639224:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 797 00000100:00100000:3.0:1783444204.639233:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557748992:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444204.639270:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557748992:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444204.639277:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 797 00000100:00080000:2.0:1783444204.639477:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444204.639482:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444204.639485:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1783444204.766386:0:85704:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:1.0:1783444204.829456:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575211776:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829551:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829592:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575212288:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829620:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829638:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575212800:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829682:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783444204.829689:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575211904:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829711:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829745:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575212416:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829771:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829803:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575212928:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829825:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829852:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575212160:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829874:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829889:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575212672:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829925:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783444204.829931:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575212032:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829952:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.829968:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575212544:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.829988:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.830004:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575213056:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.830062:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575212288 00000100:00100000:1.0:1783444204.830081:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575212288 00000100:00100000:1.0:1783444204.830128:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575211904 00000100:00100000:1.0:1783444204.830132:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575211904 00000100:00100000:1.0:1783444204.830151:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575212160 00000100:00100000:1.0:1783444204.830154:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575212160 00000100:00100000:1.0:1783444204.830165:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575212032 00000100:00100000:1.0:1783444204.830167:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575212032 00000100:00100000:1.0:1783444204.830180:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575212544 00000100:00100000:1.0:1783444204.830182:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575212544 00000100:00100000:1.0:1783444204.830191:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575213056 00000100:00100000:1.0:1783444204.830194:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575213056 00000100:00100000:1.0:1783444204.830208:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1783444204.830223:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575212288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830278:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575212288:12345-0@lo:400:kworker.0 Request processed in 56us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830284:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1783444204.830302:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1783444204.830309:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575211904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830335:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575211904:12345-0@lo:400:kworker.0 Request processed in 27us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830341:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1783444204.830350:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1783444204.830356:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575212160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830382:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575212160:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830387:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1783444204.830399:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1783444204.830404:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575212032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830428:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575212032:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830433:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1783444204.830443:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1783444204.830449:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575212544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830471:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575212544:12345-0@lo:400:kworker.0 Request processed in 23us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830477:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1783444204.830487:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1783444204.830501:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575213056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830532:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575213056:12345-0@lo:400:kworker.0 Request processed in 33us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830537:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1783444204.830560:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575212800 00000100:00100000:1.0:1783444204.830563:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575212800 00000100:00100000:1.0:1783444204.830586:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575212928 00000100:00100000:1.0:1783444204.830588:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575212928 00000100:00100000:1.0:1783444204.830607:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:1.0:1783444204.830613:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575212800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830642:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575212800:12345-0@lo:400:kworker.0 Request processed in 29us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830647:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:1.0:1783444204.830658:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266 00000100:00100000:1.0:1783444204.830664:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575212928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830688:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575212928:12345-0@lo:400:kworker.0 Request processed in 25us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830694:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266 00000100:00100000:1.0:1783444204.830709:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575212416 00000100:00100000:1.0:1783444204.830713:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575212416 00000100:00100000:1.0:1783444204.830734:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575212672 00000100:00100000:1.0:1783444204.830737:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575212672 00000100:00100000:1.0:1783444204.830752:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:1.0:1783444204.830756:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575212416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830819:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575212416:12345-0@lo:400:kworker.0 Request processed in 62us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830825:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:1.0:1783444204.830846:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1783444204.830851:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575212672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.830881:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575212672:12345-0@lo:400:kworker.0 Request processed in 30us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.830887:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1783444204.831012:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575212032:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831023:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575212544:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831031:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575213056:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831041:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575212160:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831049:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575212672:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831112:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575211904:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831122:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575212416:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831130:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575212928:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831139:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575212288:0@lo:400:kworker.0 00000100:00100000:1.0:1783444204.831148:0:3635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969447 gen 2 00000100:00100000:1.0:1783444204.831157:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575212800:0@lo:400:kworker.0 00000100:00080000:0.0:1783444204.833060:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444204.833079:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444204.833083:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444204.833086:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444204.833245:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575211776 00000100:00100000:0.0:1783444204.833255:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575211776 00000100:00100000:0.0:1783444204.833425:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783444204.833436:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575211776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444204.833649:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575211776:12345-0@lo:400:kworker.0 Request processed in 215us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444204.833657:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783444204.833746:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575211776:0@lo:400:kworker.0 00000100:00100000:3.0:1783444204.835590:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444204.840948:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575213184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444204.841103:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444204.841301:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575213184 00000100:00100000:1.0:1783444204.841310:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575213184 00000100:00100000:1.0:1783444204.841383:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:1.0:1783444204.841392:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575213184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444204.841429:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444204.841496:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575213184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444204.841504:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:3.0:1783444204.841753:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575213184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444205.341688:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575213312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444205.341765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444205.341820:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575213440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444205.341916:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444205.341931:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575213568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444205.341997:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575213312 00000100:00100000:2.0:1783444205.342005:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575213312 00000100:00100000:2.0:1783444205.342052:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:2.0:1783444205.342073:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575213312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444205.342100:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444205.344964:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444205.345089:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575213440 00000100:00100000:3.0:1783444205.345097:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575213440 00000100:00100000:3.0:1783444205.345225:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:3.0:1783444205.345235:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575213440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444205.345265:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444205.345319:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575213440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444205.345325:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:3.0:1783444205.345379:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575213440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444205.345619:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444205.353253:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575213568 00000100:00100000:3.0:1783444205.353270:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575213568 00000100:00100000:3.0:1783444205.353359:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:3.0:1783444205.353370:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575213568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444205.353410:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:3.0:1783444205.353495:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575213568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (7876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444205.353502:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:1.0:1783444205.353672:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575213568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444205.359325:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575213312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17242us (17549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444205.359340:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1783444205.361481:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575213312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783444205.469009:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444206.495070:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783444206.828312:0:85752:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1783444207.518599:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444208.540974:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444208.634516:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444208.636783:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557749376 00000100:00100000:1.0:1783444208.636814:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557749376 00000100:00100000:1.0:1783444208.636932:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1071 00000100:00100000:1.0:1783444208.636947:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65718:x1870073557749376:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1783444208.637007:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:1.0:1783444208.637111:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65718:x1870073557749376:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 169us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444208.637119:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1071 00000100:00080000:0.0:1783444208.637338:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444208.642950:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444208.643362:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557749504 00000100:00100000:1.0:1783444208.643374:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557749504 00000100:00100000:1.0:1783444208.643510:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1072 00000100:00100000:1.0:1783444208.643522:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65718:x1870073557749504:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1783444208.643575:0:66223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444208.643663:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:65718:x1870073557749504:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 143us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444208.643671:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1072 00000100:00080000:0.0:1783444208.647489:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444208.648501:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444208.648576:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557749632 00000100:00100000:2.0:1783444208.648587:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557749632 00000100:00100000:2.0:1783444208.648671:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1788 00000100:00100000:2.0:1783444208.648682:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:65718:x1870073557749632:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444208.648717:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783444208.649434:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444208.649639:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:65718:x1870073557749632:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 953us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444208.649668:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1788 00000100:00100000:3.0:1783444208.655271:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444208.664289:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557749760 00000100:00100000:2.0:1783444208.664304:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557749760 00000100:00100000:2.0:1783444208.664454:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1789 00000100:00100000:2.0:1783444208.664468:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:65718:x1870073557749760:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444208.664513:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444208.664613:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:65718:x1870073557749760:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 149us (9352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444208.664740:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1789 00000100:00080000:0.0:1783444208.664988:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444208.710724:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444208.712146:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557750016 00000100:00100000:0.0:1783444208.712161:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557750016 00000100:00100000:0.0:1783444208.712238:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1073 00000100:00100000:0.0:1783444208.712248:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65735:x1870073557750016:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444208.712269:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444208.712289:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e383195a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a4f expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.712366:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.712381:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.712392:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.712408:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.712415:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.712421:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.714535:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715110:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715118:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715124:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715131:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444208.715136:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715145:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715163:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96f00) 00010000:00010000:0.0:1783444208.715166:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444208.715171:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715178:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831961 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715195:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715201:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715221:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715226:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444208.715228:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715234:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715241:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9367c709eb00) 00010000:00010000:0.0:1783444208.715243:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444208.715246:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715251:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831968 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715299:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e383195a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a4f expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715308:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96f00) 00010000:00010000:0.0:1783444208.715311:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783444208.715314:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e383195a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a4f expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444208.715322:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05a00, rc 0) 00000100:00100000:0.0:1783444208.715467:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65735:x1870073557750016:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3220us (4751us total) trans 0 rc 301/301 00000100:00100000:0.0:1783444208.715497:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1073 00000100:00100000:1.0:1783444208.727367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444208.727624:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557750144 00000100:00100000:2.0:1783444208.727634:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557750144 00000100:00100000:2.0:1783444208.727732:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1074 00000100:00100000:2.0:1783444208.727743:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65735:x1870073557750144:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1783444208.727858:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.727875:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.727887:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.727902:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.727909:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.727935:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728048:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728057:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728064:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444208.728106:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444208.728131:0:71469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728148:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728155:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728162:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728169:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728175:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444208.728179:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728198:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728212:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96f00) 00010000:00010000:2.0:1783444208.728215:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444208.728220:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728227:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030a00/0x42cb6883e383196f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728244:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728251:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728257:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728262:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444208.728265:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728271:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728278:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9368cdf77700) 00010000:00010000:2.0:1783444208.728281:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444208.728284:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728299:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831976 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728315:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728321:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728326:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728331:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444208.728334:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728339:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728346:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff9368cdf77900) 00010000:00010000:2.0:1783444208.728348:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444208.728351:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444208.728357:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383197d lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444208.728441:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:65735:x1870073557750144:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 698us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444208.728450:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1074 00000100:00100000:1.0:1783444209.437731:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575213696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444209.437913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444209.437990:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575213696 00000100:00100000:3.0:1783444209.437999:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575213696 00000100:00100000:3.0:1783444209.438069:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:3.0:1783444209.438079:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575213696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444209.438101:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444209.438149:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575213696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444209.438156:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 00000100:00100000:1.0:1783444209.438318:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575213696:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783444209.438340:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444209.439336:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575213824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444209.439381:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444209.439719:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575213824 00000100:00100000:1.0:1783444209.439726:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575213824 00000100:00100000:1.0:1783444209.439876:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791 00000100:00100000:1.0:1783444209.439886:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575213824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444209.439902:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444209.439964:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575213824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444209.439972:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791 00000100:00080000:0.0:1783444209.440030:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444209.440040:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575213824:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783444209.565069:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444209.742134:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444209.742186:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444209.742209:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557750272 00000100:00100000:2.0:1783444209.742220:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557750272 00000100:00100000:0.0:1783444209.742230:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444209.742260:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444209.742282:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1783444209.742285:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557750400 00000100:00100000:3.0:1783444209.742290:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557750400 00000100:00100000:2.0:1783444209.742296:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557750272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444209.742297:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444209.742322:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557750528 00000100:00100000:3.0:1783444209.742325:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557750528 00000100:00100000:0.0:1783444209.742339:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557750784 00000100:00100000:0.0:1783444209.742345:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557750784 00000100:00100000:3.0:1783444209.742348:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 804 00000100:00100000:3.0:1783444209.742355:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557750400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444209.742376:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557750272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444209.742385:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1783444209.742389:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557750400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 34us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444209.742396:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 804 00000100:00100000:0.0:1783444209.742399:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557750656 00000100:00100000:0.0:1783444209.742404:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557750656 00000100:00100000:3.0:1783444209.742412:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 805 00000100:00100000:3.0:1783444209.742421:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557750528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444209.742423:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2267 00000100:00100000:2.0:1783444209.742430:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557750784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444209.742435:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2268 00000100:00100000:3.0:1783444209.742446:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557750528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444209.742449:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557750656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444209.742458:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557750784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444209.742471:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 805 00000100:00100000:2.0:1783444209.742477:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2267 00000100:00100000:0.0:1783444209.742492:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557750656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 46us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444209.742502:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2268 00000100:00100000:1.0:1783444209.950021:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575214208:0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.950074:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575213952:0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.950122:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444209.950169:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575214720:0@lo:400:kworker.0 00000100:00100000:3.0:1783444209.950294:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575214336:0@lo:400:kworker.0 00000100:00100000:2.0:1783444209.950751:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575214208 00000100:00100000:2.0:1783444209.950760:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575214208 00000100:00100000:2.0:1783444209.950860:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1783444209.950872:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575214208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.955574:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444209.956015:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575213952 00000100:00100000:0.0:1783444209.956028:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575213952 00000100:00100000:0.0:1783444209.956197:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783444209.956211:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575213952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.956302:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575213952:12345-0@lo:400:kworker.0 Request processed in 94us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444209.956310:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783444209.956370:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575214080:0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.956439:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444209.957987:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575214080 00000100:00100000:3.0:1783444209.958004:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575214080 00000100:00100000:1.0:1783444209.958021:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444209.958057:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575214720 00000100:00100000:3.0:1783444209.958061:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575214720 00000100:00100000:1.0:1783444209.958076:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575215232:0@lo:400:kworker.0 00000100:00100000:3.0:1783444209.958084:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1783444209.958093:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575214080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958128:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444209.958148:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575214080:12345-0@lo:400:kworker.0 Request processed in 56us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444209.958155:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1783444209.958165:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575215232 00000100:00100000:1.0:1783444209.958170:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575215232 00000100:00100000:3.0:1783444209.958171:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1783444209.958176:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575214720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958189:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1783444209.958195:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575215232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958225:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575215232:12345-0@lo:400:kworker.0 Request processed in 29us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444209.958231:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1783444209.958279:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575214720:0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958310:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575215232:0@lo:400:kworker.0 00000100:00080000:1.0:1783444209.958366:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783444209.958372:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444209.958402:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575213952:0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958411:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575214464:0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444209.958456:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575214464 00000100:00100000:1.0:1783444209.958459:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575214464 00000100:00100000:1.0:1783444209.958485:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1783444209.958491:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575214464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958538:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575214464:12345-0@lo:400:kworker.0 Request processed in 47us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444209.958544:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00080000:1.0:1783444209.958561:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444209.958577:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575214464:0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958584:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575214976:0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958625:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444209.958654:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575214976 00000100:00100000:1.0:1783444209.958658:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575214976 00000100:00100000:1.0:1783444209.958696:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269 00000100:00100000:1.0:1783444209.958702:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575214976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958737:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575214976:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444209.958743:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269 00000100:00080000:1.0:1783444209.958759:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444209.958786:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575214976:0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.958838:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444209.958846:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575215360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444209.958881:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444209.958908:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575215360 00000100:00100000:1.0:1783444209.958912:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575215360 00000100:00100000:1.0:1783444209.958942:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:1.0:1783444209.958949:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575215360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444209.958992:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444209.959028:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575215360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444209.959035:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:1.0:1783444209.959071:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575215360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444209.960115:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575214080:0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.960129:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575214592:0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.960187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444209.960213:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575215104:0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.960238:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444209.960300:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575215104 00000100:00100000:0.0:1783444209.960305:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575215104 00000100:00100000:2.0:1783444209.960319:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575214208:12345-0@lo:400:kworker.0 Request processed in 9446us (10194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444209.960333:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1783444209.960355:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270 00000100:00100000:0.0:1783444209.960364:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575215104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.960412:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575215104:12345-0@lo:400:kworker.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444209.960418:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270 00000100:00100000:0.0:1783444209.960450:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575215104:0@lo:400:kworker.0 00000100:00100000:3.0:1783444209.960941:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575214720:12345-0@lo:400:kworker.0 Request processed in 2762us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444209.960952:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1783444209.961020:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444209.961056:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e79dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575214848:0@lo:400:kworker.0 00000100:00100000:3.0:1783444209.961085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444209.961111:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575214592 00000100:00100000:3.0:1783444209.961115:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575214592 00000100:00100000:0.0:1783444209.961115:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575214336 00000100:00100000:0.0:1783444209.961118:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575214336 00000100:00100000:3.0:1783444209.961142:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575214848 00000100:00100000:0.0:1783444209.961144:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:3.0:1783444209.961145:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575214848 00000100:00100000:0.0:1783444209.961151:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575214336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444209.961164:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:3.0:1783444209.961170:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575214592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444209.961191:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575214336:12345-0@lo:400:kworker.0 Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444209.961198:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:3.0:1783444209.961205:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575214592:12345-0@lo:400:kworker.0 Request processed in 36us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444209.961227:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575214592:0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.961449:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:1.0:1783444209.961459:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575214848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444209.961502:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575214848:12345-0@lo:400:kworker.0 Request processed in 46us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444209.961509:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00080000:1.0:1783444209.961669:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783444209.961675:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444209.961703:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575214208:0@lo:400:kworker.0 00000100:00100000:3.0:1783444209.963418:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00100000:3.0:1783444209.963503:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e79dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575214848:0@lo:400:kworker.0 00000100:00100000:3.0:1783444209.963540:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575214336:0@lo:400:kworker.0 00000100:00100000:3.0:1783444210.461203:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444210.461229:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575215488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444210.461317:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444210.461412:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575215488 00000100:00100000:1.0:1783444210.461422:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575215488 00000100:00100000:1.0:1783444210.461483:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:1.0:1783444210.461495:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575215488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444210.461539:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:1.0:1783444210.461609:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575215488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444210.461616:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:1.0:1783444210.461663:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575215488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444210.463155:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575215616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444210.463216:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444210.463261:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575215616 00000100:00100000:3.0:1783444210.463268:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575215616 00000100:00100000:3.0:1783444210.463312:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:3.0:1783444210.463321:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575215616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444210.463353:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444210.463396:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575215616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444210.463402:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:3.0:1783444210.463449:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575215616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444210.464067:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444210.464079:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575215744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444210.464119:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444210.464154:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575215744 00000100:00100000:1.0:1783444210.464159:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575215744 00000100:00100000:1.0:1783444210.464191:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:1.0:1783444210.464198:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fa01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575215744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444210.464218:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444210.464254:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fa01a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575215744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444210.464260:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:1.0:1783444210.464477:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575215744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783444210.589699:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444211.621595:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444212.637048:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444213.662124:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444214.557153:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444214.557181:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575215872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444214.557273:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444214.557400:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575215872 00000100:00100000:3.0:1783444214.557408:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575215872 00000100:00100000:3.0:1783444214.557486:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:3.0:1783444214.557497:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575215872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444214.557533:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444214.557583:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575215872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444214.557597:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00100000:0.0:1783444214.557829:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575215872:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783444214.557960:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444214.558749:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575216000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444214.558816:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444214.559074:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575216000 00000100:00100000:1.0:1783444214.559081:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575216000 00000100:00100000:1.0:1783444214.559180:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:1.0:1783444214.559191:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575216000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444214.559226:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444214.559278:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575216000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444214.559285:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:0.0:1783444214.559510:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575216000:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783444214.559730:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783444214.696623:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444214.860237:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444214.860284:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444214.860322:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444214.860356:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444214.860401:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444214.860438:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557751168 00000100:00100000:1.0:1783444214.860448:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557751168 00000100:00100000:1.0:1783444214.860514:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557751040 00000100:00100000:1.0:1783444214.860517:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557751040 00000100:00100000:1.0:1783444214.860545:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 812 00000100:00100000:1.0:1783444214.860556:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557751168:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444214.860631:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557751168:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 78us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444214.860640:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 812 00000100:00100000:1.0:1783444214.860658:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 813 00000100:00100000:1.0:1783444214.860664:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557751040:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444214.860689:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557751040:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444214.860696:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 813 00000100:00100000:1.0:1783444214.860714:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557751424 00000100:00100000:1.0:1783444214.860718:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557751424 00000100:00100000:1.0:1783444214.860744:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557751296 00000100:00100000:1.0:1783444214.860747:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557751296 00000100:00100000:1.0:1783444214.860767:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2271 00000100:00100000:1.0:1783444214.860773:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557751424:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444214.860822:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557751424:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 49us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444214.860854:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2271 00000100:00100000:1.0:1783444214.860867:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2272 00000100:00100000:1.0:1783444214.860886:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557751296:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444214.860913:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557751296:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 40us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444214.860919:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2272 00000100:00100000:0.0:1783444214.860977:0:85128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557750912 00000100:00100000:0.0:1783444214.860983:0:85128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557750912 00000100:00100000:0.0:1783444214.861034:0:85128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:0.0:1783444214.861042:0:85128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557750912:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444214.861076:0:85128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557750912:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 30us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444214.861084:0:85128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00080000:2.0:1783444214.861690:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444214.861697:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444214.861710:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444214.861712:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444215.069493:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575216384:0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.069568:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.069600:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575216896:0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.069627:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.069643:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575217408:0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.069663:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.069689:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783444215.069696:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575216512:0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.069718:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.069733:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575217024:0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.069756:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.069771:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575217536:0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.069821:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.069947:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575216896 00000100:00100000:1.0:1783444215.069954:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575216896 00000100:00100000:1.0:1783444215.070002:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575217408 00000100:00100000:1.0:1783444215.070004:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575217408 00000100:00100000:1.0:1783444215.070027:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:1.0:1783444215.070048:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575216896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.070106:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575216896:12345-0@lo:400:kworker.0 Request processed in 58us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444215.070113:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:1.0:1783444215.070132:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1783444215.070138:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575217408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.070168:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7f83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575217408:12345-0@lo:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444215.070174:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1783444215.070219:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575216896:0@lo:400:kworker.0 00000100:00100000:1.0:1783444215.070230:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575217408:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072088:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575216128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444215.072154:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444215.072188:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575216640:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072210:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444215.072226:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575217152:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072243:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444215.072258:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575217664:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072277:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444215.072300:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1783444215.072307:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575216256:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072334:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444215.072361:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575216768:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072380:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444215.072415:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575217280:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072439:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444215.072458:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575217792:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072476:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444215.072516:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575216384 00000100:00100000:0.0:1783444215.072524:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575216384 00000100:00100000:0.0:1783444215.072571:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575216512 00000100:00100000:0.0:1783444215.072574:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575216512 00000100:00100000:0.0:1783444215.072588:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575216640 00000100:00100000:0.0:1783444215.072590:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575216640 00000100:00100000:0.0:1783444215.072603:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575216768 00000100:00100000:0.0:1783444215.072606:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575216768 00000100:00100000:0.0:1783444215.072617:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575217280 00000100:00100000:0.0:1783444215.072620:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575217280 00000100:00100000:0.0:1783444215.072630:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575217792 00000100:00100000:0.0:1783444215.072633:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575217792 00000100:00100000:0.0:1783444215.072648:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1783444215.072656:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575216384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072708:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575216384:12345-0@lo:400:kworker.0 Request processed in 52us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.072716:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1783444215.072734:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1783444215.072741:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575216512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072771:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575216512:12345-0@lo:400:kworker.0 Request processed in 31us (3052us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.072777:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1783444215.072813:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1783444215.072820:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575216640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.072950:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575216640:12345-0@lo:400:kworker.0 Request processed in 131us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.072957:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1783444215.072970:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1783444215.072976:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575216768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073001:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575216768:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073006:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1783444215.073017:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1783444215.073022:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575217280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073048:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575217280:12345-0@lo:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073053:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1783444215.073067:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1783444215.073072:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575217792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073098:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575217792:12345-0@lo:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073104:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1783444215.073125:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575216128 00000100:00100000:0.0:1783444215.073129:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575216128 00000100:00100000:0.0:1783444215.073151:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:0.0:1783444215.073157:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575216128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444215.073188:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:0.0:1783444215.073218:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575216128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073234:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:0.0:1783444215.073263:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575217024 00000100:00100000:0.0:1783444215.073267:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575217024 00000100:00100000:0.0:1783444215.073288:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575217536 00000100:00100000:0.0:1783444215.073291:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575217536 00000100:00100000:0.0:1783444215.073310:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575217152 00000100:00100000:0.0:1783444215.073313:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575217152 00000100:00100000:0.0:1783444215.073330:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575217664 00000100:00100000:0.0:1783444215.073333:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575217664 00000100:00100000:0.0:1783444215.073353:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1783444215.073360:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575217024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073394:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575217024:12345-0@lo:400:kworker.0 Request processed in 34us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073400:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1783444215.073410:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:0.0:1783444215.073416:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575217536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073443:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575217536:12345-0@lo:400:kworker.0 Request processed in 27us (3621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073449:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00100000:0.0:1783444215.073460:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275 00000100:00100000:0.0:1783444215.073465:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575217152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073491:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575217152:12345-0@lo:400:kworker.0 Request processed in 26us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073497:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275 00000100:00100000:0.0:1783444215.073506:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:0.0:1783444215.073512:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575217664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073549:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575217664:12345-0@lo:400:kworker.0 Request processed in 37us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073556:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:0.0:1783444215.073586:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575216256 00000100:00100000:0.0:1783444215.073590:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575216256 00000100:00100000:0.0:1783444215.073614:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783444215.073620:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575216256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073649:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575216256:12345-0@lo:400:kworker.0 Request processed in 29us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444215.073655:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1783444215.073684:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444215.073689:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444215.073692:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444215.073693:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444215.073749:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575216512:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073764:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575217024:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073775:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575217536:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.073810:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575216384:0@lo:400:kworker.0 00000100:00100000:3.0:1783444215.074092:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575216256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444215.074107:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575216768:0@lo:400:kworker.0 00000100:00100000:3.0:1783444215.074119:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd10b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575217280:0@lo:400:kworker.0 00000100:00100000:3.0:1783444215.074136:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575217792:0@lo:400:kworker.0 00000100:00100000:3.0:1783444215.074153:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575216128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444215.074164:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575216640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444215.074173:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575217152:0@lo:400:kworker.0 00000100:00100000:3.0:1783444215.074183:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575217664:0@lo:400:kworker.0 00000100:00100000:0.0:1783444215.581066:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575217920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444215.581136:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.581212:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575217920 00000100:00100000:1.0:1783444215.581223:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575217920 00000100:00100000:1.0:1783444215.581276:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1783444215.581286:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575217920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444215.581309:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444215.586583:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575217920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5287us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444215.586597:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1783444215.586746:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575218176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444215.586829:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.589840:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575218176 00000100:00100000:1.0:1783444215.589879:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575218176 00000100:00100000:1.0:1783444215.589969:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:1.0:1783444215.589979:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575218176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444215.590027:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444215.590785:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575218176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 803us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444215.590821:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00100000:1.0:1783444215.590914:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575218176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444215.592052:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575218048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444215.592117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444215.592507:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575218048 00000100:00100000:1.0:1783444215.592514:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575218048 00000100:00100000:1.0:1783444215.592571:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:1.0:1783444215.592581:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575218048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444215.592617:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444843520 avail 1298604032 00000100:00100000:1.0:1783444215.592668:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575218048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444215.592676:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:1.0:1783444215.592745:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575218048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444215.595065:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575217920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783444215.710081:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783444215.717997:0:85948:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 13:10:15 (1783444215) 00000100:00100000:2.0:1783444215.812310:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444215.812400:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557751552 00000100:00100000:3.0:1783444215.812411:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557751552 00000100:00100000:3.0:1783444215.812474:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1075 00000100:00100000:3.0:1783444215.812485:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66323:x1870073557751552:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444215.812505:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444215.812525:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a56 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812594:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812609:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812632:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812648:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812654:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812661:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812707:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812714:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812719:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812725:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812730:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1aa00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444215.812734:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812741:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812753:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96f00) 00010000:00010000:3.0:1783444215.812762:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444215.812768:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812774:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383198b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812823:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812839:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812845:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812850:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1bc00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444215.812854:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812868:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812879:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9368c3220200) 00010000:00010000:3.0:1783444215.812882:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444215.812885:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812890:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831992 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812919:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831984 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a56 expref: 8 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812935:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96f00) 00010000:00010000:3.0:1783444215.812938:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444215.812942:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a56 expref: 8 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444215.812950:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1be00, rc 0) 00000100:00100000:3.0:1783444215.813090:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66323:x1870073557751552:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 606us (791us total) trans 0 rc 301/301 00000100:00100000:3.0:1783444215.813098:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1075 00000100:00100000:0.0:1783444215.821258:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444215.821389:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557751808 00000100:00100000:1.0:1783444215.821400:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557751808 00000100:00100000:1.0:1783444215.821461:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1076 00000100:00100000:1.0:1783444215.821473:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66323:x1870073557751808:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:1.0:1783444215.821531:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444215.821560:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831945 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a48 expref: 7 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.821577:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96f00) 00010000:00010000:1.0:1783444215.821588:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444215.821651:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.821669:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.821679:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.821693:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.821698:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.821704:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824014:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824037:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824049:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444215.824068:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033545e64 reply state 000000000187f021 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824079:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824087:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368dccaef00) 00010000:00010000:1.0:1783444215.824095:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444215.824100:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783444215.824105:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783444215.824117:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824123:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824128:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824135:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824140:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444215.824144:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824151:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824162:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368d4c9ab00) 00010000:00010000:1.0:1783444215.824165:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444215.824168:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824174:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71000/0x42cb6883e3831999 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444215.824192:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033545e64 reply state 000000000187f021 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824213:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.824220:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9368d4c9ae00) 00010000:00010000:1.0:1783444215.824222:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444215.824225:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783444215.824317:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:66323:x1870073557751808:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 2843us (3064us total) trans 103079215105 rc 0/0 00000100:00100000:1.0:1783444215.824325:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1076 00000100:00100000:1.0:1783444215.846549:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444215.846968:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557751936 00000100:00100000:2.0:1783444215.846979:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557751936 00000100:00100000:2.0:1783444215.847036:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1077 00000100:00100000:2.0:1783444215.847045:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:66324:x1870073557751936:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444215.847071:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444215.847094:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e38319ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a5d expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.847158:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e38319b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.847171:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e38319b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.847182:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e38319b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444215.847232:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444215.847236:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444215.847254:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e38319b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.847277:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e38319ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a5d expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.847316:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e38319b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a5d expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.847325:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368cdf77700) 00010000:00010000:2.0:1783444215.847328:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444215.847332:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031a00, rc 0) 00000100:00100000:2.0:1783444215.847403:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+9:66324:x1870073557751936:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 358us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444215.847410:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1077 00000100:00100000:3.0:1783444215.849540:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444215.849700:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557752064 00000100:00100000:1.0:1783444215.849709:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557752064 00000100:00100000:1.0:1783444215.849765:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1078 00000100:00100000:1.0:1783444215.849775:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:66324:x1870073557752064:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444215.849830:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444215.849866:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70800/0x42cb6883e38319bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a64 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.849931:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.849945:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.849956:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.849967:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.849988:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.849996:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850072:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e38319d1 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850082:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e38319d1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850088:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e38319d1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444215.850123:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783444215.850127:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444215.850145:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e38319d1 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850158:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850165:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850171:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850179:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850195:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444215.850200:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850208:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850220:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368cdf77700) 00010000:00010000:1.0:1783444215.850224:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444215.850228:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850235:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e38319c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850250:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850256:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850262:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850267:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444215.850269:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850275:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850295:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9368d4c9ae00) 00010000:00010000:1.0:1783444215.850297:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444215.850300:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850306:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38319ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850333:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70800/0x42cb6883e38319bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a64 expref: 11 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850345:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e38319d1 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a64 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444215.850353:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368dccaef00) 00010000:00010000:1.0:1783444215.850355:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444215.850357:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71c00, rc 0) 00000100:00100000:1.0:1783444215.850417:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:66324:x1870073557752064:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 643us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444215.850424:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1078 00000100:00100000:1.0:1783444215.856308:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444215.856387:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557752320 00000100:00100000:2.0:1783444215.856398:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557752320 00000100:00100000:2.0:1783444215.856459:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1079 00000100:00100000:2.0:1783444215.856469:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+10:66324:x1870073557752320:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444215.856490:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444215.856513:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e38319d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a6b expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444215.856611:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783444215.856715:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e38319d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a6b expref: 12 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.856730:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368cdf77700) 00010000:00010000:2.0:1783444215.856733:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783444215.856739:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e38319d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a6b expref: 12 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.856766:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030200, rc 0) 00000100:00100000:2.0:1783444215.857964:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+11:66324:x1870073557752320:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1489us (1658us total) trans 103079215106 rc 301/301 00000100:00100000:2.0:1783444215.857976:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1079 00000100:00100000:1.0:1783444215.865080:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444215.866126:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557752576 00000100:00100000:2.0:1783444215.866137:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557752576 00000100:00100000:2.0:1783444215.866204:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1080 00000100:00100000:2.0:1783444215.866215:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+11:66324:x1870073557752576:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:2.0:1783444215.866274:0:66225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444215.866302:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e38319d1 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a64 expref: 11 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.866320:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368dccaef00) 00010000:00010000:2.0:1783444215.866325:0:66225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444215.866348:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.866361:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.866371:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444215.866550:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038a95b84 reply state 00000000b5065b4b transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.866563:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444215.866576:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368dccaef00) 00010000:00010000:2.0:1783444215.866580:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1783444215.866582:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783444215.866590:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000100:00100000:2.0:1783444215.866673:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+12:66324:x1870073557752576:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 459us (1599us total) trans 103079215107 rc 0/0 00000100:00100000:2.0:1783444215.866681:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1080 00000100:00100000:2.0:1783444215.871720:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444215.872023:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557752832 00000100:00100000:0.0:1783444215.872032:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557752832 00000100:00100000:0.0:1783444215.872088:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:0.0:1783444215.872097:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+12:66324:x1870073557752832:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1783444215.872334:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+13:66324:x1870073557752832:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 236us (621us total) trans 103079215108 rc 0/0 00000100:00100000:0.0:1783444215.872341:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 218 00000001:00080000:1.0:1783444216.731046:0:85122:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215108 is committed 00010000:00010000:0.0:1783444216.732479:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732494:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732501:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732507:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444216.732511:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732518:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732536:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9368d4c9ae00) 00010000:00010000:0.0:1783444216.732539:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444216.732544:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732550:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e38319a0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732582:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732588:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732593:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732598:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444216.732601:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732606:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732614:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368dccaef00) 00010000:00010000:0.0:1783444216.732616:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444216.732619:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732624:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e38319a7 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732637:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732643:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732648:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732657:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444216.732660:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732666:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732674:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368dccaef00) 00010000:00010000:0.0:1783444216.732676:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783444216.732678:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.732683:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e38319e6 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444216.732935:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444216.802469:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444216.802501:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557752960 00000100:00100000:1.0:1783444216.802511:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557752960 00000100:00100000:1.0:1783444216.802570:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1081 00000100:00100000:1.0:1783444216.802580:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66334:x1870073557752960:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1783444216.802632:0:66226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00100000:1.0:1783444216.802710:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66334:x1870073557752960:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 130us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444216.802717:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1081 00000100:00080000:1.0:1783444216.802892:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444216.810973:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444216.811008:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557753088 00000100:00100000:3.0:1783444216.811019:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557753088 00000100:00100000:3.0:1783444216.811093:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1082 00000100:00100000:3.0:1783444216.811103:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66334:x1870073557753088:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444216.811143:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00080000:1.0:1783444216.811236:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444216.813039:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66334:x1870073557753088:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 1930us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444216.813052:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1082 00000100:00100000:2.0:1783444216.818111:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444216.818246:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557753216 00000100:00100000:1.0:1783444216.818257:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557753216 00000100:00100000:1.0:1783444216.818343:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1798 00000100:00100000:1.0:1783444216.818354:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:66334:x1870073557753216:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:1.0:1783444216.818388:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444216.818458:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:66334:x1870073557753216:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 106us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444216.818467:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1798 00000100:00080000:2.0:1783444216.818726:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444216.823629:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444216.823700:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557753344 00000100:00100000:3.0:1783444216.823711:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557753344 00000100:00100000:3.0:1783444216.823786:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1799 00000100:00080000:0.0:1783444216.823895:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444216.823946:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:66334:x1870073557753344:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:3.0:1783444216.823979:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444216.824090:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3391c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:66334:x1870073557753344:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 146us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444216.824110:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1799 00000100:00100000:1.0:1783444216.903847:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444216.904001:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557753600 00000100:00100000:0.0:1783444216.904012:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557753600 00000100:00100000:0.0:1783444216.904076:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1083 00000100:00100000:0.0:1783444216.904087:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66341:x1870073557753600:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00010000:0.0:1783444216.904155:0:66225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444216.904185:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e38319b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a5d expref: 7 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.904207:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368cdf77700) 00010000:00010000:0.0:1783444216.904222:0:66225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444216.904296:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.904329:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.904342:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.904515:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.904523:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.904530:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905323:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905336:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905343:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905425:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905432:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444216.905437:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905446:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905471:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c709e400) 00010000:00010000:0.0:1783444216.905475:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444216.905480:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905487:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262800/0x42cb6883e38319ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444216.905507:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a31890f reply state 00000000aac8058c transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905519:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444216.905525:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c709e000) 00010000:00010000:0.0:1783444216.905527:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444216.905530:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444216.905718:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:66341:x1870073557753600:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 1629us (1884us total) trans 103079215109 rc 0/0 00000100:00100000:0.0:1783444216.905727:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1083 00000100:00100000:3.0:1783444216.965703:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444216.966233:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557753728 00000100:00100000:1.0:1783444216.966245:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557753728 00000100:00100000:1.0:1783444216.966314:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1084 00000100:00100000:1.0:1783444216.966326:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:66344:x1870073557753728:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1783444216.966352:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444216.966376:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70a00/0x42cb6883e38319fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a72 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.966446:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3831a02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.966472:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3831a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.966486:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3831a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444216.966533:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783444216.966537:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444216.966560:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3831a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.966584:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70a00/0x42cb6883e38319fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a72 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.966601:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3831a02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a72 expref: 9 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.966610:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccae300) 00010000:00010000:1.0:1783444216.966613:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444216.966617:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70600, rc 0) 00000100:00100000:1.0:1783444216.966688:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:66344:x1870073557753728:12345-192.168.204.20@tcp:101:rm.0 Request processed in 364us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444216.966695:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1084 00000100:00100000:1.0:1783444216.975827:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444216.979639:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557753856 00000100:00100000:3.0:1783444216.979655:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557753856 00000100:00100000:3.0:1783444216.981026:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1085 00000100:00100000:3.0:1783444216.981042:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+9:66344:x1870073557753856:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444216.981067:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444216.981090:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a79 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981171:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981185:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981197:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981209:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981216:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981223:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981302:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a1e lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981318:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a1e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981338:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a1e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444216.981392:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783444216.981397:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444216.981417:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a1e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981429:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a1e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981438:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981445:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981452:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981458:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1bc00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444216.981464:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981472:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981485:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccae300) 00010000:00010000:3.0:1783444216.981494:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444216.981500:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981506:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981518:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981524:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981530:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981535:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1aa00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444216.981538:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981544:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981552:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c709e000) 00010000:00010000:3.0:1783444216.981555:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444216.981558:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981564:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981592:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a79 expref: 11 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981619:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a1e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a79 expref: 10 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.981626:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9368c3220600) 00010000:00010000:3.0:1783444216.981628:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444216.981630:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1ba00, rc 0) 00000100:00100000:3.0:1783444216.981701:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+10:66344:x1870073557753856:12345-192.168.204.20@tcp:101:rm.0 Request processed in 663us (5883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444216.981709:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1085 00000100:00100000:0.0:1783444216.993572:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444216.993635:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557754112 00000100:00100000:3.0:1783444216.993647:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557754112 00000100:00100000:3.0:1783444216.993703:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1086 00000100:00100000:3.0:1783444216.993714:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:66344:x1870073557754112:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1783444216.993944:0:66225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783444216.993974:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a1e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a79 expref: 10 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.993995:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9368c3220600) 00010000:00010000:3.0:1783444216.994015:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3831a02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a72 expref: 9 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994025:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccae300) 00010000:00010000:3.0:1783444216.994032:0:66225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444216.994057:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994080:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994091:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994104:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994111:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994118:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994203:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994211:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994218:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994496:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994567:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994578:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994596:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994602:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994608:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994631:0:66225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444216.994648:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.994654:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444216.994655:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.994665:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994666:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994687:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1aa00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444216.994688:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1bc00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444216.994693:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.994702:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994705:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.994721:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994725:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9368c3220400) 00010000:00010000:3.0:1783444216.994732:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783444216.994738:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.994742:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9368c3220400) 00010000:00010000:1.0:1783444216.994747:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783444216.994750:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.994762:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1bc00/0x42cb6883e3831a3a lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444216.994774:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444216.994776:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444216.994778:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444216.994931:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a33 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994953:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994959:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994965:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994971:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994976:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1b600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444216.994979:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994985:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.994994:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3220800) 00010000:00010000:3.0:1783444216.994997:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444216.995000:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.995006:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a25 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444216.995021:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000829002d9 reply state 000000002765a0e2 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.995040:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444216.995047:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c709e000) 00010000:00010000:3.0:1783444216.995050:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444216.995053:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444216.995142:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:66344:x1870073557754112:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1427us (1577us total) trans 103079215110 rc 0/0 00000100:00100000:3.0:1783444216.995152:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1086 00010000:00010000:1.0:1783444217.763654:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444218.781176:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444219.678287:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575218304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444219.678358:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444219.681370:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575218304 00000100:00100000:3.0:1783444219.681379:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575218304 00000100:00100000:3.0:1783444219.681441:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:3.0:1783444219.681452:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575218304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444219.681483:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444219.681559:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575218304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444219.681567:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00080000:3.0:1783444219.681600:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444219.681645:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575218304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444219.684591:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575218432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444219.684666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444219.684910:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575218432 00000100:00100000:3.0:1783444219.684918:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575218432 00000100:00100000:3.0:1783444219.684970:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:3.0:1783444219.684990:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575218432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444219.685023:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444219.685064:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575218432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444219.685085:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00080000:1.0:1783444219.685770:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444219.685838:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575218432:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783444219.808364:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444219.980125:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444219.980173:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444219.980261:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444219.980290:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444219.980313:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444219.980348:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557754752 00000100:00100000:3.0:1783444219.980359:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557754752 00000100:00100000:3.0:1783444219.980426:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557754624 00000100:00100000:3.0:1783444219.980430:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557754624 00000100:00100000:3.0:1783444219.980456:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2277 00000100:00100000:3.0:1783444219.980467:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557754752:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444219.980560:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557754752:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444219.980567:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2277 00000100:00100000:3.0:1783444219.980584:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2278 00000100:00100000:3.0:1783444219.980590:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557754624:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444219.980615:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557754624:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444219.980621:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2278 00000100:00100000:3.0:1783444219.980639:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557754496 00000100:00100000:3.0:1783444219.980643:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557754496 00000100:00100000:3.0:1783444219.980670:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557754368 00000100:00100000:3.0:1783444219.980673:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557754368 00000100:00100000:3.0:1783444219.980693:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 820 00000100:00100000:3.0:1783444219.980699:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557754496:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444219.980733:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557754496:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444219.980740:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 820 00000100:00100000:3.0:1783444219.980752:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 821 00000100:00100000:3.0:1783444219.980759:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2403:x1870073557754368:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000080:3.0:1783444219.980803:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901f37b80 x1870073557754368/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:595/0 lens 224/224 e 0 to 0 dl 1783444230 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444219.980830:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2403:x1870073557754368:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 71us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444219.980836:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 821 00000100:00080000:3.0:1783444219.980858:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444219.980861:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444219.980864:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444219.980866:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444219.981048:0:85132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557754240 00000100:00100000:2.0:1783444219.981054:0:85132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557754240 00000100:00100000:2.0:1783444219.981094:0:85132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:2.0:1783444219.981101:0:85132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557754240:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444219.981135:0:85132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557754240:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 35us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444219.981142:0:85132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:2.0:1783444220.188933:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444220.188959:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575218944:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189039:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189078:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575218560:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189149:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575219456:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189207:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575219968:0@lo:400:kworker.0 00000100:00100000:1.0:1783444220.189220:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575219072:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189229:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444220.189244:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189262:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575218944 00000100:00100000:1.0:1783444220.189264:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575219584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189270:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575218944 00000100:00100000:2.0:1783444220.189321:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575219072 00000100:00100000:2.0:1783444220.189325:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575219072 00000100:00100000:2.0:1783444220.189348:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1783444220.189357:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575218944:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444220.189385:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8ca80 x1870073575218944/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:596/0 lens 224/224 e 0 to 0 dl 1783444231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444220.189421:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189426:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575218944:12345-0@lo:400:kworker.0 Request processed in 70us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444220.189433:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1783444220.189444:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575220096:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189447:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575219584 00000100:00100000:2.0:1783444220.189449:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575219584 00000100:00100000:1.0:1783444220.189465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189468:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1783444220.189473:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575219072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444220.189488:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575218688:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189505:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575219072:12345-0@lo:400:kworker.0 Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.189509:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189511:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1783444220.189519:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575219200:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189520:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575220096 00000100:00100000:2.0:1783444220.189522:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575220096 00000100:00100000:2.0:1783444220.189533:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575218688 00000100:00100000:2.0:1783444220.189535:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575218688 00000100:00100000:1.0:1783444220.189538:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189548:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:2.0:1783444220.189553:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575219584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444220.189555:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575219712:0@lo:400:kworker.0 00010000:00000080:2.0:1783444220.189563:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c56f7100 x1870073575219584/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:596/0 lens 224/224 e 0 to 0 dl 1783444231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444220.189572:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444220.189588:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783444220.189593:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575218816:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189597:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575219584:12345-0@lo:400:kworker.0 Request processed in 45us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444220.189603:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1783444220.189610:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189612:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575218816 00000100:00100000:2.0:1783444220.189615:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575218816 00000100:00100000:1.0:1783444220.189619:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575219328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189630:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1783444220.189635:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575220096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444220.189637:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:2.0:1783444220.189644:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901800380 x1870073575220096/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:596/0 lens 224/224 e 0 to 0 dl 1783444231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444220.189652:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575219840:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189667:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575220096:12345-0@lo:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.189670:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444220.189673:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1783444220.189683:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1783444220.189689:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575218688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444220.189696:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00010000:00000080:2.0:1783444220.189699:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901802d80 x1870073575218688/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:596/0 lens 224/224 e 0 to 0 dl 1783444231 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444220.189704:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575218816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.189728:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575218688:12345-0@lo:400:kworker.0 Request processed in 39us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.189729:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575218816:12345-0@lo:400:kworker.0 Request processed in 27us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444220.189826:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575219200 00000100:00100000:0.0:1783444220.189832:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575219200 00000100:00100000:0.0:1783444220.189863:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575219712 00000100:00100000:0.0:1783444220.189866:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575219712 00000100:00100000:0.0:1783444220.189886:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:0.0:1783444220.189893:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575219200:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1783444220.189908:0:23687:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901803800 x1870073575219200/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:596/0 lens 224/224 e 0 to 0 dl 1783444231 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444220.189922:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1783444220.189928:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1783444220.189949:0:85129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575218560 00000100:00100000:1.0:1783444220.189949:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575219456 00000100:00100000:2.0:1783444220.189953:0:85129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575218560 00000100:00100000:1.0:1783444220.189953:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575219456 00000100:00100000:0.0:1783444220.189955:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575219200:12345-0@lo:400:kworker.0 Request processed in 62us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444220.189964:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:0.0:1783444220.189985:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:2.0:1783444220.189989:0:85129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783444220.189996:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575219712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.190002:0:85129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575218560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444220.190037:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575219712:12345-0@lo:400:kworker.0 Request processed in 42us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444220.190045:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:2.0:1783444220.190050:0:85129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575218560:12345-0@lo:400:kworker.0 Request processed in 51us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.190062:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575219968 00000100:00100000:2.0:1783444220.190066:0:85129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783444220.190066:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575219968 00000100:00100000:1.0:1783444220.190090:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575219328 00000100:00100000:1.0:1783444220.190093:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575219328 00000100:00100000:2.0:1783444220.190097:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575219840 00000100:00100000:2.0:1783444220.190101:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575219840 00000100:00100000:0.0:1783444220.190112:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1783444220.190121:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575219456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444220.190153:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575219456:12345-0@lo:400:kworker.0 Request processed in 34us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.190231:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1783444220.190239:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575219968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444220.190277:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1783444220.190299:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:0.0:1783444220.190306:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575219328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444220.190377:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575219968:12345-0@lo:400:kworker.0 Request processed in 139us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.190384:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1783444220.190396:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:1.0:1783444220.190402:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575219840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444220.190474:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575219328:12345-0@lo:400:kworker.0 Request processed in 169us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444220.190481:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:1.0:1783444220.190486:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575219840:12345-0@lo:400:kworker.0 Request processed in 82us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.190494:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00080000:2.0:1783444220.192240:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444220.192248:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444220.192251:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444220.192254:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444220.192319:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575219072:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192336:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575219584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192355:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575220096:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192406:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575218816:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192418:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575219328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192430:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575219840:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192440:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575218688:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192451:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575219200:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192462:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575219712:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192496:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575219968:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192521:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575219456:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192532:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575218944:0@lo:400:kworker.0 00000100:00100000:2.0:1783444220.192542:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575218560:0@lo:400:kworker.0 00000100:00100000:1.0:1783444220.196691:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444220.196714:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575220224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444220.196826:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444220.198181:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575220224 00000100:00100000:1.0:1783444220.198193:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575220224 00000100:00100000:1.0:1783444220.198248:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:1.0:1783444220.198256:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575220224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444220.198302:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444220.198458:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575220224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.198465:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:1.0:1783444220.198511:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575220224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444220.701017:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575220352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444220.701101:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444220.701170:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575220352 00000100:00100000:1.0:1783444220.701178:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575220352 00000100:00100000:1.0:1783444220.701241:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:1.0:1783444220.701249:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575220352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444220.701284:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00010000:00000080:1.0:1783444220.701299:0:29151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368c9f69180 x1870073575220352/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:596/0 lens 224/368 e 0 to 0 dl 1783444231 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444220.701341:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575220352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444220.701348:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:1.0:1783444220.701412:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c9f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575220352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444220.701597:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444220.701614:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575220480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444220.701645:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444220.705634:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575220480 00000100:00100000:3.0:1783444220.705648:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575220480 00000100:00100000:3.0:1783444220.705715:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:3.0:1783444220.705932:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575220480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444220.706105:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444220.706196:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575220480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 472us (4549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444220.706203:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:2.0:1783444220.706318:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575220480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444220.711889:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444220.711914:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575220608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444220.711998:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444220.712131:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575220608 00000100:00100000:3.0:1783444220.712140:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575220608 00000100:00100000:3.0:1783444220.712195:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:3.0:1783444220.712204:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575220608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444220.712235:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444220.712290:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575220608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444220.712297:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:1.0:1783444220.712383:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575220608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783444220.834032:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444221.853938:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783444222.716667:0:86345:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000001:00080000:1.0:1783444222.758488:0:85122:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:0.0:1783444222.758786:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758819:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758827:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758845:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444222.758850:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758858:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758880:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c709e000) 00010000:00010000:0.0:1783444222.758884:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444222.758890:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758898:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38319f4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758921:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758928:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758934:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758939:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1be00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444222.758942:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758949:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758969:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c709e000) 00010000:00010000:0.0:1783444222.758972:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444222.758976:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.758982:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831a2c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444222.796559:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444222.797958:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557754880 00000100:00100000:2.0:1783444222.797972:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557754880 00000100:00100000:2.0:1783444222.798056:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1087 00000100:00100000:2.0:1783444222.798083:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66411:x1870073557754880:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:2.0:1783444222.798112:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444222.798143:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e3831a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a80 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.798213:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831a48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.798227:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.798239:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444222.798282:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444222.798286:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444222.798319:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.798342:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e3831a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a80 expref: 8 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.798359:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831a48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a80 expref: 7 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.798376:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368cdf77800) 00010000:00010000:2.0:1783444222.798379:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444222.798382:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030200, rc 0) 00010000:00000080:2.0:1783444222.798390:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd15f480 x1870073557754880/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:598/0 lens 576/688 e 0 to 0 dl 1783444233 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444222.798452:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66411:x1870073557754880:12345-192.168.204.20@tcp:101:touch.0 Request processed in 374us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444222.798459:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1087 00000100:00080000:1.0:1783444222.798845:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444222.803208:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444222.805241:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557755008 00000100:00100000:3.0:1783444222.805257:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557755008 00000100:00100000:3.0:1783444222.805331:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1088 00000100:00100000:3.0:1783444222.805344:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66411:x1870073557755008:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444222.805383:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444222.805409:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a87 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805494:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805512:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805526:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805540:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805551:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805558:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805667:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831a64 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805676:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831a64 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805683:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831a64 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444222.805736:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783444222.805740:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444222.805769:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831a64 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805784:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805810:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805818:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805825:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1aa00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444222.805830:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805838:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805852:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368cdf77800) 00010000:00010000:3.0:1783444222.805861:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444222.805931:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805940:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e3831a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805953:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805959:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805965:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805970:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1ba00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444222.805973:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805979:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.805987:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9368c3220600) 00010000:00010000:3.0:1783444222.805990:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444222.805993:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.806000:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3831a5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.806036:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3831a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a87 expref: 9 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.806064:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831a64 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a87 expref: 8 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444222.806071:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368c3220b00) 00010000:00010000:3.0:1783444222.806074:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783444222.806076:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1b000, rc 0) 00010000:00000080:3.0:1783444222.806085:0:80475:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd15ed80 x1870073557755008/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:598/0 lens 592/688 e 0 to 0 dl 1783444233 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444222.806285:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:66411:x1870073557755008:12345-192.168.204.20@tcp:101:touch.0 Request processed in 942us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444222.806295:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1088 00000100:00100000:3.0:1783444222.810249:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444222.810652:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557755264 00000100:00100000:0.0:1783444222.810663:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557755264 00000100:00100000:0.0:1783444222.810720:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1089 00000100:00100000:0.0:1783444222.810738:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:66411:x1870073557755264:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444222.810763:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444222.810828:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831a6b lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a8e expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.810997:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.811011:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.811023:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.811038:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.811057:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444222.811065:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812414:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812437:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812448:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444222.812492:0:71469:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1783444222.812496:0:71469:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 0 -> 1783444224 00000004:00010000:1.0:1783444222.812499:0:71469:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 0 -> 1783444224 00000004:00010000:1.0:1783444222.812508:0:71469:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 0 -> 1783444224 00000004:00010000:1.0:1783444222.812510:0:71469:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:1.0:1783444222.812515:0:71469:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:1.0:1783444222.812523:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812531:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812538:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812544:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812549:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444222.812553:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812559:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 5/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812573:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368c3220b00) 00010000:00010000:1.0:1783444222.812576:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444222.812581:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 3/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812588:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831a72 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444222.812604:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e47a30fe reply state 0000000049780f15 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812626:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812633:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9367c709e000) 00010000:00010000:1.0:1783444222.812635:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444222.812638:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444222.812680:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831a6b lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 11 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812696:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.812703:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9368d4c9a800) 00010000:00010000:1.0:1783444222.812705:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1783444222.812708:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71c00, rc 0) 00010000:00000080:1.0:1783444222.812715:0:71469:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901f37800 x1870073557755264/t103079215111(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:598/0 lens 752/824 e 0 to 0 dl 1783444233 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444222.812827:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+11:66411:x1870073557755264:12345-192.168.204.20@tcp:101:touch.0 Request processed in 2090us (2589us total) trans 103079215111 rc 0/0 00000100:00100000:1.0:1783444222.812837:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1089 00000100:00100000:0.0:1783444222.822366:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444222.822550:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557755520 00000100:00100000:1.0:1783444222.822563:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557755520 00000100:00100000:1.0:1783444222.822643:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1090 00000100:00100000:1.0:1783444222.822656:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+11:66411:x1870073557755520:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:1.0:1783444222.822786:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.822882:0:66223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 11 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.822894:0:66223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.822952:0:66223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 11 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.822970:0:66223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 11 pid: 71469 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444222.822987:0:66223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dcf3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575220736:192.168.204.20@tcp:104: 00000100:00100000:1.0:1783444222.823089:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1783444222.836469:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444222.837267:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dcf3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575220736:192.168.204.20@tcp:104: 00010000:00010000:1.0:1783444222.837300:0:66223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444222.840194:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557755648 00000100:00100000:2.0:1783444222.840209:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557755648 00010000:00010000:2.0:1783444222.840329:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 12 pid: 71469 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444222.840424:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2542 00000100:00100000:2.0:1783444222.840434:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2403:x1870073557755648:12345-192.168.204.20@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1783444222.840452:0:6490:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 12 pid: 71469 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.840465:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 12 pid: 71469 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.840476:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 12 pid: 71469 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.840484:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9368d4c9a800) 00010000:00010000:2.0:1783444222.840495:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1783444222.840499:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.840508:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.840514:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444222.840550:0:6490:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 12 pid: 71469 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444222.840622:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2403:x1870073557755648:12345-192.168.204.20@tcp:102:ldlm_bl.0 Request processed in 188us (4160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444222.840629:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2542 00010000:00010000:1.0:1783444222.840687:0:66223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.840698:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444222.840893:0:66223:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1783444222.840897:0:66223:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 1783444224 -> 1783444224 00000004:00010000:1.0:1783444222.840900:0:66223:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 1783444224 -> 1783444224 00000004:00010000:1.0:1783444222.840908:0:66223:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 1783444224 -> 1783444224 00000004:00010000:1.0:1783444222.840911:0:66223:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1783444222.840918:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006221afed reply state 000000008ce25448 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.840932:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444222.840951:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9368d4c9a800) 00010000:00010000:1.0:1783444222.840954:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444222.840957:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1783444222.841012:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f8ffaa00 x1870073557755520/t103079215112(0) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:598/0 lens 488/456 e 0 to 0 dl 1783444233 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444222.841046:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+13:66411:x1870073557755520:12345-192.168.204.20@tcp:36:touch.0 Request processed in 18394us (18689us total) trans 103079215112 rc 0/0 00000100:00100000:1.0:1783444222.841053:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1090 00000100:00100000:0.0:1783444222.846615:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444222.846716:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557755904 00000100:00100000:3.0:1783444222.849116:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557755904 00000100:00100000:3.0:1783444222.849202:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:3.0:1783444222.849213:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+13:66411:x1870073557755904:12345-192.168.204.20@tcp:35:touch.0 00010000:00000080:3.0:1783444222.851832:0:76566:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ea497100 x1870073557755904/t103079215113(0) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:598/0 lens 392/456 e 0 to 0 dl 1783444233 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444222.851908:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+14:66411:x1870073557755904:12345-192.168.204.20@tcp:35:touch.0 Request processed in 2695us (5301us total) trans 103079215113 rc 0/0 00000100:00100000:3.0:1783444222.851919:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 219 00010000:00010000:1.0:1783444222.884182:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444223.901834:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783444224.783001:0:86443:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783444224.783141:0:86443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.783158:0:86443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.783166:0:86443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.783172:0:86443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.783320:0:86443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783444224.783327:0:86443:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783444224.783424:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444224.783429:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783444224.783436:0:86443:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783444224.783465:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783444224.783522:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575220864:0@lo:39:umount.0 00000100:00100000:3.0:1783444224.783597:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783444224.783778:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444224.783786:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.783840:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a55400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444224.783844:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.783854:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444224.783863:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444224.783879:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444224.783881:0:6493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783444224.783884:0:6493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783444224.783988:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.784001:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444224.784024:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.784031:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6a55400/0x42cb6883e3831612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831619 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.784041:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444224.784043:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444224.784044:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444224.784140:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575220992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444224.784175:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444224.784330:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575220992 00000100:00100000:0.0:1783444224.784338:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575220992 00000100:00100000:0.0:1783444224.784395:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1783444224.784405:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dcf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575220992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444224.784417:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444224.784432:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a54e00/0x42cb6883e3831619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831612 expref: 24 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.784444:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444224.784477:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dcf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3633:x1870073575220992:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444224.784483:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1783444224.784619:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575220992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444224.784764:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575220864 00000100:00100000:3.0:1783444224.784768:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575220864 00000100:00100000:3.0:1783444224.784822:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1783444224.784829:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575220864:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783444224.784852:0:80475:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383172a 00000100:00080000:3.0:1783444224.784867:0:80475:0:(import.c:65:import_set_state_nolock()) ffff9368ff64a800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1783444224.784940:0:80475:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff936901f36300 x1870073575220864/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:600/0 lens 224/224 e 0 to 0 dl 1783444235 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444224.784978:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3632:x1870073575220864:12345-0@lo:39:umount.0 Request processed in 149us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444224.784984:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000020:00000080:3.0:1783444224.784991:0:80475:0:(genops.c:906:class_export_put()) final put ffff9368ff64d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783444224.785024:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff64d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783444224.785075:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff64a800 for lustre-MDT0000 00000100:00080000:3.0:1783444224.785096:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783444224.785104:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575220864:0@lo:39:umount.0 00000100:00080000:0.0:1783444224.785324:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444224.785328:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783444224.785332:0:86443:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783444224.786298:0:86443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.786333:0:86443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.786341:0:86443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.786350:0:86443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.786865:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444224.786872:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.786881:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444224.786886:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.786894:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444224.786902:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444224.786907:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444224.786910:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783444224.787006:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.787014:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444224.787040:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.787049:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444224.787051:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444224.787060:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444224.787067:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444224.787079:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575221120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444224.787138:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444224.787195:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575221120 00000100:00100000:3.0:1783444224.787200:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575221120 00000100:00100000:3.0:1783444224.787244:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1783444224.787251:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3633:x1870073575221120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444224.787263:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444224.787275:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a55a00/0x42cb6883e3831539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831532 expref: 23 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.787289:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444224.787328:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3633:x1870073575221120:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444224.787336:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1783444224.787516:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575221120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444224.787632:0:86443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783444224.787639:0:86443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6a54c00/0x42cb6883e3831532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831539 expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787652:0:86443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787660:0:86443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787667:0:86443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787674:0:86443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787698:0:86443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444224.787704:0:86443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787722:0:86443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787729:0:86443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787735:0:86443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787746:0:86443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444224.787754:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444224.787758:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787764:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444224.787768:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787775:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444224.787781:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444224.787804:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783444224.787807:0:6493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1783444224.787809:0:6493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783444224.787827:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787842:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444224.787856:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787863:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6a54a00/0x42cb6883e3831651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831658 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787871:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444224.787874:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787879:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444224.787883:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787890:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444224.787896:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444224.787901:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783444224.787903:0:6493:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783444224.787905:0:6493:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783444224.787914:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787919:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444224.787924:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787939:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3831604 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383160b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.787946:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444224.787947:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444224.787949:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444224.787958:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575221376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444224.787999:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444224.788031:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444224.788036:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575221248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444224.788165:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444224.788460:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444224.788490:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444224.788533:0:86443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.788543:0:86443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.788550:0:86443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.788556:0:86443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.788574:0:86443:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783444224.788577:0:86443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1783444224.788581:0:86443:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1783444224.788625:0:86443:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783444224.788630:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1783444224.788641:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1783444224.788647:0:86443:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:1.0:1783444224.789166:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575221376 00000100:00100000:1.0:1783444224.789173:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575221376 00000100:00100000:1.0:1783444224.789227:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575221248 00000100:00100000:1.0:1783444224.789230:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575221248 00000100:00100000:1.0:1783444224.789253:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1783444224.789268:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3636:x1870073575221376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444224.789280:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444224.789296:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05800/0x42cb6883e383160b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831604 expref: 23 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.789311:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444224.789368:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3636:x1870073575221376:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444224.789376:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1783444224.789393:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1783444224.789398:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3636:x1870073575221248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444224.789405:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444224.789413:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583ee00/0x42cb6883e3831658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831651 expref: 21 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.789421:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444224.789440:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3636:x1870073575221248:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444224.789446:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1783444224.789479:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575221248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444224.789487:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575221376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444224.789667:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444224.789673:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.789682:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6a54400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444224.789696:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.789705:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444224.789713:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444224.789730:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783444224.789733:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783444224.789737:0:10323:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783444224.789765:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.789773:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444224.789848:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.789857:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6a54400/0x42cb6883e3831524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383152b expref: -99 pid: 85121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.789883:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444224.789889:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444224.789899:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444224.789909:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444224.789922:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575221504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444224.789962:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444224.790008:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575221504 00000100:00100000:3.0:1783444224.790012:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575221504 00000100:00100000:3.0:1783444224.790040:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1783444224.790047:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3634:x1870073575221504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444224.790415:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444224.790429:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583e200/0x42cb6883e383152b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831524 expref: 20 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444224.790440:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444224.790480:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3634:x1870073575221504:12345-0@lo:103:ldlm_bl.0 Request processed in 432us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444224.790487:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1783444224.790517:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575221504:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1783444224.798541:0:86443:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:1.0:1783444224.801540:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444224.801565:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575221632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444224.801632:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444224.801923:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575221760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444224.802016:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444224.802086:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575221632 00000100:00100000:2.0:1783444224.802096:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575221632 00000100:00100000:2.0:1783444224.802177:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575221760 00000100:00100000:2.0:1783444224.802181:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575221760 00000100:00100000:2.0:1783444224.802203:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:2.0:1783444224.802213:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575221632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444224.802251:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444224.802308:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575221632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444224.802316:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:2.0:1783444224.802349:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:2.0:1783444224.802356:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575221760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444224.802373:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444224.802403:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575221760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444224.802409:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00080000:2.0:1783444224.802425:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444224.802430:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444224.802479:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575221632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444224.802541:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575221760:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1783444224.802584:0:85122:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:0.0:1783444224.802657:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802669:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802676:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802682:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444224.802697:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802705:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802725:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9367c709e000) 00010000:00010000:0.0:1783444224.802728:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444224.802734:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802740:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262200/0x42cb6883e3831a79 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802766:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802772:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802814:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802821:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444224.802826:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802834:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802844:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9368d4c9a800) 00010000:00010000:0.0:1783444224.802848:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444224.802851:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444224.802859:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3831a8e lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1783444224.802928:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1783444224.802937:0:86443:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c6bc8000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783444224.802946:0:86443:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c9a11000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783444224.802951:0:86443:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c9a10000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783444224.802956:0:86443:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368dd1e8800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783444224.802964:0:86443:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368dd1ef800 778015c5-4969-44f5-82a5-0f6eadd152d5 192.168.204.20@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 103079215113 stale:0 00000020:00080000:2.0:1783444224.802970:0:86443:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9368f8f18000) has exports, disconnecting them 00000020:00080000:2.0:1783444224.802975:0:86443:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c6bc8000), last request at 1783444194 00000020:00000080:2.0:1783444224.802983:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831723 00000100:00080000:2.0:1783444224.802993:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9368ff64c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783444224.803025:0:86443:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c6bc8000): rc 0 00000020:00000080:2.0:1783444224.803028:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368c6bc8000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1783444224.803043:0:86443:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c9a11000), last request at 1783444220 00000020:00000080:2.0:1783444224.803046:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383171c 00000100:00080000:2.0:1783444224.803059:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9368c6bc8800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1783444224.803082:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c6bc8000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783444224.803134:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff64c000 for lustre-MDT0000 00000020:00080000:2.0:1783444224.803148:0:86443:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c9a11000): rc 0 00000020:00000080:2.0:1783444224.803151:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368c9a11000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1783444224.803157:0:86443:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c9a10000), last request at 1783444220 00000020:00000080:2.0:1783444224.803161:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831715 00000100:00080000:2.0:1783444224.803166:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9368c9a10800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1783444224.803178:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a11000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783444224.803202:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c6bc8800 for lustre-MDT0000 00000020:00080000:2.0:1783444224.803211:0:86443:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c9a10000): rc 0 00000020:00000080:2.0:1783444224.803213:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368c9a10000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1783444224.803219:0:86443:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368dd1e8800), last request at 1783444189 00000020:00000080:2.0:1783444224.803226:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831586 00000100:00080000:2.0:1783444224.803238:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9368c88cb000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1783444224.803251:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a10000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783444224.803299:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c9a10800 for lustre-MDT0000 00000020:00080000:2.0:1783444224.803309:0:86443:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368dd1e8800): rc 0 00000020:00000080:2.0:1783444224.803312:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368dd1e8800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1783444224.803318:0:86443:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.20@tcp (ffff9368dd1ef800), last request at 1783444222 00000020:00000080:2.0:1783444224.803323:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383157f 00000020:00010000:2.0:1783444224.803329:0:86443:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368dd1ef800: total 1 00000100:00080000:2.0:1783444224.803332:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9368eab70800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1783444224.803340:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1e8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1783444224.803373:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c88cb000 for lustre-MDT0000 00000020:00080000:2.0:1783444224.803384:0:86443:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368dd1ef800): rc 0 00000004:00000080:2.0:1783444224.803391:0:86443:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac1c41503ae0 00000100:00080000:2.0:1783444224.803417:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783444224.803427:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:1.0:1783444224.803451:0:10324:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368dd1ef800: total 0 00010000:00010000:1.0:1783444224.803458:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444224.803526:0:10324:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368dd1ef800, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1783444224.803564:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3831a80 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 4 pid: 71469 timeout: 3313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.803590:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3831a48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a80 expref: 3 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.803610:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831a64 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a87 expref: 2 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444224.803624:0:10324:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368dd1ef800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1783444224.806249:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444224.806263:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444224.806349:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444224.814482:0:86443:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783444224.816825:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9367c229d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783444224.817457:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783444224.817460:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575221888:0@lo:39:umount.0 00000100:00100000:3.0:1783444224.817463:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969447 gen 3 00000004:00080000:3.0:1783444224.817483:0:86443:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783444224.817541:0:86443:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783444224.817560:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9367c5032000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783444224.817568:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783444224.817570:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:3.0:1783444224.817579:0:86443:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444224.817652:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444224.817733:0:86443:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783444224.817745:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9368ff5e7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783444224.817786:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368f8f18000) has no exports 00000100:00100000:2.0:1783444224.818651:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575222016:0@lo:9:umount.0 00000100:00100000:2.0:1783444224.818708:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444224.818813:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575222144:0@lo:9:umount.0 00000100:00100000:2.0:1783444224.818845:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444224.818868:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575222016 00000100:00100000:0.0:1783444224.818881:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575222016 00000100:00100000:2.0:1783444224.818920:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575221888 00000100:00100000:0.0:1783444224.818961:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575222144 00000100:00100000:0.0:1783444224.818966:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575222144 00000100:00100000:0.0:1783444224.818996:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:0.0:1783444224.819006:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575222016:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783444224.819037:0:26204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315d3 00000100:00080000:0.0:1783444224.819046:0:26204:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca6800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783444224.819397:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575221888 00000100:00100000:2.0:1783444224.819464:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1783444224.819474:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575221888:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783444224.819518:0:23687:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315c5 00000100:00080000:2.0:1783444224.819527:0:23687:0:(import.c:65:import_set_state_nolock()) ffff9368ef12e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783444224.820764:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969447 00000100:00100000:0.0:1783444224.820999:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575222016:12345-0@lo:9:umount.0 Request processed in 1990us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444224.821029:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000100:00100000:0.0:1783444224.821067:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000100:00100000:0.0:1783444224.821078:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575222144:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783444224.821105:0:26204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315ef 00000100:00080000:0.0:1783444224.821114:0:26204:0:(import.c:65:import_set_state_nolock()) ffff9368ead8c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783444224.823388:0:23687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411431 00010000:00010000:2.0:1783444224.823422:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444224.823743:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3632:x1870073575221888:12345-0@lo:39:umount.0 Request processed in 4263us (6085us total) trans 77309411432 rc 0/0 00000100:00100000:2.0:1783444224.823757:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00010000:00010000:2.0:1783444224.825425:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444224.825455:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444224.825464:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783444224.826824:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1783444224.826908:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969451 00000100:00100000:0.0:1783444224.827498:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575222144:12345-0@lo:9:umount.0 Request processed in 6418us (8648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444224.827510:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00000100:00080000:0.0:1783444224.827572:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c5032000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783444224.827589:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783444224.827591:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783444224.827595:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575222016:0@lo:9:umount.0 00000100:00080000:0.0:1783444224.827606:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ff5e7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783444224.827666:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000020:00080000:3.0:1783444224.831244:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368f8f18000) has no exports 00000004:00080000:0.0:1783444224.835298:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783444224.835319:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575222144:0@lo:9:umount.0 00000100:00080000:0.0:1783444224.835948:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c229d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783444224.835956:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575221888:0@lo:39:umount.0 00000020:00000080:1.0:1783444224.852571:0:10324:0:(genops.c:906:class_export_put()) final put ffff9368dd1ef800/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:1.0:1783444224.852640:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1ef800/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-MDT0000 00000020:00000080:1.0:1783444224.852754:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368eab70800 for lustre-MDT0000 00010000:00010000:2.0:1783444224.853165:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444224.853172:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444224.853177:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444224.925015:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783444224.930608:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383159b 00000020:00000080:3.0:1783444224.930627:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368ea60c000/lustre-QMT0000_UUID 00000020:01000000:3.0:1783444224.930721:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783444224.931132:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea60c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783444224.931256:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444224.931284:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783444224.931289:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9367c3330000) has no exports 00000020:00000080:2.0:1783444224.931953:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831594 00000020:00000080:2.0:1783444224.931965:0:86443:0:(genops.c:906:class_export_put()) final put ffff9367c32ce000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444224.932021:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c32ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783444224.932139:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444224.932150:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783444224.932153:0:86443:0:(genops.c:906:class_export_put()) final put ffff9367c32cc800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783444224.932156:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c32cc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783444224.932161:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1783444224.932490:0:86443:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9368c6105600 - data ffff9368ffb746c0/ffff9367c6b83c00 00000020:01000000:2.0:1783444224.932642:0:86443:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9368c61054e0 - data ffff9367c19c8870/ffff9367c59ffc00 00000100:00080000:3.0:1783444224.992378:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783444224.992388:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783444224.992404:0:86443:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff936901f35500 x1870073575221888/t77309411432(77309411432) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444234 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444224.992433:0:86443:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783444224.996294:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783444224.996305:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969447 gen 4 00000004:00080000:3.0:1783444224.996373:0:86443:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444224.996376:0:86443:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783444225.000951:0:85140:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783444225.000959:0:85140:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:0.0:1783444225.000975:0:85140:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:3.0:1783444225.002398:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783444225.002405:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:3.0:1783444225.002429:0:86443:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444225.002433:0:86443:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783444225.004317:0:85142:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783444225.004326:0:85142:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:0.0:1783444225.004343:0:85142:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:1.0:1783444225.014122:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383154e 00000020:00000080:1.0:1783444225.014135:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368eaf3f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444225.014225:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eaf3f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783444225.015130:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831563 00000020:00000080:1.0:1783444225.015137:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368dd1e8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783444225.015144:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783444225.015150:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1e8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783444225.015161:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444225.015174:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783444225.015189:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9368f8f1b380) has no exports 00000004:01000000:1.0:1783444225.015488:0:86443:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783444225.015497:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315e8 00000020:00000080:1.0:1783444225.015501:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368ead8a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783444225.015509:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783444225.015516:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ead8a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783444225.015539:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444225.015547:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783444225.015550:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9367c3334d40) has no exports 00000020:00000080:1.0:1783444225.015556:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315e1 00000020:00000080:1.0:1783444225.015561:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368ff5e1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444225.015572:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff5e1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783444225.016664:0:86443:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783444225.016670:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783444225.016675:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:1.0:1783444225.016692:0:86443:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783444225.016695:0:86443:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783444225.021579:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff5e7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783444225.021634:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444225.021653:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444225.021659:0:86443:0:(genops.c:906:class_export_put()) final put ffff9367c2299000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444225.021663:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c2299000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783444225.021677:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444225.023018:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315cc 00000020:00000080:1.0:1783444225.023030:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368cb780000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783444225.023049:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783444225.023446:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cb780000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783444225.023463:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444225.023476:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783444225.023480:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9367c33319c0) has no exports 00000020:00000080:1.0:1783444225.023489:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315be 00000020:00000080:1.0:1783444225.023494:0:86443:0:(genops.c:906:class_export_put()) final put ffff9367c5030800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444225.023508:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5030800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783444225.025467:0:86443:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783444225.025475:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783444225.025479:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969447 gen 5 00000004:00080000:1.0:1783444225.025498:0:86443:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783444225.025501:0:86443:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783444225.025534:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c5032000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783444225.025575:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444225.025587:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444225.025592:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368ea60e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444225.025595:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea60e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783444225.025601:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783444225.026294:0:86443:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783444225.026305:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315b0 00000020:00000080:1.0:1783444225.026313:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368dd20d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783444225.026322:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783444225.026331:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd20d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783444225.026344:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444225.026616:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783444225.026621:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9367c3333380) has no exports 00000020:00000080:1.0:1783444225.026630:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38315a9 00000020:00000080:1.0:1783444225.026635:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368cb781000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444225.026650:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cb781000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783444225.027845:0:86443:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783444225.027852:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783444225.027869:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783444225.027876:0:86443:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444225.027900:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c229d000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783444225.027940:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444225.027951:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444225.027955:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368dd11e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444225.027958:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd11e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783444225.027970:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444225.028084:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444225.028089:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444225.028092:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368dd11a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444225.028095:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd11a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783444225.028099:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444225.028158:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383156a 00000020:00000080:0.0:1783444225.028164:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368dd1ef000/lustre-MDD0000_UUID 00000020:01000000:0.0:1783444225.028172:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783444225.028179:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1ef000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783444225.028189:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444225.028193:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783444225.028197:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9368f8f1cd40) has no exports 00000020:00000080:0.0:1783444225.028215:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444225.028219:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444225.028222:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368dd209000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783444225.028224:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd209000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783444225.028228:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444225.028258:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831571 00000020:00000080:0.0:1783444225.028262:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368dd1ec000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444225.028274:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1ec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783444225.028296:0:86443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ef0cb000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783444225.028300:0:86443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ef0cb000 3 00000020:01000004:0.0:1783444225.028445:0:86443:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368ef0cb000 from lustre-MDT0000 00000020:00000080:0.0:1783444225.028468:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444225.028473:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783444225.028477:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368eaf3e000/lustre-MDT0000_UUID 00000020:00000080:0.0:1783444225.028479:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eaf3e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783444225.028485:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783444225.028518:0:86443:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783444225.028522:0:86443:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783444225.028525:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783444225.028528:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444225.028531:0:86443:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783444225.028537:0:86443:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9368ca0f8000 c89ab73b-dbb2-4305-b221-37cc64d61227 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444225.028546:0:86443:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9368ff64d000 fea1b1de-aca2-4501-86bf-fe28138c0593 192.168.204.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444225.028550:0:86443:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff9368c50799c0) has exports, disconnecting them 00000020:00080000:0.0:1783444225.028555:0:86443:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9368ca0f8000), last request at 1783444189 00000020:00000080:0.0:1783444225.028572:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831516 00000020:00010000:0.0:1783444225.028577:0:86443:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368ca0f8000: total 0 00000100:00080000:0.0:1783444225.028581:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9368ca0fe000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444225.028606:0:86443:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368ca0f8000): rc 0 00000020:00080000:0.0:1783444225.028610:0:86443:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.20@tcp (ffff9368ff64d000), last request at 1783444188 00000020:00000080:0.0:1783444225.028658:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383150f 00000020:00010000:0.0:1783444225.028661:0:86443:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368ff64d000: total 0 00000100:00080000:0.0:1783444225.028664:0:86443:0:(import.c:65:import_set_state_nolock()) ffff9368ff64f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444225.028694:0:86443:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368ff64d000): rc 0 00000020:00080000:0.0:1783444225.028699:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9368c50799c0) has no exports 00000100:00100000:0.0:1783444225.028910:0:85127:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9368c5084c00:85127] 0 exiting: rc = 1 00000020:00010000:3.0:1783444225.029259:0:6494:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368ca0f8000: total 0 00010000:00010000:3.0:1783444225.029315:0:6494:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368ca0f8000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783444225.029346:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04200/0x42cb6883e38316ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38316b3 expref: 14 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029362:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04000/0x42cb6883e38316c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38316c1 expref: 13 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029372:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a55c00/0x42cb6883e38316d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38316cf expref: 12 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029382:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583fe00/0x42cb6883e3831666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383165f expref: 11 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029394:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05600/0x42cb6883e38316e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38316dd expref: 10 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029404:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583f400/0x42cb6883e3831674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383166d expref: 9 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029415:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26200/0x42cb6883e38316f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38316eb expref: 8 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029424:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a55600/0x42cb6883e3831682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383167b expref: 7 pid: 85128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029445:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04400/0x42cb6883e3831700 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38316f9 expref: 6 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029458:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583ec00/0x42cb6883e3831690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831689 expref: 5 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029471:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26e00/0x42cb6883e38316ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38316a5 expref: 4 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029480:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04c00/0x42cb6883e383170e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831707 expref: 3 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029488:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583f000/0x42cb6883e383169e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831697 expref: 2 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029497:0:6494:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368ca0f8000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1783444225.029515:0:6494:0:(genops.c:906:class_export_put()) final put ffff9368ca0f8000/c89ab73b-dbb2-4305-b221-37cc64d61227 00000020:00010000:3.0:1783444225.029526:0:6494:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368ff64d000: total 1 00010000:00010000:3.0:1783444225.029544:0:6494:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368ff64d000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1783444225.029560:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05000/0x42cb6883e383164a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a41 expref: 5 pid: 85132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029571:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26c00/0x42cb6883e3831643 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a3a expref: 4 pid: 85129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029581:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a55200/0x42cb6883e3831635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a2c expref: 3 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029593:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6a54200/0x42cb6883e383163c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a33 expref: 2 pid: 85127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444225.029610:0:6494:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368ff64d000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1783444225.029622:0:6494:0:(genops.c:906:class_export_put()) final put ffff9368ff64d000/fea1b1de-aca2-4501-86bf-fe28138c0593 00010000:00010000:3.0:1783444225.029628:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444225.029630:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444225.029632:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444225.029676:0:85128:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9369005b4e00:85128] 1 exiting: rc = 0 00000020:00000080:3.0:1783444225.030238:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ca0f8000/c89ab73b-dbb2-4305-b221-37cc64d61227 for MGS 00000020:00000080:3.0:1783444225.030265:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff64d000/fea1b1de-aca2-4501-86bf-fe28138c0593 for MGS 00000020:00000080:3.0:1783444225.030279:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ca0fe000 for MGS 00000020:00000080:3.0:1783444225.030284:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff64f800 for MGS 00010000:00010000:2.0:1783444225.030512:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444225.030545:0:85132:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9368dd29ae00:85132] 3 exiting: rc = 0 00000100:00100000:3.0:1783444225.032652:0:85129:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9367c31eb200:85129] 2 exiting: rc = 0 00000100:00100000:0.0:1783444225.034538:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034558:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034565:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034570:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034592:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034599:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034605:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034610:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034616:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034623:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034628:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.034633:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035640:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035654:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035660:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035666:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035694:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035700:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035705:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035711:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035716:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035731:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035737:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035742:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035747:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035753:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035758:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035763:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035768:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035773:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035779:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035804:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035821:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035826:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035834:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035840:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035846:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035852:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035858:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035873:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035879:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035885:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035893:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035899:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035904:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035910:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035916:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035922:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035927:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035933:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035938:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035944:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035950:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035954:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035960:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035966:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035970:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035975:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035982:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035987:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035993:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.035998:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.036003:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444225.036010:0:86443:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1783444225.038649:0:86443:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c4c3dcc0 - data ffff9368f63d7798/ffff9367c21e1400 00000020:01000000:0.0:1783444225.039097:0:86443:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c7757420 - data ffff9368ffb1e000/ffff9368c71ed400 00000020:00000080:0.0:1783444225.042085:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831508 00000020:00000080:0.0:1783444225.042101:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368ea5f1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444225.042351:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea5f1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783444225.042437:0:86443:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ef0cb000 from MGS, refs=2 00000020:01000004:0.0:1783444225.042441:0:86443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ef0cb000 2 00000020:01000004:0.0:1783444225.042444:0:86443:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368ef0cb000 from MGS 00000020:00000080:0.0:1783444225.042473:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444225.042499:0:86443:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1783444225.042502:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368ea5f7800/MGS 00000020:00000080:0.0:1783444225.042505:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea5f7800/MGS for MGS 00000020:01000000:0.0:1783444225.042510:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1783444225.042604:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783444225.042608:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444225.042617:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783444225.042623:0:86443:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9367c6ab2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444225.042628:0:86443:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9368c507cd40) has exports, disconnecting them 00000020:00080000:0.0:1783444225.042633:0:86443:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9367c6ab2000), last request at 1783444189 00000020:00000080:0.0:1783444225.042637:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831627 00000020:00080000:0.0:1783444225.042646:0:86443:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367c6ab2000): rc 0 00000020:00000080:0.0:1783444225.043180:0:86443:0:(genops.c:906:class_export_put()) final put ffff9367c6ab2000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783444225.043213:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c6ab2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783444225.084862:0:86443:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783444225.084872:0:86443:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783444225.084877:0:86443:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783444225.084886:0:86443:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783444225.085190:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444225.085205:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783444225.085213:0:86443:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ef0cb000 1 00000020:00000080:1.0:1783444225.085220:0:86443:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38314fa 00000020:00000080:1.0:1783444225.085229:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368ea5f4800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783444225.085234:0:86443:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783444225.085239:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444225.085244:0:86443:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783444225.085258:0:86443:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9368f8f199c0) has no exports 00000020:00000080:1.0:1783444225.089197:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c6a4f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783444225.089222:0:54930:0:(genops.c:906:class_export_put()) final put ffff9368ff57f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783444225.089225:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff57f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783444225.089240:0:54930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783444225.089596:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea5f4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000400:00000100:1.0:1783444225.101480:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557756032 offset 0 length 224: 4 00000100:00100000:1.0:1783444225.101531:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444225.101576:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444225.101610:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444225.101642:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444225.101672:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557756288 00000100:00100000:1.0:1783444225.101700:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557756288 00000100:00100000:1.0:1783444225.101772:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557756160 00000100:00100000:1.0:1783444225.101775:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557756160 00000100:00100000:1.0:1783444225.101814:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 828 00000100:00100000:1.0:1783444225.101826:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557756288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444225.101900:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557756288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444225.101908:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 828 00000100:00100000:1.0:1783444225.101929:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1092 00000100:00100000:1.0:1783444225.101935:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1870073557756160:12345-192.168.204.20@tcp:400:kworker.0 00000020:00080000:1.0:1783444225.101942:0:71469:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.20@tcp 00000100:00100000:1.0:1783444225.101969:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1870073557756160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (358us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783444225.101975:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1092 00000100:00080000:2.0:1783444225.104087:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444225.104982:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557756544 00000100:00100000:0.0:1783444225.104995:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557756544 00000100:00100000:0.0:1783444225.105089:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557756416 00000100:00100000:0.0:1783444225.105093:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557756416 00000100:00080000:3.0:1783444225.105166:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444225.105170:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444225.105248:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2283 00000100:00100000:0.0:1783444225.105259:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557756544:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444225.105349:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557756544:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 92us (3771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444225.105365:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2283 00000100:00100000:0.0:1783444225.105382:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2284 00000100:00100000:0.0:1783444225.105389:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e79df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557756416:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444225.105414:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e79df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557756416:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444225.105420:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2284 00000100:00100000:1.0:1783444225.113617:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444225.115341:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557756672 00000100:00100000:3.0:1783444225.115433:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557756672 00000100:00100000:3.0:1783444225.115537:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1093 00000100:00100000:3.0:1783444225.115547:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557756672:12345-192.168.204.20@tcp:38:ptlrpcd_01_00.0 00010000:00020000:3.0:1783444225.115578:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444225.115687:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557756672:12345-192.168.204.20@tcp:38:ptlrpcd_01_00.0 Request processed in 128us (2071us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444225.115696:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1093 00000020:00000080:3.0:1783444225.240240:0:86443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783444225.240258:0:86443:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783444225.240265:0:86443:0:(genops.c:906:class_export_put()) final put ffff9368ef0cc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444225.240270:0:86443:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0cc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783444225.240282:0:86443:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783444225.240428:0:86443:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9368ef0cd000 00000020:02000400:3.0:1783444225.240498:0:86443:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1783444225.308932:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575222272:0@lo:400:kworker.0 00000400:00000100:2.0:1783444225.309004:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575222272 offset 0 length 224: 4 00000100:00100000:3.0:1783444225.309008:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575222400:0@lo:400:kworker.0 00000100:00100000:3.0:1783444225.309054:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444225.309122:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575222400 00000100:00100000:0.0:1783444225.309129:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575222400 00000100:00100000:0.0:1783444225.309180:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1783444225.309188:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1870073575222400:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444225.309196:0:66226:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783444225.309302:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575222528:0@lo:400:kworker.0 00000100:00100000:2.0:1783444225.309331:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444225.309361:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575222528 00000100:00100000:2.0:1783444225.309365:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575222528 00000100:00100000:2.0:1783444225.309409:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1783444225.309416:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575222528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444225.309482:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575222528:12345-0@lo:400:kworker.0 Request processed in 65us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444225.309489:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1783444225.309534:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575222528:0@lo:400:kworker.0 00000100:00100000:0.0:1783444225.309669:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1870073575222400:12345-0@lo:400:kworker.0 Request processed in 479us (614us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444225.309688:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1783444225.310706:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575223040:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.310746:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.310772:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444225.310777:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575222912:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.310822:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.310848:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575222912 00000100:00100000:1.0:1783444225.310853:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575222912 00000100:00100000:1.0:1783444225.310880:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:1.0:1783444225.310885:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3634:x1870073575222912:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783444225.310892:0:29151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783444225.310922:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3634:x1870073575222912:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783444225.310928:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00080000:1.0:1783444225.310960:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444225.310965:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783444225.310969:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783444225.310974:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444225.310978:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3185 00000100:00080000:1.0:1783444225.310983:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444225.311003:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5099f80 x1870073575223424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444225.311023:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575222912:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.311045:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575223424:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783444225.311067:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.311091:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575222784:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.311120:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.311138:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575223296:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.311157:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.311174:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783444225.311179:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575222656:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.311198:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.311213:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575223168:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.311232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.311257:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575222784 00000100:00100000:1.0:1783444225.311260:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575222784 00000100:00100000:1.0:1783444225.311289:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575223296 00000100:00100000:1.0:1783444225.311291:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575223296 00000100:00100000:1.0:1783444225.311303:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575222656 00000100:00100000:1.0:1783444225.311305:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575222656 00000100:00100000:1.0:1783444225.311319:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1783444225.311325:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575222784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.311363:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575222784:12345-0@lo:400:kworker.0 Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444225.311370:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1783444225.311383:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1783444225.311387:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1870073575223296:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783444225.311392:0:67017:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783444225.311412:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1870073575223296:12345-0@lo:400:kworker.0 Request processed in 23us (254us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783444225.311418:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1783444225.311427:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1783444225.311431:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1870073575222656:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1783444225.311443:0:67017:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783444225.311479:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1870073575222656:12345-0@lo:400:kworker.0 Request processed in 46us (280us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783444225.311485:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00080000:1.0:1783444225.311520:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444225.311523:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783444225.311526:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783444225.311530:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444225.311533:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3185 00000100:00080000:1.0:1783444225.311537:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444225.311551:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5098a80 x1870073575223552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444225.311567:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575222656:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.311579:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575222784:0@lo:400:kworker.0 00000100:00080000:1.0:1783444225.311586:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444225.311589:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783444225.311592:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783444225.311594:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444225.311597:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3185 00000100:00080000:1.0:1783444225.311601:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444225.311614:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5099180 x1870073575223680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444225.311624:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575223296:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.311655:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575223552:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783444225.311689:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.311706:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575223680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783444225.311726:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444225.311750:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575223552 00000100:00100000:1.0:1783444225.311754:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575223552 00000100:00100000:1.0:1783444225.311768:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575223680 00000100:00100000:1.0:1783444225.311770:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575223680 00000100:00100000:1.0:1783444225.311782:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1783444225.311807:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575223552:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783444225.311825:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444225.311856:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575223552:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 68us (166us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444225.311861:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1783444225.311873:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1783444225.311877:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575223680:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783444225.311885:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444225.311906:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575223680:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 27us (178us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444225.311911:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00080000:1.0:1783444225.311935:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444225.311940:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444225.311943:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575223552:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1783444225.311950:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444225.311952:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444225.311962:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575223680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783444225.312051:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575223424 00000100:00100000:2.0:1783444225.312056:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575223424 00000100:00100000:2.0:1783444225.312090:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1783444225.312095:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575223424:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783444225.312105:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444225.312137:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575223424:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 41us (1069us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444225.312142:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00080000:1.0:1783444225.312301:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444225.312306:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444225.312309:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575223424:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783444225.312929:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575223040 00000100:00100000:2.0:1783444225.312935:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575223040 00000100:00100000:2.0:1783444225.312975:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575223168 00000100:00100000:2.0:1783444225.312979:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575223168 00000100:00100000:2.0:1783444225.313002:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:2.0:1783444225.313008:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575223040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444225.313060:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575223040:12345-0@lo:400:kworker.0 Request processed in 52us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444225.313066:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:2.0:1783444225.313079:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:2.0:1783444225.313085:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575223168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444225.313114:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575223168:12345-0@lo:400:kworker.0 Request processed in 29us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444225.313121:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00080000:2.0:1783444225.313137:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444225.313239:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575223040:0@lo:400:kworker.0 00000100:00100000:1.0:1783444225.313272:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575223168:0@lo:400:kworker.0 00000100:00080000:3.0:1783444225.313818:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783444225.313824:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783444225.313828:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783444225.313832:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444225.313836:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3185 00000100:00080000:3.0:1783444225.313842:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444225.313867:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff936901f34e00 x1870073575223808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444225.313889:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575222400:0@lo:400:kworker.0 00000100:00100000:0.0:1783444225.313956:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff936901f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575223808:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783444225.313994:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444225.314067:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575223808 00000100:00100000:2.0:1783444225.314072:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575223808 00000100:00100000:2.0:1783444225.314104:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1783444225.314110:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575223808:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1783444225.314135:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444225.314174:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575223808:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 63us (179us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444225.314181:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00080000:0.0:1783444225.314238:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444225.314242:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444225.314244:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff936901f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575223808:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1783444225.952720:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444226.973028:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444227.997066:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444229.020941:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444229.917041:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783444229.917065:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575224064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444229.917132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444229.917169:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575223936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444229.917191:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444229.917221:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575224064 00000100:00100000:2.0:1783444229.917227:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575223936 00000100:00100000:1.0:1783444229.917227:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575224064 00000100:00100000:2.0:1783444229.917230:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575223936 00000100:00100000:1.0:1783444229.917281:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:1.0:1783444229.917291:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575224064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444229.917323:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444229.917366:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575224064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444229.917374:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:1.0:1783444229.917423:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575224064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444229.917680:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:2.0:1783444229.917689:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575223936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444229.917705:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444229.917748:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575223936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444229.917755:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1783444229.917776:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575223936:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783444229.918667:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444229.918674:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783444230.045020:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1783444230.218463:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557756800 offset 0 length 224: 4 00000100:00100000:0.0:1783444230.218529:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444230.218647:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444230.218683:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444230.218753:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557757184 00000100:00100000:2.0:1783444230.218767:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557757184 00000100:00100000:2.0:1783444230.218928:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2287 00000100:00100000:2.0:1783444230.218942:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557757184:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444230.219071:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557757184:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 131us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444230.219080:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2287 00000100:00080000:3.0:1783444230.219657:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444230.220033:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444230.220229:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557757312 00000100:00100000:3.0:1783444230.220237:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557757312 00000100:00100000:3.0:1783444230.220297:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2288 00000100:00100000:3.0:1783444230.220308:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557757312:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444230.220374:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557757312:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 68us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444230.220382:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2288 00000100:00080000:0.0:1783444230.220652:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444230.221364:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557756928 00000100:00100000:1.0:1783444230.221387:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557756928 00000100:00100000:1.0:1783444230.221486:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557757056 00000100:00100000:1.0:1783444230.221491:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557757056 00000100:00080000:3.0:1783444230.221590:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444230.222178:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 831 00000100:00100000:2.0:1783444230.222196:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557757056:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444230.222289:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557757056:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (3604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444230.222313:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 831 00000100:00100000:2.0:1783444230.222340:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1100 00000100:00100000:2.0:1783444230.222346:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557756928:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444230.222373:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444230.222404:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557756928:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 57us (3876us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444230.222412:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1100 00000100:00080000:1.0:1783444230.429121:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444230.429131:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444230.429137:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444230.429149:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3216 00000100:00080000:1.0:1783444230.429158:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444230.429167:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444230.429200:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5099180 x1870073575224320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444230.429286:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575224320:0@lo:38:kworker.0 00000100:00100000:0.0:1783444230.429386:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444230.429485:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575224320 00000100:00100000:2.0:1783444230.429497:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575224320 00000100:00100000:2.0:1783444230.429551:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1783444230.429560:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575224320:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444230.429601:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444230.429685:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444230.429719:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575224192:0@lo:400:kworker.0 00000400:00000100:3.0:1783444230.429749:0:3633:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575224192 offset 0 length 224: 4 00000100:00080000:1.0:1783444230.430053:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444230.430057:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444230.430060:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444230.430065:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3216 00000100:00080000:1.0:1783444230.430069:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444230.430074:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444230.430092:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5098380 x1870073575224576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444230.430139:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575224448:0@lo:400:kworker.0 00000100:00100000:3.0:1783444230.430171:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444230.430211:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575224448 00000100:00100000:3.0:1783444230.430215:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575224448 00000100:00100000:3.0:1783444230.430271:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1783444230.430279:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575224448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444230.430334:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575224448:12345-0@lo:400:kworker.0 Request processed in 55us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444230.430342:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00080000:3.0:1783444230.430372:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444230.430410:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575224448:0@lo:400:kworker.0 00000100:00100000:0.0:1783444230.431280:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575224576:0@lo:38:kworker.0 00000100:00100000:0.0:1783444230.431341:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444230.431432:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575224576 00000100:00100000:3.0:1783444230.431440:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575224576 00000100:00100000:3.0:1783444230.431478:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1783444230.431485:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575224576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444230.431510:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444230.431552:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575224576:12345-0@lo:38:kworker.0 Request processed in 66us (210us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444230.431559:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1783444230.431683:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575224320:12345-0@lo:38:kworker.0 Request processed in 2121us (2296us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444230.431691:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00080000:1.0:1783444230.431939:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444230.431945:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444230.431949:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444230.431954:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3216 00000100:00080000:1.0:1783444230.431959:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444230.431964:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444230.431988:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c509a680 x1870073575224832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444230.432082:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444230.432086:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444230.432089:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444230.432093:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3216 00000100:00080000:1.0:1783444230.432096:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444230.432101:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444230.432116:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973c700 x1870073575225216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444230.432148:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575224960:0@lo:400:kworker.0 00000100:00100000:1.0:1783444230.432186:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444230.432218:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444230.432224:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575225088:0@lo:400:kworker.0 00000100:00100000:1.0:1783444230.432248:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444230.432277:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575224960 00000100:00100000:1.0:1783444230.432282:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575224960 00000100:00100000:1.0:1783444230.432317:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575225088 00000100:00100000:1.0:1783444230.432320:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575225088 00000100:00100000:1.0:1783444230.432342:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289 00000100:00100000:1.0:1783444230.432349:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575224960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444230.432398:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575224960:12345-0@lo:400:kworker.0 Request processed in 49us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444230.432405:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289 00000100:00100000:1.0:1783444230.432420:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:1.0:1783444230.432426:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575225088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444230.432451:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575225088:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444230.432463:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00100000:1.0:1783444230.432516:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575225088:0@lo:400:kworker.0 00000100:00100000:1.0:1783444230.432526:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575224960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444230.432747:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444230.432776:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575224704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444230.432842:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444230.433021:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575224704 00000100:00100000:1.0:1783444230.433026:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575224704 00000100:00100000:1.0:1783444230.433143:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:1.0:1783444230.433150:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575224704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444230.433193:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575224704:12345-0@lo:400:kworker.0 Request processed in 42us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444230.433199:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00080000:2.0:1783444230.433384:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444230.433415:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575224704:0@lo:400:kworker.0 00000100:00080000:0.0:1783444230.433504:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444230.433510:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444230.433514:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575224320:0@lo:38:kworker.0 00000100:00100000:0.0:1783444230.433543:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575224832:0@lo:38:kworker.0 00000100:00100000:0.0:1783444230.433590:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444230.433617:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575225216:0@lo:38:kworker.0 00000100:00100000:0.0:1783444230.433640:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444230.433709:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444230.433714:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444230.433718:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575224576:0@lo:38:kworker.0 00000100:00100000:1.0:1783444230.433910:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575224832 00000100:00100000:1.0:1783444230.433916:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575224832 00000100:00100000:1.0:1783444230.433955:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:1.0:1783444230.433961:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575224832:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444230.433984:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444230.434211:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575224832:12345-0@lo:38:kworker.0 Request processed in 247us (632us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444230.434219:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00080000:0.0:1783444230.434342:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444230.434347:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444230.434351:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575224832:0@lo:38:kworker.0 00000100:00100000:3.0:1783444230.434412:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575225216 00000100:00100000:3.0:1783444230.434418:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575225216 00000100:00100000:3.0:1783444230.434485:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1783444230.434491:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575225216:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444230.434503:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444230.434557:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575225216:12345-0@lo:38:kworker.0 Request processed in 65us (915us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444230.434563:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:0.0:1783444230.434630:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444230.434635:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444230.434639:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575225216:0@lo:38:kworker.0 00000001:00100000:1.0:1783444230.955236:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444230.955251:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368ead89800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444230.955290:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ead89800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783444230.955348:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ead8c800 for lustre-OST0001 00000001:00100000:2.0:1783444230.956750:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783444230.956770:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411432 is committed 00000020:00000080:2.0:1783444230.956778:0:75651:0:(genops.c:906:class_export_put()) final put ffff9368ef12e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444230.956823:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef12e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1783444230.956910:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef12e000 for lustre-MDT0001 00000001:00100000:0.0:1783444230.957057:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444230.957063:0:8415:0:(genops.c:906:class_export_put()) final put ffff9368f8ca3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444230.957088:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783444230.957123:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368f8ca6800 for lustre-OST0000 00010000:00010000:2.0:1783444231.069024:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444232.094448:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444233.123410:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444234.143232:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444235.037551:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444235.037572:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575225344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444235.037660:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444235.037705:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575225344 00000100:00100000:1.0:1783444235.037714:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575225344 00000100:00100000:1.0:1783444235.037770:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:1.0:1783444235.037781:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575225344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444235.037828:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444235.037874:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575225344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444235.037881:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00080000:1.0:1783444235.037903:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444235.037938:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575225344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444235.039651:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575225472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444235.041964:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444235.042556:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575225472 00000100:00100000:2.0:1783444235.042569:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575225472 00000100:00100000:2.0:1783444235.042684:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:2.0:1783444235.042699:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575225472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444235.042744:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444235.042890:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575225472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 187us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444235.042898:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1783444235.043229:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575225472:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783444235.043375:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783444235.165520:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1783444235.338752:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557757440 offset 0 length 224: 4 00000100:00100000:0.0:1783444235.346084:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444235.346138:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444235.346220:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444235.346315:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557757824 00000100:00100000:1.0:1783444235.346335:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557757824 00000100:00100000:0.0:1783444235.346335:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444235.346447:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557757952 00000100:00100000:1.0:1783444235.346453:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557757952 00000100:00100000:1.0:1783444235.346500:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2291 00000100:00100000:1.0:1783444235.346512:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557757824:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444235.346630:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557757824:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 120us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444235.346639:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2291 00000100:00100000:1.0:1783444235.346665:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2292 00000100:00100000:1.0:1783444235.346672:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557757952:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444235.346699:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557757952:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444235.346728:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2292 00000100:00080000:1.0:1783444235.346753:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444235.346759:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444235.350960:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557757696 00000100:00100000:3.0:1783444235.350979:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557757696 00000100:00100000:3.0:1783444235.351143:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557757568 00000100:00100000:3.0:1783444235.351148:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557757568 00000100:00100000:3.0:1783444235.351180:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 834 00000100:00100000:3.0:1783444235.351192:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557757696:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444235.351346:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557757696:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 156us (5208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444235.351355:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 834 00000100:00080000:1.0:1783444235.351356:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444235.351377:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1104 00000100:00100000:3.0:1783444235.351381:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557757568:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:3.0:1783444235.351408:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444235.351434:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557757568:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 51us (5102us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444235.351441:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1104 00000100:00080000:1.0:1783444235.549000:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444235.549007:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444235.549011:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444235.549020:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3221 00000100:00080000:1.0:1783444235.549028:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783444235.549035:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444235.549073:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973e300 x1870073575225728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444235.549105:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444235.549109:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444235.549111:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444235.549115:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3221 00000100:00080000:1.0:1783444235.549117:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783444235.549121:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444235.549133:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973f800 x1870073575225984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444235.549164:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444235.549168:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444235.549170:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444235.549173:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3221 00000100:00080000:1.0:1783444235.549190:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783444235.549194:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444235.549205:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973ed80 x1870073575226240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444235.549215:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444235.549218:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444235.549220:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444235.549223:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3221 00000100:00080000:1.0:1783444235.549225:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783444235.549229:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444235.549238:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973c000 x1870073575226368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444235.549281:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575225600:0@lo:400:kworker.0 00000400:00000100:1.0:1783444235.549334:0:3633:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575225600 offset 0 length 224: 4 00000100:00100000:1.0:1783444235.549385:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444235.549390:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575225856:0@lo:400:kworker.0 00000100:00100000:1.0:1783444235.549422:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444235.549534:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444235.549550:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575226112:0@lo:400:kworker.0 00000100:00100000:0.0:1783444235.549579:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444235.549613:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575225728:0@lo:38:kworker.0 00000100:00100000:0.0:1783444235.549635:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444235.549647:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575225984:0@lo:38:kworker.0 00000100:00100000:0.0:1783444235.549665:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444235.549676:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575226240:0@lo:38:kworker.0 00000100:00100000:0.0:1783444235.549711:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444235.549739:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575226368:0@lo:38:kworker.0 00000100:00100000:0.0:1783444235.549762:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444235.549818:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575225856 00000100:00100000:0.0:1783444235.549825:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575225856 00000100:00100000:0.0:1783444235.549865:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575226112 00000100:00100000:0.0:1783444235.549868:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575226112 00000100:00100000:0.0:1783444235.549880:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575225728 00000100:00100000:0.0:1783444235.549882:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575225728 00000100:00100000:0.0:1783444235.549890:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575225984 00000100:00100000:0.0:1783444235.549892:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575225984 00000100:00100000:0.0:1783444235.549898:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575226368 00000100:00100000:0.0:1783444235.549900:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575226368 00000100:00100000:0.0:1783444235.549910:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1783444235.549917:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575225856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444235.549962:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575225856:12345-0@lo:400:kworker.0 Request processed in 45us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444235.549969:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1783444235.549984:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1783444235.549989:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575226112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444235.550028:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575226112:12345-0@lo:400:kworker.0 Request processed in 38us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444235.550034:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1783444235.550045:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1783444235.550049:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575225728:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444235.550066:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444235.550095:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575225728:12345-0@lo:38:kworker.0 Request processed in 44us (459us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444235.550101:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1783444235.550110:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1783444235.550114:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575225984:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444235.550123:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444235.550142:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575225984:12345-0@lo:38:kworker.0 Request processed in 26us (476us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444235.550147:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1783444235.550155:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1783444235.550159:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575226368:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444235.550166:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444235.550184:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575226368:12345-0@lo:38:kworker.0 Request processed in 23us (421us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444235.550189:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1783444235.550220:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575226112:0@lo:400:kworker.0 00000100:00080000:0.0:1783444235.550245:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444235.550250:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444235.550259:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575225728:0@lo:38:kworker.0 00000100:00080000:0.0:1783444235.550269:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444235.550273:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444235.550276:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575225984:0@lo:38:kworker.0 00000100:00080000:0.0:1783444235.550283:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444235.550286:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444235.550288:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575226368:0@lo:38:kworker.0 00000100:00100000:1.0:1783444235.551436:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575226240 00000100:00100000:1.0:1783444235.551447:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575226240 00000100:00100000:1.0:1783444235.551518:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:1.0:1783444235.551525:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575226240:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444235.551543:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444235.551599:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575226240:12345-0@lo:38:kworker.0 Request processed in 73us (1886us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444235.551606:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00080000:1.0:1783444235.551639:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444235.551672:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575225856:0@lo:400:kworker.0 00000100:00080000:0.0:1783444235.552912:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444235.552922:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444235.552927:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575226240:0@lo:38:kworker.0 00010000:00010000:3.0:1783444236.189528:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444237.213358:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444238.239689:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444239.262608:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444240.157437:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444240.157461:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575226624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444240.157530:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444240.157584:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575226624 00000100:00100000:1.0:1783444240.157591:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575226624 00000100:00100000:1.0:1783444240.157639:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:1.0:1783444240.157648:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575226624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444240.157693:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444240.157735:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575226624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444240.157753:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00080000:1.0:1783444240.157774:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444240.157827:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575226624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444240.157958:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575226496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444240.157987:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444240.158030:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575226496 00000100:00100000:2.0:1783444240.158034:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575226496 00000100:00100000:2.0:1783444240.158064:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:2.0:1783444240.158073:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575226496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444240.158088:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444240.158118:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575226496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444240.158124:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00080000:2.0:1783444240.158140:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444240.158160:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575226496:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444240.286194:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444240.463835:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:1.0:1783444240.463866:0:3626:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557758080 offset 0 length 224: 4 00000100:00100000:2.0:1783444240.463867:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557758336 00000100:00100000:1.0:1783444240.463884:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444240.463900:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557758336 00000100:00100000:1.0:1783444240.463905:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444240.463929:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444240.463949:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557758208 00000100:00100000:1.0:1783444240.463953:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557758208 00000100:00100000:2.0:1783444240.463964:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 837 00000100:00100000:2.0:1783444240.463980:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557758336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444240.464086:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557758336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 113us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444240.464200:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1108 00000100:00100000:1.0:1783444240.464207:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557758208:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:1.0:1783444240.464230:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444240.464268:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557758208:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 60us (382us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444240.464276:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1108 00000100:00100000:1.0:1783444240.464305:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557758464 00000100:00100000:1.0:1783444240.464309:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557758464 00000100:00100000:1.0:1783444240.464338:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557758592 00000100:00100000:1.0:1783444240.464341:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557758592 00000100:00100000:1.0:1783444240.464365:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5856 00000100:00100000:1.0:1783444240.464372:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2400:x1870073557758464:12345-192.168.204.20@tcp:9:kworker.0 00000100:00100000:0.0:1783444240.464556:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5857 00000100:00100000:0.0:1783444240.464565:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2400:x1870073557758592:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1783444240.464584:0:8421:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831953 00000100:00080000:0.0:1783444240.464593:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9368dd11f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783444240.464638:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969451 00000100:00100000:0.0:1783444240.464768:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+2:2400:x1870073557758592:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 203us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444240.464775:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5857 00000020:00000080:1.0:1783444240.465212:0:26210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383194c 00000100:00080000:1.0:1783444240.465220:0:26210:0:(import.c:65:import_set_state_nolock()) ffff9368c92d0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783444240.465252:0:26210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969447 00000100:00100000:1.0:1783444240.465336:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:778015c5-4969-44f5-82a5-0f6eadd152d5+2:2400:x1870073557758464:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 963us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444240.465344:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5856 00010000:00010000:1.0:1783444240.465376:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444240.466745:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444240.466811:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 837 00000100:00080000:2.0:1783444240.466851:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444240.466856:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444240.466859:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444240.668975:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444240.668982:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444240.668985:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444240.668993:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3226 00000100:00080000:1.0:1783444240.668998:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783444240.669005:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444240.669027:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973ed80 x1870073575226880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444240.669070:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444240.669080:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444240.669082:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444240.669086:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3226 00000100:00080000:1.0:1783444240.669089:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783444240.669093:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444240.669106:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973f800 x1870073575227136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444240.669121:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444240.669124:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444240.669126:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444240.669129:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3226 00000100:00080000:1.0:1783444240.669131:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783444240.669134:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444240.669144:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973dc00 x1870073575227392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444240.669152:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444240.669155:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444240.669156:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444240.669159:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3226 00000100:00080000:1.0:1783444240.669161:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783444240.669164:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444240.669172:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973c700 x1870073575227520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444240.669391:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575226880:0@lo:38:kworker.0 00000100:00100000:1.0:1783444240.669404:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575226752:0@lo:400:kworker.0 00000100:00100000:2.0:1783444240.669484:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575227264:0@lo:400:kworker.0 00000100:00100000:3.0:1783444240.669718:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444240.669760:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575227136:0@lo:38:kworker.0 00000100:00100000:3.0:1783444240.669784:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444240.669841:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575227392:0@lo:38:kworker.0 00000100:00100000:3.0:1783444240.669876:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444240.669896:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575227520:0@lo:38:kworker.0 00000100:00100000:3.0:1783444240.669918:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444240.669953:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575227008:0@lo:400:kworker.0 00000100:00100000:3.0:1783444240.669981:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444240.670027:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575227392 00000100:00100000:3.0:1783444240.670036:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575227392 00000100:00100000:3.0:1783444240.670072:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:3.0:1783444240.670079:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575227392:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444240.670103:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444240.670146:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575227392:12345-0@lo:38:kworker.0 Request processed in 65us (268us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444240.670153:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00100000:3.0:1783444240.670173:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575226880 00000100:00100000:3.0:1783444240.670176:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575226880 00000100:00100000:3.0:1783444240.670195:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575227136 00000100:00100000:3.0:1783444240.670198:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575227136 00000100:00100000:3.0:1783444240.670211:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575227520 00000100:00100000:3.0:1783444240.670213:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575227520 00000100:00100000:3.0:1783444240.670221:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575227008 00000100:00100000:3.0:1783444240.670223:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575227008 00000100:00100000:3.0:1783444240.670254:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1783444240.670260:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57cf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575227008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444240.670304:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57cf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575227008:12345-0@lo:400:kworker.0 Request processed in 44us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444240.670310:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1783444240.670322:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1783444240.670333:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575226880:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444240.670344:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444240.670370:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575226880:12345-0@lo:38:kworker.0 Request processed in 35us (652us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444240.670375:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1783444240.670400:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1783444240.670405:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575227136:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444240.670413:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444240.670436:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575227136:12345-0@lo:38:kworker.0 Request processed in 30us (651us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444240.670442:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1783444240.670452:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1783444240.670455:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575227520:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444240.670464:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444240.670487:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575227520:12345-0@lo:38:kworker.0 Request processed in 29us (567us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444240.670492:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1783444240.671829:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575227008:0@lo:400:kworker.0 00000100:00080000:3.0:1783444240.671870:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444240.671875:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444240.671878:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575226880:0@lo:38:kworker.0 00000100:00080000:3.0:1783444240.671886:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444240.671890:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444240.671892:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575227136:0@lo:38:kworker.0 00000100:00080000:3.0:1783444240.671915:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444240.671919:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444240.671922:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575227392:0@lo:38:kworker.0 00000100:00080000:3.0:1783444240.671930:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444240.671933:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444240.671936:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575227520:0@lo:38:kworker.0 00000100:00100000:2.0:1783444240.675013:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444240.675127:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575227264 00000100:00100000:2.0:1783444240.675136:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575227264 00000100:00100000:2.0:1783444240.675653:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:2.0:1783444240.675667:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575227264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444240.675737:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575227264:12345-0@lo:400:kworker.0 Request processed in 74us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444240.675745:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000400:00000100:1.0:1783444240.680061:0:3634:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575226752 offset 0 length 224: 4 00000100:00080000:2.0:1783444240.680282:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444240.680336:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575227264:0@lo:400:kworker.0 00010000:00010000:2.0:1783444241.310939:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1783444241.486878:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557758720 offset 0 length 520: 4 00000100:00100000:0.0:1783444241.486919:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444241.486951:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444241.487052:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557758848 00000100:00100000:2.0:1783444241.487062:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557758848 00000100:00100000:2.0:1783444241.487102:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557758976 00000100:00100000:2.0:1783444241.487105:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557758976 00000100:00100000:2.0:1783444241.487151:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 840 00000100:00100000:2.0:1783444241.487162:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557758976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444241.487262:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557758976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444241.487270:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 840 00000100:00100000:2.0:1783444241.487288:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1112 00000100:00100000:2.0:1783444241.487292:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557758848:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444241.487315:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444241.487537:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557758848:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 241us (616us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444241.487544:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1112 00000100:00000400:2.0:1783444241.692906:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444225/real 1783444225] req@ffff9367c5098700 x1870073575222272/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444241 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444241.692942:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9367c5098700 x1870073575222272/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444241 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444241.692951:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783444241.692956:0:3636:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1783444241.692960:0:3636:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783444241.692962:0:3636:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783444241.692966:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c5098700 x1870073575222272/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444241 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444241.692975:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c5099c00 x1870073575224192/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444246 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444241.693039:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368f973c380 x1870073575225600/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444251 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444241.693049:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368f973f480 x1870073575226752/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444256 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783444241.693077:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783444241.693080:0:3636:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783444241.693081:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783444241.693084:0:3636:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1783444241.693103:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575222272:0@lo:400:kworker.0 00000100:00080000:2.0:1783444241.693147:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444241.693152:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783444241.693155:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444241.693160:0:80542:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3180 00000100:00080000:2.0:1783444241.693170:0:80542:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444241.693199:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f4000 x1870073575227648/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444241.693218:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575226752:0@lo:400:kworker.0 00000100:00080000:2.0:1783444241.693222:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444241.693227:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444241.693229:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444241.693233:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3231 00000100:00080000:2.0:1783444241.693237:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444241.693242:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444241.693259:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f7100 x1870073575227776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444241.693289:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444241.693293:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444241.693294:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444241.693298:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3231 00000100:00080000:2.0:1783444241.693300:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444241.693312:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444241.693344:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f4700 x1870073575228032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444241.693373:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444241.693377:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444241.693378:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444241.693382:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3231 00000100:00080000:2.0:1783444241.693384:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444241.693388:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444241.693402:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f6680 x1870073575228288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444241.693407:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575228160:0@lo:400:kworker.0 00000100:00080000:2.0:1783444241.693443:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444241.693447:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444241.693449:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444241.693453:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3231 00000100:00080000:2.0:1783444241.693455:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444241.693460:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444241.693473:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5098700 x1870073575228672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444241.693483:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444241.693505:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575227648:0@lo:250:kworker.0 00000100:00100000:1.0:1783444241.693524:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444241.693533:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575227904:0@lo:400:kworker.0 00000400:00000100:2.0:1783444241.693537:0:3632:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575227648 offset 0 length 520: 4 00000100:00100000:1.0:1783444241.693570:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444241.693572:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575227776:0@lo:38:kworker.0 00000100:00100000:2.0:1783444241.693608:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444241.693623:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575228160 00000100:00100000:1.0:1783444241.693631:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575228160 00000100:00100000:2.0:1783444241.693632:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575228032:0@lo:38:kworker.0 00000100:00100000:1.0:1783444241.693683:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575227904 00000100:00100000:2.0:1783444241.693687:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444241.693688:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575227904 00000100:00100000:1.0:1783444241.693712:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575227776 00000100:00100000:2.0:1783444241.693715:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575228288:0@lo:38:kworker.0 00000100:00100000:1.0:1783444241.693716:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575227776 00000100:00100000:1.0:1783444241.693727:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575228032 00000100:00100000:1.0:1783444241.693730:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575228032 00000100:00100000:1.0:1783444241.693744:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:2.0:1783444241.693749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444241.693755:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575228160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444241.693773:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575228672:0@lo:38:kworker.0 00000100:00100000:1.0:1783444241.693848:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575228160:12345-0@lo:400:kworker.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444241.693850:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444241.693860:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1783444241.693879:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575228672 00000100:00100000:1.0:1783444241.693882:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575228672 00000100:00100000:2.0:1783444241.693887:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575228416:0@lo:400:kworker.0 00000100:00100000:1.0:1783444241.693895:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1783444241.693903:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575227904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444241.693919:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444241.693946:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444241.693952:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575227904:12345-0@lo:400:kworker.0 Request processed in 49us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444241.693956:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575228544:0@lo:400:kworker.0 00000100:00100000:1.0:1783444241.693961:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1783444241.693992:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1783444241.693996:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444241.694010:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575227776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444241.694031:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444241.694034:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1783444241.694041:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575228032:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444241.694055:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444241.694072:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575227776:12345-0@lo:38:kworker.0 Request processed in 71us (463us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444241.694079:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1783444241.694098:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1783444241.694099:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575228032:12345-0@lo:38:kworker.0 Request processed in 53us (410us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444241.694106:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575228672:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783444241.694111:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1783444241.694141:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575228416 00000100:00100000:2.0:1783444241.694145:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575228416 00000100:00100000:2.0:1783444241.694180:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575228544 00000100:00100000:2.0:1783444241.694183:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575228544 00000100:00100000:2.0:1783444241.694210:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:2.0:1783444241.694218:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575228416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444241.694256:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575228416:12345-0@lo:400:kworker.0 Request processed in 40us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444241.694262:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00100000:2.0:1783444241.694276:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:2.0:1783444241.694292:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575228544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444241.694325:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575228544:12345-0@lo:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444241.694331:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:2.0:1783444241.694406:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575228544:0@lo:400:kworker.0 00000100:00100000:2.0:1783444241.694417:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575228416:0@lo:400:kworker.0 00010000:00020000:1.0:1783444241.694556:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444241.694594:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575228672:12345-0@lo:38:kworker.0 Request processed in 480us (739us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444241.694600:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1783444241.694629:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575228288 00000100:00100000:1.0:1783444241.694633:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575228288 00000100:00100000:1.0:1783444241.694719:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:1.0:1783444241.694723:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575228288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444241.694732:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444241.694757:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575228288:12345-0@lo:38:kworker.0 Request processed in 33us (1009us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444241.694762:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:1.0:1783444241.694841:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575227904:0@lo:400:kworker.0 00000100:00100000:1.0:1783444241.694852:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575228160:0@lo:400:kworker.0 00000100:00080000:1.0:1783444241.694879:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444241.694884:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444241.694894:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575227776:0@lo:38:kworker.0 00000100:00080000:1.0:1783444241.694906:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444241.694910:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444241.695005:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575228032:0@lo:38:kworker.0 00000100:00080000:1.0:1783444241.695027:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444241.695032:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444241.695038:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575228288:0@lo:38:kworker.0 00000100:00080000:1.0:1783444241.695055:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444241.695059:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444241.695064:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575228672:0@lo:38:kworker.0 00000100:00100000:3.0:1783444241.696580:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575224192:0@lo:400:kworker.0 00000100:00100000:3.0:1783444241.696616:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575225600:0@lo:400:kworker.0 00010000:00010000:0.0:1783444242.335770:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444243.357908:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444244.382006:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444245.279890:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444245.279918:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575228800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444245.279990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444245.280040:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575228800 00000100:00100000:1.0:1783444245.280047:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575228800 00000100:00100000:1.0:1783444245.280107:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:1.0:1783444245.280117:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575228800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444245.280149:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444245.280194:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575228800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444245.280203:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00080000:1.0:1783444245.280229:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444245.280267:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575228800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444245.286676:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444245.286702:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575228928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444245.286773:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444245.286838:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575228928 00000100:00100000:2.0:1783444245.286846:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575228928 00000100:00100000:2.0:1783444245.286902:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:2.0:1783444245.286914:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575228928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444245.286944:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444245.286989:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575228928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444245.286996:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00080000:2.0:1783444245.287017:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444245.287057:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575228928:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783444245.414526:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444245.516902:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444245.516951:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444245.517142:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557759104 00000100:00100000:1.0:1783444245.517152:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557759104 00000100:00100000:1.0:1783444245.517241:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557759232 00000100:00100000:1.0:1783444245.517245:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557759232 00000100:00080000:3.0:1783444245.519347:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444245.520255:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 843 00000100:00100000:1.0:1783444245.520286:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557759232:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444245.520449:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557759232:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 179us (3496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444245.520458:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 843 00000100:00100000:1.0:1783444245.520486:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1116 00000100:00100000:1.0:1783444245.520491:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557759104:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:1.0:1783444245.520514:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444245.520542:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557759104:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 49us (3651us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444245.520548:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1116 00000001:00100000:3.0:1783444245.796962:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:3.0:1783444245.796973:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368dd11c000/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:3.0:1783444245.797000:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd11c000/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-OST0001 00000020:00000080:3.0:1783444245.797035:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd11f800 for lustre-OST0001 00000001:00100000:0.0:1783444245.797122:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444245.797127:0:8415:0:(genops.c:906:class_export_put()) final put ffff9368c92d7800/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444245.797143:0:84624:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c92d7800/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-OST0000 00000020:00000080:0.0:1783444245.797163:0:84624:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c92d0800 for lustre-OST0000 00010000:00010000:0.0:1783444246.431574:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444246.540675:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444246.540786:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444246.540846:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557759488 00000100:00100000:1.0:1783444246.540848:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557759360 00000100:00100000:2.0:1783444246.540859:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557759488 00000100:00100000:1.0:1783444246.540860:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557759360 00000100:00100000:2.0:1783444246.540931:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 844 00000100:00100000:2.0:1783444246.540944:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557759488:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444246.541088:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557759488:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 146us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444246.541115:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1117 00000100:00100000:0.0:1783444246.541130:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557759360:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444246.541157:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444246.541191:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557759360:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 61us (406us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444246.542245:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 844 00000100:00100000:0.0:1783444246.542417:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1117 00000100:00080000:2.0:1783444246.813924:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444246.813940:0:80542:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444246.813944:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444246.813949:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444246.813954:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444246.813966:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3232 00000100:00080000:2.0:1783444246.813972:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444246.813981:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444246.814036:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5098a80 x1870073575229056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444246.814108:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444246.814112:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444246.814114:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444246.814117:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3232 00000100:00080000:2.0:1783444246.814121:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444246.814125:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444246.814139:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5098700 x1870073575229312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444246.814158:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444246.814161:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444246.814172:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444246.814176:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3232 00000100:00080000:2.0:1783444246.814179:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444246.814183:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444246.814199:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f4700 x1870073575229568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444246.814239:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444246.814243:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444246.814245:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444246.814248:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3232 00000100:00080000:2.0:1783444246.814251:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444246.814255:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444246.814277:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32f6300 x1870073575229952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444246.814316:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575229184:0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.814413:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444246.814466:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444246.814473:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575229440:0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.814497:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444246.814529:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575229696:0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.814560:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444246.814582:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444246.814588:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575229824:0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.814613:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444246.814656:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575229184 00000100:00100000:2.0:1783444246.814673:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575229184 00000100:00100000:2.0:1783444246.814736:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575229440 00000100:00100000:2.0:1783444246.814740:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575229440 00000100:00100000:2.0:1783444246.814774:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1783444246.814785:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575229184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.814878:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575229184:12345-0@lo:400:kworker.0 Request processed in 93us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444246.814887:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1783444246.814908:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:2.0:1783444246.814916:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575229440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.814944:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575229440:12345-0@lo:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444246.814950:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:2.0:1783444246.814972:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575229696 00000100:00100000:2.0:1783444246.814975:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575229696 00000100:00100000:2.0:1783444246.815004:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575229824 00000100:00100000:2.0:1783444246.815008:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575229824 00000100:00100000:2.0:1783444246.815027:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:2.0:1783444246.815034:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575229696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.815072:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575229696:12345-0@lo:400:kworker.0 Request processed in 39us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444246.815079:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:2.0:1783444246.815090:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:2.0:1783444246.815096:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575229824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.815124:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575229824:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444246.815130:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00080000:2.0:1783444246.815161:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444246.815213:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575229824:0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.815227:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575229696:0@lo:400:kworker.0 00000100:00100000:1.0:1783444246.815450:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575229056:0@lo:38:kworker.0 00000100:00100000:1.0:1783444246.815490:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444246.815526:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575229312:0@lo:38:kworker.0 00000100:00100000:1.0:1783444246.815549:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444246.815572:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575229568:0@lo:38:kworker.0 00000100:00100000:1.0:1783444246.815598:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444246.815619:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575229952:0@lo:38:kworker.0 00000100:00100000:1.0:1783444246.815645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444246.815676:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575229056 00000100:00100000:1.0:1783444246.815680:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575229056 00000100:00100000:1.0:1783444246.815713:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575229312 00000100:00100000:1.0:1783444246.815716:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575229312 00000100:00100000:1.0:1783444246.815724:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575229952 00000100:00100000:1.0:1783444246.815726:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575229952 00000100:00100000:1.0:1783444246.815738:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1783444246.815743:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575229056:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444246.815768:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444246.815830:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575229056:12345-0@lo:38:kworker.0 Request processed in 85us (339us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444246.815836:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1783444246.815854:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1783444246.815858:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575229312:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444246.815868:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444246.815895:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575229312:12345-0@lo:38:kworker.0 Request processed in 35us (345us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444246.815901:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1783444246.815913:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1783444246.815917:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575229952:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444246.815926:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444246.815951:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575229952:12345-0@lo:38:kworker.0 Request processed in 32us (306us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444246.815957:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1783444246.815993:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575229568 00000100:00100000:1.0:1783444246.815997:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575229568 00000100:00100000:1.0:1783444246.816022:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:1.0:1783444246.816027:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575229568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444246.816037:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444246.816070:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575229568:12345-0@lo:38:kworker.0 Request processed in 42us (471us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444246.816078:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00080000:1.0:1783444246.816108:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444246.816113:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444246.816116:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575229056:0@lo:38:kworker.0 00000100:00080000:1.0:1783444246.816124:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444246.816127:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444246.816130:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575229312:0@lo:38:kworker.0 00000100:00080000:1.0:1783444246.816136:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444246.816140:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444246.816143:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575229568:0@lo:38:kworker.0 00000100:00080000:1.0:1783444246.816150:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444246.816153:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444246.816156:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575229952:0@lo:38:kworker.0 00000100:00100000:2.0:1783444246.816304:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575229440:0@lo:400:kworker.0 00000100:00100000:2.0:1783444246.816323:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575229184:0@lo:400:kworker.0 00000020:01000004:3.0:1783444246.916549:0:87061:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783444246.916558:0:87061:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783444246.916559:0:87061:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783444246.916713:0:87061:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9367c3a05800 00000020:01000004:3.0:1783444246.916741:0:87061:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783444246.916758:0:87061:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783444246.916776:0:87061:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9368c507cd40) 00000020:00000080:3.0:1783444246.916841:0:87061:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783444247.035309:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783444247.037833:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783444247.040638:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783444247.040867:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.041192:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.041569:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783444247.042173:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.044861:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.047626:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.049202:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.049600:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783444247.049859:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.051617:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783444247.052092:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.052433:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783444247.052694:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.053165:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.053536:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783444247.053773:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.054213:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.054582:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.054868:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.055432:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.056024:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783444247.057051:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783444247.057642:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.058051:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783444247.060871:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.061578:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783444247.061983:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1783444247.064199:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1783444247.065985:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1783444247.071880:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1783444247.072458:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783444247.082027:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.082809:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1783444247.083209:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.083517:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.083873:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1783444247.084347:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783444247.084838:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.085061:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783444247.085551:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.085964:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1783444247.086345:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.086537:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783444247.086882:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.087519:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.088039:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.088241:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.089238:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.089938:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783444247.090358:0:87061:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1783444247.091543:0:87061:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783444247.092065:0:87061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783444247.092075:0:87061:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783444247.092089:0:87061:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831a9c 00000020:01000004:1.0:1783444247.092097:0:87061:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1783444247.092108:0:87061:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783444247.092113:0:87061:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9367c3a05800 from MGS 00000020:01000004:1.0:1783444247.092118:0:87061:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783444247.092128:0:87061:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9368dd0e99c0) 00000020:00000080:1.0:1783444247.092142:0:87061:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1783444247.092210:0:87061:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9367c3a05800 from MGS, refs=2 00080000:01000000:1.0:1783444247.092216:0:87061:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783444247.092240:0:87061:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831aaa 00010000:00010000:1.0:1783444247.092373:0:87061:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783444247.102503:0:87061:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783444247.106874:0:87065:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783444247.107004:0:87061:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783444247.107064:0:87061:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783444247.108409:0:87061:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783444247.108663:0:87061:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783444247.108841:0:87061:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783444247.108847:0:87061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783444247.115303:0:87061:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783444247.115417:0:87061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783444247.116219:0:87061:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783444247.116229:0:87061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783444247.117036:0:87061:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783444247.117063:0:87061:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1783444247.117064:0:87061:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1783444247.117068:0:87061:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1783444247.117074:0:87061:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 76, was 0): CONNECTING 00000100:00100000:0.0:1783444247.117146:0:87061:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:2.0:1783444247.452994:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444248.477575:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444249.502015:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444250.397271:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444250.397342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444250.399305:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575230080 00000100:00100000:1.0:1783444250.399314:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575230080 00000100:00100000:1.0:1783444250.399398:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:1.0:1783444250.399409:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575230080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444250.399441:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444250.399511:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575230080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444250.399519:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1783444250.399642:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575230208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444250.399682:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444250.399780:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444250.400648:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444250.400681:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575230208 00000100:00100000:2.0:1783444250.400686:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575230208 00000100:00080000:0.0:1783444250.401135:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444250.401173:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1783444250.401185:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575230208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444250.401223:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444250.401294:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575230208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444250.401301:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:3.0:1783444250.402905:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575230208:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783444250.525839:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444251.548970:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444251.659081:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444251.659135:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444251.659274:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557759616 00000100:00100000:1.0:1783444251.659285:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557759616 00000100:00100000:1.0:1783444251.659335:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1783444251.659344:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2400:x1870073557759616:12345-192.168.204.20@tcp:250:kworker.0 00010000:00080000:1.0:1783444251.659372:0:87066:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fea1b1de-aca2-4501-86bf-fe28138c0593@192.168.204.20@tcp t0 exp 0000000000000000 cur 3242 last 0 00000020:00000080:1.0:1783444251.659402:0:87066:0:(genops.c:1406:class_connect()) connect: client fea1b1de-aca2-4501-86bf-fe28138c0593, cookie 0x42cb6883e3831ab1 00000100:00080000:1.0:1783444251.659552:0:87066:0:(import.c:65:import_set_state_nolock()) ffff9368ff68a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444251.660066:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+5:2400:x1870073557759616:12345-192.168.204.20@tcp:250:kworker.0 Request processed in 720us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444251.660074:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1783444251.662125:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557759744 00000100:00100000:3.0:1783444251.662139:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557759744 00000100:00100000:3.0:1783444251.662262:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1121 00000100:00100000:3.0:1783444251.662286:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557759744:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:3.0:1783444251.662311:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444251.662361:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557759744:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 75us (3226us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444251.662369:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1121 00000100:00100000:1.0:1783444251.671376:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444251.672634:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557759872 00000100:00100000:0.0:1783444251.672647:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557759872 00000100:00100000:0.0:1783444251.672779:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 847 00000100:00100000:0.0:1783444251.672825:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557759872:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444251.672906:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557759872:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444251.672915:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 847 00000100:00080000:1.0:1783444251.673168:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444251.933273:0:3632:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444241/real 1783444241] req@ffff9367c32f4000 x1870073575227648/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444251 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444251.933318:0:3632:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9367c32f4000 x1870073575227648/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444251 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444251.935617:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444251.935631:0:80542:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444251.935634:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444251.935638:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444251.935642:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444251.935650:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3237 00000100:00080000:2.0:1783444251.935656:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444251.935663:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444251.935701:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018a8e00 x1870073575230336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444251.935854:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444251.935858:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444251.935860:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444251.935864:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3237 00000100:00080000:2.0:1783444251.935867:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444251.935871:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444251.935884:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018a9500 x1870073575230592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444251.935900:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444251.935903:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444251.935905:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444251.935908:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3237 00000100:00080000:2.0:1783444251.935910:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444251.935914:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444251.935923:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018a8a80 x1870073575230848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444251.935971:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444251.935974:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444251.935976:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444251.935979:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3237 00000100:00080000:2.0:1783444251.935981:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444251.935985:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444251.935994:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018abb80 x1870073575231232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444251.936162:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575230464:0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.936238:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.936280:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444251.936286:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575230720:0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.936309:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.936342:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575230464 00000100:00100000:2.0:1783444251.936350:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575230464 00000100:00100000:2.0:1783444251.936402:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575230720 00000100:00100000:2.0:1783444251.936405:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575230720 00000100:00100000:2.0:1783444251.936433:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1783444251.936442:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575230464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.936491:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575230464:12345-0@lo:400:kworker.0 Request processed in 50us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444251.936498:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1783444251.936513:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:2.0:1783444251.936520:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575230720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.936544:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575230720:12345-0@lo:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444251.936549:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:2.0:1783444251.936568:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444251.936609:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575230720:0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.936620:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575230464:0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.936664:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575231104:0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.936692:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.936716:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444251.936722:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575230976:0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.936750:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444251.937412:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575231104 00000100:00100000:1.0:1783444251.937419:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575231104 00000100:00100000:1.0:1783444251.937462:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575230976 00000100:00100000:1.0:1783444251.937466:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575230976 00000100:00100000:1.0:1783444251.937489:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:1.0:1783444251.937498:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575231104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.937523:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298 00000100:00100000:2.0:1783444251.937533:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575230976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444251.937558:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575231104:12345-0@lo:400:kworker.0 Request processed in 60us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444251.937574:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00100000:2.0:1783444251.937577:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575230976:12345-0@lo:400:kworker.0 Request processed in 45us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444251.937587:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298 00000100:00100000:1.0:1783444251.937623:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575230976:0@lo:400:kworker.0 00000100:00100000:1.0:1783444251.937634:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575231104:0@lo:400:kworker.0 00000100:00080000:3.0:1783444251.937766:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444251.937916:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783444251.937931:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575227648:0@lo:250:kworker.0 00000100:00080000:3.0:1783444251.937976:0:83732:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444251.937981:0:83732:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783444251.937983:0:83732:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444251.937988:0:83732:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3232 00000100:00080000:3.0:1783444251.937991:0:83732:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783444251.937996:0:83732:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444251.938016:0:83732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fdf80 x1870073575231360/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1783444251.938088:0:87061:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1783444251.938106:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831700 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938116:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831700 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938130:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1783444251.938151:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938161:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c583e000/0x42cb6883e38316f9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831700 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938189:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831666 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938196:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831666 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938201:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938205:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938209:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f04e00/0x42cb6883e383165f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831666 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938217:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831682 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938222:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831682 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938226:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938229:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938232:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c583e400/0x42cb6883e383167b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831682 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938239:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38316ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938255:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38316ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938259:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938263:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938267:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38316a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38316ac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938274:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38316ba expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938280:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38316ba expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938286:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938289:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938292:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e38316b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38316ba expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938299:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38316d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938305:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38316d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938309:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938311:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938314:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38316cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38316d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938330:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38316e4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938336:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38316e4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938340:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938343:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938345:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6a55000/0x42cb6883e38316dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38316e4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938352:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383170e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938357:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383170e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938362:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938365:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938368:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c583fc00/0x42cb6883e3831707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383170e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938380:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831674 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938386:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831674 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938391:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938398:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938403:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e383166d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831674 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938414:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831690 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938420:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831690 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938424:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.938427:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938430:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6a55800/0x42cb6883e3831689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831690 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938440:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383169e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938446:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383169e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938451:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444251.938454:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938457:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6a54800/0x42cb6883e3831697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383169e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938465:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38316c8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938483:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38316c8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938498:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444251.938502:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938506:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e38316c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38316c8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.938515:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38316f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.938521:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38316f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.938525:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444251.938528:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.938531:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f04800/0x42cb6883e38316eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38316f2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783444251.938545:0:87061:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 77, was 0): CONNECTING 00000100:00080000:0.0:1783444251.938549:0:87061:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1783444251.939059:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575230336:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.939110:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.939146:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575230592:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.939179:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.939202:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575230848:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.939228:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444251.939306:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575230336 00000100:00100000:3.0:1783444251.939313:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575230336 00000100:00100000:3.0:1783444251.939343:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575230592 00000100:00100000:3.0:1783444251.939346:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575230592 00000100:00100000:3.0:1783444251.939363:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1783444251.939378:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575230336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444251.939399:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444251.939437:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575230336:12345-0@lo:38:kworker.0 Request processed in 58us (327us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444251.939444:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1783444251.939466:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1783444251.939469:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575230592:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444251.939479:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444251.939503:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575230592:12345-0@lo:38:kworker.0 Request processed in 31us (333us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444251.939508:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1783444251.939602:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575231232:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.939627:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.939655:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575231360:0@lo:250:kworker.0 00000100:00100000:2.0:1783444251.939682:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783444251.939735:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444251.939740:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444251.939744:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575230336:0@lo:38:kworker.0 00000100:00080000:2.0:1783444251.939754:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444251.939758:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444251.939760:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575230592:0@lo:38:kworker.0 00000100:00100000:0.0:1783444251.939914:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575231360 00000100:00100000:0.0:1783444251.939919:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575231360 00000100:00100000:0.0:1783444251.939944:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783444251.939949:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3632:x1870073575231360:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1783444251.939966:0:87068:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo t0 exp 0000000000000000 cur 3242 last 0 00000020:00000080:0.0:1783444251.939996:0:87068:0:(genops.c:1406:class_connect()) connect: client c89ab73b-dbb2-4305-b221-37cc64d61227, cookie 0x42cb6883e3831ab8 00000100:00080000:0.0:1783444251.940119:0:87068:0:(import.c:65:import_set_state_nolock()) ffff9368c518e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444251.940161:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+5:3632:x1870073575231360:12345-0@lo:250:kworker.0 Request processed in 211us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444251.940181:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783444251.940292:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 10000000:01000000:2.0:1783444251.940301:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:2.0:1783444251.940306:0:3632:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x42cb6883e3831ab8 00000100:00100000:3.0:1783444251.941243:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575231232 00000100:00100000:3.0:1783444251.941252:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575231232 00000100:00100000:3.0:1783444251.941302:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1783444251.941309:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575231232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444251.941328:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444251.941377:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575231232:12345-0@lo:38:kworker.0 Request processed in 69us (1750us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444251.941384:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1783444251.945324:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575230848 00000100:00100000:1.0:1783444251.945339:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575230848 00000100:00100000:1.0:1783444251.945397:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1783444251.945407:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575230848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444251.945433:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444251.945511:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575230848:12345-0@lo:38:kworker.0 Request processed in 104us (6280us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444251.945887:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00080000:2.0:1783444251.949822:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:2.0:1783444251.949842:0:3632:0:(import.c:1673:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:1.0:1783444251.958963:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575231360:0@lo:250:kworker.0 00000100:00080000:1.0:1783444251.959013:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444251.959018:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444251.959021:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575230848:0@lo:38:kworker.0 00000100:00080000:1.0:1783444251.959032:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444251.959036:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444251.959039:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575231232:0@lo:38:kworker.0 00000100:00080000:0.0:1783444251.959163:0:87061:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:0.0:1783444251.959186:0:87061:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783444251.959231:0:87061:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783444251.959236:0:87061:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783444251.959337:0:87061:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783444251.959372:0:87061:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783444251.959377:0:87061:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783444251.959378:0:87061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783444251.959379:0:87061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444251.959381:0:87061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444251.959382:0:87061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444251.959383:0:87061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444251.959385:0:87061:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783444251.959386:0:87061:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783444251.959388:0:87061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444251.959389:0:87061:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783444251.959391:0:87061:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783444251.959393:0:87061:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783444251.959394:0:87061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783444251.959395:0:87061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444251.959396:0:87061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444251.959397:0:87061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444251.959398:0:87061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444251.959399:0:87061:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783444251.959400:0:87061:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783444251.959401:0:87061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444251.959402:0:87061:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783444251.959425:0:87061:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783444251.959439:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3a780 going to sleep for 0 seconds 00000100:00100000:0.0:1783444251.959443:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575231488:0@lo:253:mount.lustre.0 00000020:00080000:0.0:1783444251.959455:0:87061:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:0.0:1783444251.959466:0:87061:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9367c3a05800 from lustre-MDT0000 10000000:01000000:0.0:1783444251.959483:0:87061:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783444251.959486:0:87061:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783444251.959494:0:87061:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9367c3a05800 10000000:01000000:0.0:1783444251.959502:0:87061:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783444251.959506:0:87061:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9367c3a05800 10000000:01000000:0.0:1783444251.959508:0:87061:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783444251.959511:0:87061:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9367c3a05800 from 1 10000000:01000000:0.0:1783444251.959513:0:87061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783444251.959541:0:87061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959553:0:87061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959561:0:87061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444251.959570:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3ab40 going to sleep for 0 seconds 00000100:00100000:0.0:1783444251.959573:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575231616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444251.959581:0:87061:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959588:0:87061:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959595:0:87061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959603:0:87061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959610:0:87061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959625:0:87061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444251.959628:0:87061:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959636:0:87061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444251.959643:0:87061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.959649:0:87061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444251.959652:0:87061:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444251.959660:0:87061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.959667:0:87061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831abf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.959685:0:87061:0:(mgc_request.c:1816:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:0.0:1783444251.959688:0:87061:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:0.0:1783444251.959714:0:84624:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444251.959718:0:84624:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1783444251.959721:0:84624:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444251.959725:0:84624:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444251.959741:0:84624:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444251.959746:0:84624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3242 00000100:00080000:0.0:1783444251.959751:0:84624:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444251.959756:0:84624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444251.959782:0:84624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7269880 x1870073575231744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444251.959870:0:84624:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444251.959874:0:84624:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444251.959876:0:84624:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444251.959880:0:84624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3242 00000100:00080000:0.0:1783444251.959882:0:84624:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444251.959885:0:84624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444251.959896:0:84624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7268e00 x1870073575232000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444251.959909:0:84624:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444251.959912:0:84624:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444251.959913:0:84624:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444251.959916:0:84624:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3242 00000100:00080000:0.0:1783444251.959918:0:84624:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444251.959921:0:84624:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444251.959930:0:84624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e726a680 x1870073575232256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444251.959954:0:84624:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444251.959956:0:84624:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444251.959958:0:84624:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444251.959961:0:84624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3242 00000100:00080000:0.0:1783444251.959963:0:84624:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444251.959966:0:84624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444251.959982:0:84624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e726a300 x1870073575232640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444251.960007:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575231872:0@lo:400:kworker.0 00000100:00100000:0.0:1783444251.960063:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444251.960089:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444251.960094:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575232128:0@lo:400:kworker.0 00000100:00100000:0.0:1783444251.960109:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444251.960129:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575232384:0@lo:400:kworker.0 00000100:00100000:0.0:1783444251.960152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444251.960179:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444251.960185:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575232512:0@lo:400:kworker.0 00000100:00100000:0.0:1783444251.960205:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444251.960237:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575232384 00000100:00100000:0.0:1783444251.960244:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575232384 00000100:00100000:0.0:1783444251.960286:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575232512 00000100:00100000:0.0:1783444251.960289:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575232512 00000100:00100000:0.0:1783444251.960310:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:0.0:1783444251.960319:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575232384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444251.960371:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575232384:12345-0@lo:400:kworker.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444251.960378:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00000100:00100000:0.0:1783444251.960393:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300 00000100:00100000:0.0:1783444251.960399:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575232512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444251.960425:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575232512:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444251.960431:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300 00000100:00100000:0.0:1783444251.960484:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575232512:0@lo:400:kworker.0 00000100:00100000:0.0:1783444251.960495:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575232384:0@lo:400:kworker.0 00000100:00080000:2.0:1783444251.960497:0:87071:0:(import.c:1597:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.204.120@tcp to MGS@0@lo 00000100:00100000:2.0:1783444251.960501:0:87071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1783444251.960505:0:87071:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:2.0:1783444251.960515:0:87071:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:2.0:1783444251.960521:0:87071:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from RECOVER to FULL 10000000:01000000:2.0:1783444251.960523:0:87071:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783444251.960539:0:87071:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:2.0:1783444251.960542:0:87071:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) MGC192.168.204.120@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:2.0:1783444251.960579:0:80542:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.120@tcp 10000000:01000000:2.0:1783444251.960593:0:80542:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1783444251.960596:0:80542:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783444251.960598:0:80542:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783444251.960599:0:80542:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444251.960600:0:80542:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444251.960602:0:80542:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444251.960603:0:80542:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444251.960604:0:80542:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444251.960606:0:80542:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444251.960607:0:80542:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783444251.960640:0:80542:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783444251.960647:0:80542:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1783444251.960649:0:80542:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783444251.960650:0:80542:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783444251.960651:0:80542:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444251.960652:0:80542:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444251.960653:0:80542:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444251.960655:0:80542:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444251.960656:0:80542:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444251.960657:0:80542:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444251.960658:0:80542:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783444251.960677:0:80542:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783444251.960682:0:80542:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1783444251.960683:0:80542:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783444251.960685:0:80542:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783444251.960686:0:80542:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444251.960687:0:80542:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444251.960687:0:80542:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444251.960689:0:80542:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444251.960690:0:80542:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444251.960691:0:80542:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444251.960692:0:80542:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783444251.960704:0:80542:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1783444251.961206:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575232768:0@lo:253:kworker.0 00000100:00100000:0.0:1783444251.961215:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575232896:0@lo:253:kworker.0 00000100:00100000:3.0:1783444251.961305:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575231872 00000100:00100000:3.0:1783444251.961311:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575231872 00000100:00100000:3.0:1783444251.961354:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575232128 00000100:00100000:3.0:1783444251.961357:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575232128 00000100:00100000:3.0:1783444251.961380:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1783444251.961387:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575231872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.961558:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1783444251.961568:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575232128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444251.962645:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444251.962892:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575232768 00000100:00100000:1.0:1783444251.962900:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575232768 00000100:00100000:1.0:1783444251.962949:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783444251.962969:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+5:3633:x1870073575232768:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783444251.963003:0:87068:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:1.0:1783444251.963214:0:87072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783444251.963333:0:87068:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 107 00000100:00100000:1.0:1783444251.963554:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575233024:0@lo:253:kworker.0 00000100:00100000:1.0:1783444251.963617:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1783444251.963654:0:87061:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9367c3a05800 from 1 10000000:01000000:1.0:1783444251.963658:0:87061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783444251.963699:0:87061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444251.963711:0:87061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444251.963950:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575231872:12345-0@lo:400:kworker.0 Request processed in 2561us (3884us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444251.963966:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1783444251.964021:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575231872:0@lo:400:kworker.0 00000100:00100000:3.0:1783444251.964050:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575231744:0@lo:38:kworker.0 00000100:00100000:3.0:1783444251.964076:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444251.964096:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575231744 00000100:00100000:3.0:1783444251.964101:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575231744 00000100:00100000:2.0:1783444251.964228:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575232128:12345-0@lo:400:kworker.0 Request processed in 2660us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444251.964236:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1783444251.964267:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575232000:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.964290:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.964307:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e726a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575232256:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.964328:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.964349:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575232256 00000100:00100000:2.0:1783444251.964353:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575232256 00000100:00100000:2.0:1783444251.964375:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:2.0:1783444251.964381:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575232256:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444251.964399:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444251.964430:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575232256:12345-0@lo:38:kworker.0 Request processed in 49us (101us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444251.964436:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00080000:2.0:1783444251.964463:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444251.964474:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444251.964478:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e726a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575232256:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.964484:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e726a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575232640:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.964507:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.964549:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575232128:0@lo:400:kworker.0 00000100:00100000:2.0:1783444251.964568:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575232000 00000100:00100000:2.0:1783444251.964571:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575232000 00000100:00100000:2.0:1783444251.964586:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575232640 00000100:00100000:2.0:1783444251.964589:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575232640 00000100:00100000:2.0:1783444251.964600:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1783444251.964604:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575232000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444251.964614:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444251.964638:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575232000:12345-0@lo:38:kworker.0 Request processed in 32us (347us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444251.964644:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1783444251.964653:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1783444251.964656:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575232640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444251.964665:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444251.964684:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575232640:12345-0@lo:38:kworker.0 Request processed in 25us (175us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444251.964689:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:2.0:1783444251.964708:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444251.964712:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444251.964715:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575232000:0@lo:38:kworker.0 00010000:00010000:1.0:1783444251.964947:0:87061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444251.965050:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575233152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444251.965080:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444251.965245:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1783444251.965250:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575231744:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444251.965262:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444251.965291:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575231744:12345-0@lo:38:kworker.0 Request processed in 39us (1213us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444251.965297:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1783444251.965352:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575233024 00000100:00100000:1.0:1783444251.965357:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575233024 00000100:00080000:2.0:1783444251.965425:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444251.965435:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444251.965438:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e726a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575232640:0@lo:38:kworker.0 00000100:00080000:2.0:1783444251.965459:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444251.965463:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444251.965465:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575231744:0@lo:38:kworker.0 00000100:00100000:2.0:1783444251.965522:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575233152 00000100:00100000:2.0:1783444251.965525:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575233152 00000100:00100000:2.0:1783444251.965543:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783444251.965547:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3635:x1870073575233024:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783444251.965571:0:87069:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1783444251.966255:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c72273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444251.969067:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444251.969340:0:87066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1783444251.969354:0:87066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1783444251.969613:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575232896 00000100:00100000:1.0:1783444251.969623:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575232896 00000100:00100000:3.0:1783444251.970263:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783444251.970274:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:87061:x1870073575233152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444251.970292:0:87074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444251.970312:0:87074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1b600/0x42cb6883e3831acd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831ac6 expref: -99 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444251.970339:0:87074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1b600/0x42cb6883e3831acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831ac6 expref: 9 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444251.970349:0:87074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1b600/0x42cb6883e3831acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831ac6 expref: 9 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444251.970359:0:87074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1b600, rc 0) 00000100:00100000:3.0:1783444251.970432:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:87061:x1870073575233152:12345-0@lo:101:mount.lustre.0 Request processed in 159us (5349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444251.970444:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783444251.970475:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783444251.970482:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3634:x1870073575232896:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1783444251.970501:0:87074:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1783444251.970709:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575233152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444251.970741:0:87061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.970750:0:87061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.970770:0:87061:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783444251.970812:0:87061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.970820:0:87061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444251.970829:0:87061:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783444251.970835:0:87061:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783444251.970840:0:87061:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9367c3a05800 10000000:01000000:0.0:1783444251.970843:0:87061:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783444251.970846:0:87061:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783444251.970849:0:87061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444251.970872:0:87061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.970880:0:87061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.970895:0:87061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444251.970915:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575233280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783444251.970951:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444251.970979:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444251.971276:0:87066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:3.0:1783444251.971283:0:87066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:2.0:1783444251.972053:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575233280 00000100:00100000:2.0:1783444251.972060:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575233280 20000000:01000000:3.0:1783444251.972246:0:87073:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783444251.972250:0:87073:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1783444251.972253:0:87073:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783444251.972256:0:87073:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000100:00100000:3.0:1783444251.972377:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783444251.972386:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+9:87061:x1870073575233280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444251.972399:0:87075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444251.972415:0:87075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1ba00/0x42cb6883e3831adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831ad4 expref: -99 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444251.972436:0:87075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1ba00/0x42cb6883e3831adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831ad4 expref: 10 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444251.972447:0:87075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1ba00/0x42cb6883e3831adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831ad4 expref: 10 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444251.972455:0:87075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1ba00, rc 0) 00000100:00100000:3.0:1783444251.972513:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575233280:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444251.972520:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783444251.972632:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575233280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444251.972648:0:87061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444251.972657:0:87061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444251.972714:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575233408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783444251.972762:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444251.972821:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3aa80 going to sleep for 11 seconds 00000040:00080000:3.0:1783444251.973074:0:87073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:2.0:1783444251.977905:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575233408 00000100:00100000:2.0:1783444251.977918:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575233408 00000100:00100000:2.0:1783444251.977977:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783444251.977987:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575233408:12345-0@lo:501:mount.lustre.0 20000000:01000000:1.0:1783444251.979077:0:87068:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444251.979133:0:87069:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783444251.979381:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575233408:12345-0@lo:501:mount.lustre.0 Request processed in 1393us (6615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444251.979390:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783444251.979454:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575233408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444251.979509:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575233536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444251.979566:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444251.980459:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575233536 00000100:00100000:2.0:1783444251.980466:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575233536 00000100:00100000:2.0:1783444251.980506:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783444251.980514:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575233536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444251.980654:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c11ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444251.981496:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575233536:12345-0@lo:503:mount.lustre.0 Request processed in 981us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444251.981505:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783444251.981847:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575233536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444251.982576:0:87076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87076:1870073575233664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444251.982636:0:87076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444251.982671:0:87076:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d08bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444251.982712:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575233664 00000100:00100000:0.0:1783444251.982717:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575233664 00000100:00100000:0.0:1783444251.982759:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783444251.982767:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87076:x1870073575233664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444251.983615:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87076:x1870073575233664:12345-0@lo:502:llog_process_th.0 Request processed in 844us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444251.983692:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783444251.983763:0:87076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87076:1870073575233664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444251.983817:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444251.983829:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444251.983832:0:87076:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783444251.983837:0:87076:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783444251.983840:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783444251.983855:0:87076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9368c50799c0) 00000020:00000080:3.0:1783444251.983877:0:87076:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1783444251.983887:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783444251.983967:0:87076:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783444251.983974:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831ae9 00000020:00000080:3.0:1783444251.984227:0:87076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783444251.984231:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444251.984235:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444251.984236:0:87076:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783444251.984239:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444251.984242:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444251.984244:0:87076:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783444251.984247:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783444251.984253:0:87076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9368c5078000) 00000020:00000080:3.0:1783444251.984266:0:87076:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1783444251.984269:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783444251.984271:0:87076:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783444251.984274:0:87076:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783444251.984279:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783444251.984320:0:87076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9367c3a05800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783444251.984331:0:87076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9367c1e80000) 00000020:00000080:3.0:1783444251.984342:0:87076:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1783444251.984391:0:87076:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783444251.984401:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3831afe 00000020:00000080:3.0:1783444251.984494:0:87076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783444251.984501:0:87076:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783444251.984505:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42cb6883e3831b05 00080000:01000000:3.0:1783444251.984510:0:87076:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783444251.984513:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831b0c 20000000:01000000:2.0:1783444251.986520:0:87069:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444251.986537:0:87069:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783444251.986724:0:87074:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783444251.986949:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:3635:x1870073575233024:12345-0@lo:253:kworker.0 Request processed in 21396us (23327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444251.986960:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:1.0:1783444251.987039:0:87072:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783444251.987044:0:87072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783444251.987066:0:87072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783444251.987092:0:3635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00010000:00010000:1.0:1783444251.987093:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783444251.987097:0:3635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783444251.987100:0:3635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444251.987103:0:3635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444251.987105:0:3635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 20000000:01000000:1.0:1783444251.987107:0:87072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000064171s 00000020:01000004:0.0:1783444251.987107:0:3635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444251.987109:0:3635:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783444251.987111:0:3635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444251.987114:0:3635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1783444251.987115:0:87072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444251.987119:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575233024:0@lo:253:kworker.0 00010000:00010000:1.0:1783444251.987134:0:87072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444251.987142:0:87072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444251.987150:0:87072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444251.987157:0:87072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444251.987161:0:87072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444251.987177:0:87072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444251.987192:0:87072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444251.987199:0:87072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444251.987205:0:87072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71000/0x42cb6883e3831b13 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444251.993726:0:87074:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783444251.993752:0:87074:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783444251.993919:0:87072:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783444251.993924:0:87072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783444251.993954:0:87072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.993972:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783444251.993982:0:87072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000064171s 00010000:00010000:2.0:1783444251.993986:0:87072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.993992:0:87072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.993999:0:87072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.994005:0:87072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.994024:0:87072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444251.994028:0:87072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.994038:0:87072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.994053:0:87072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.994060:0:87072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444251.994068:0:87072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031a00/0x42cb6883e3831b1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783444251.994148:0:87068:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783444251.994375:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:3634:x1870073575232896:12345-0@lo:253:kworker.0 Request processed in 23889us (25315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444251.994386:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1783444251.995778:0:3634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783444251.995784:0:3634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783444251.995786:0:3634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444251.995801:0:3634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444251.995803:0:3634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444251.995805:0:3634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444251.995807:0:3634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783444251.995809:0:3634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444251.995810:0:3634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783444251.995815:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575232896:0@lo:253:kworker.0 20000000:01000000:1.0:1783444251.999765:0:87068:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783444251.999814:0:87068:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783444251.999927:0:87072:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783444251.999933:0:87072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783444251.999956:0:87072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444251.999974:0:87072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783444251.999984:0:87072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000064171s 00010000:00010000:3.0:1783444251.999989:0:87072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444251.999996:0:87072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.000003:0:87072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.000010:0:87072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.000020:0:87072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1aa00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444252.000025:0:87072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.000032:0:87072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.000068:0:87072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.000076:0:87072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.000083:0:87072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1aa00/0x42cb6883e3831b21 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444252.000189:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3633:x1870073575232768:12345-0@lo:253:kworker.0 Request processed in 37215us (37542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.000200:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:3.0:1783444252.000479:0:3633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783444252.000481:0:3633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783444252.000483:0:3633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444252.000484:0:3633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444252.000486:0:3633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444252.000488:0:3633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444252.000489:0:3633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783444252.000491:0:3633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444252.000492:0:3633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783444252.000496:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575232768:0@lo:253:kworker.0 00010000:00010000:0.0:1783444252.070042:0:87076:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1783444252.070401:0:87076:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 778015c5-4969-44f5-82a5-0f6eadd152d5 idx: 0 lr: 98784247815 srv lr: 103079215104 lx: 0 gen 23 00000001:00080000:0.0:1783444252.070451:0:87076:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 22 00000001:00000004:0.0:1783444252.070477:0:87076:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:0.0:1783444252.072609:0:87076:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1783444252.072695:0:87076:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368dcf3aa80: xid 1870073557752832, transno 103079215108, client gen 23, slot idx 0 00000001:00080000:0.0:1783444252.072705:0:87076:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368dcf3a540: xid 1870073557752576, transno 103079215107, client gen 23, slot idx 1 00000020:00000080:0.0:1783444252.076603:0:87076:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9368e7124d40) 00000020:00000080:0.0:1783444252.076638:0:87076:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1783444252.076730:0:87076:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783444252.076739:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831b3d 00000020:00000080:2.0:1783444252.079530:0:87076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783444252.089462:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42cb6883e3831b44 00000020:00000080:0.0:1783444252.090192:0:87076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783444252.090205:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444252.090212:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444252.090215:0:87076:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783444252.090219:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783444252.090229:0:87076:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783444252.090231:0:87076:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444252.090233:0:87076:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444252.090234:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783444252.090237:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444252.090239:0:87076:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783444252.090241:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444252.090246:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444252.090248:0:87076:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783444252.090253:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783444252.090306:0:87076:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783444252.090325:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444252.090329:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444252.090331:0:87076:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783444252.090333:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444252.090337:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444252.090338:0:87076:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783444252.090341:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783444252.090347:0:87076:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:0.0:1783444252.090370:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783444252.090386:0:87076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9368e7123380) 00000020:00000080:0.0:1783444252.090404:0:87076:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783444252.090408:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783444252.090466:0:87076:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783444252.090473:0:87076:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783444252.090478:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831b52 00010000:00080000:0.0:1783444252.090514:0:87076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff936901dbd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1783444252.092145:0:87076:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1783444252.105734:0:87076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444252.105752:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783444252.106055:0:87076:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783444252.106083:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3831b59 00000100:00080000:3.0:1783444252.106097:0:87076:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783444252.106104:0:87076:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff936901dbd800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444252.106230:0:87076:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fd180 x1870073575233792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444252.106294:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575233792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783444252.106369:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444252.106437:0:87076:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783444252.106524:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575233920:0@lo:400:kworker.0 00000100:00100000:3.0:1783444252.106557:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.106615:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575233920 00000100:00100000:3.0:1783444252.106621:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575233920 00000100:00100000:3.0:1783444252.106660:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783444252.106668:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3636:x1870073575233920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444252.106715:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3636:x1870073575233920:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444252.106724:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783444252.106771:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575233920:0@lo:400:kworker.0 00000020:01000000:3.0:1783444252.106858:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444252.106863:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.106865:0:87076:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783444252.106868:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783444252.106871:0:87076:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783444252.106872:0:87076:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783444252.106874:0:87076:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783444252.106875:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783444252.106878:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.106879:0:87076:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783444252.106882:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783444252.106886:0:87076:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783444252.106889:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.106891:0:87076:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783444252.106894:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783444252.106897:0:87076:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:3.0:1783444252.106918:0:87076:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783444252.106920:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783444252.106933:0:87076:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9367c1e83380) 00000020:00000080:3.0:1783444252.106967:0:87076:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783444252.106975:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783444252.107043:0:87076:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783444252.107049:0:87076:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783444252.107063:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831b67 00010000:00080000:3.0:1783444252.107093:0:87076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ef129800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00000100:00100000:0.0:1783444252.107250:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575233792 00000100:00100000:0.0:1783444252.107255:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575233792 00000100:00100000:0.0:1783444252.107278:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:0.0:1783444252.107285:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575233792:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783444252.107315:0:23687:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3243 last 0 00000020:00000080:0.0:1783444252.107345:0:23687:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3831b6e 00000004:00100000:0.0:1783444252.107360:0:23687:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444252.107469:0:23687:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f4800 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1783444252.107769:0:87076:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:3.0:1783444252.109585:0:87076:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783444252.109614:0:87076:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783444252.109691:0:87076:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1783444252.113372:0:87076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783444252.113405:0:87076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:3.0:1783444252.113573:0:87076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:1.0:1783444252.116442:0:87082:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:1.0:1783444252.116451:0:87082:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783444252.116667:0:87082:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:1.0:1783444252.116690:0:87082:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783444252.116861:0:87082:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:1.0:1783444252.116865:0:87082:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783444252.122864:0:87076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444252.122884:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783444252.122931:0:87076:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783444252.122969:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3831b75 00000100:00080000:1.0:1783444252.122983:0:87076:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783444252.122989:0:87076:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368ef129800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444252.123032:0:87076:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973f100 x1870073575234048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444252.123063:0:87076:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783444252.123155:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444252.123159:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444252.123161:0:87076:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783444252.123174:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783444252.123177:0:87076:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1783444252.123178:0:87076:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783444252.123180:0:87076:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783444252.123182:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783444252.123184:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444252.123186:0:87076:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783444252.123189:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783444252.123194:0:87076:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783444252.123198:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444252.123199:0:87076:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783444252.123202:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783444252.123206:0:87076:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:1.0:1783444252.123231:0:87076:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783444252.123233:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783444252.123246:0:87076:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9368dd0eb380) 00000020:00000080:1.0:1783444252.123262:0:87076:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783444252.123268:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783444252.123329:0:87076:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783444252.123336:0:87076:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783444252.123342:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3831b83 00010000:00080000:1.0:1783444252.123371:0:87076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368c511b800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1783444252.123558:0:87076:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1783444252.123627:0:87076:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783444252.123642:0:87076:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783444252.123738:0:87076:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:0.0:1783444252.123820:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575233792:12345-0@lo:38:llog_process_th.0 Request processed in 16531us (17447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444252.123832:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000040:00080000:1.0:1783444252.124553:0:87076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783444252.124606:0:87076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:1.0:1783444252.124746:0:87076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000100:00100000:2.0:1783444252.124911:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783444252.124924:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1783444252.124931:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783444252.124936:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783444252.124941:0:3632:0:(import.c:65:import_set_state_nolock()) ffff936901dbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783444252.124963:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575233792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783444252.124991:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575234048:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783444252.125057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.125190:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575234048 00000100:00100000:3.0:1783444252.125197:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575234048 00000100:00100000:3.0:1783444252.125235:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5858 00000100:00100000:3.0:1783444252.125243:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3632:x1870073575234048:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783444252.125270:0:26210:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3243 last 0 00000020:00000080:3.0:1783444252.125295:0:26210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3831b8a 00002000:00100000:3.0:1783444252.125308:0:26210:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9367c17b7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783444252.125313:0:26210:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783444252.125316:0:26210:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783444252.125374:0:26210:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783444252.125396:0:26210:0:(import.c:65:import_set_state_nolock()) ffff9367c17b6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444252.125450:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575234048:12345-0@lo:8:llog_process_th.0 Request processed in 206us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444252.125457:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5858 00000100:00100000:2.0:1783444252.126052:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783444252.126060:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783444252.126067:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783444252.126070:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783444252.126072:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef129800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783444252.126083:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783444252.126087:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575234048:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783444252.126182:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444252.126192:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575234176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444252.126231:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444252.126662:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575234176 00000100:00100000:2.0:1783444252.126669:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575234176 00000100:00100000:2.0:1783444252.126726:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:2.0:1783444252.126735:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575234176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444252.126758:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444252.126836:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575234176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.126844:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:2.0:1783444252.126899:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575234176:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1783444252.127087:0:87082:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:3.0:1783444252.127105:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783444252.127242:0:87082:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3243169452399ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783444252.127249:0:87082:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783444252.127454:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444252.127464:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575234304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444252.127502:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.128267:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575234304 00000100:00100000:1.0:1783444252.128274:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575234304 00000100:00100000:1.0:1783444252.128312:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000040:00080000:3.0:1783444252.128321:0:87084:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000100:00100000:1.0:1783444252.128321:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575234304:12345-0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783444252.128338:0:87084:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00000024:1.0:1783444252.128352:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444252.128400:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575234304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.128407:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000040:00080000:3.0:1783444252.128519:0:87084:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:2.0:1783444252.128763:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575234304:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1783444252.129849:0:87084:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783444252.130014:0:87084:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:0.0:1783444252.130018:0:87084:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1783444252.131434:0:87062:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:3.0:1783444252.131672:0:87076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444252.131687:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783444252.131732:0:87076:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783444252.131759:0:87076:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3831b91 00000100:00080000:3.0:1783444252.131769:0:87076:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783444252.131775:0:87076:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9368c511b800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444252.131831:0:87076:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fea00 x1870073575234432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444252.131866:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575234432:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783444252.131933:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444252.131999:0:87076:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783444252.132079:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444252.132084:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.132086:0:87076:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783444252.132089:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444252.132094:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.132095:0:87076:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783444252.132098:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783444252.132100:0:87076:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783444252.132102:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444252.132104:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.132105:0:87076:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783444252.132107:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444252.132109:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.132111:0:87076:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783444252.132114:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783444252.132142:0:87076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87076:1870073575234560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444252.132199:0:87076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.132231:0:87076:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f59a6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444252.132251:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575234432 00000100:00100000:1.0:1783444252.132257:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575234432 00000100:00100000:1.0:1783444252.132296:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5859 00000100:00100000:1.0:1783444252.132304:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3632:x1870073575234432:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783444252.132329:0:26206:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3243 last 0 00000020:00000080:1.0:1783444252.132357:0:26206:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3831b98 00002000:00100000:1.0:1783444252.132373:0:26206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9368c9a14000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783444252.132377:0:26206:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783444252.132380:0:26206:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783444252.132448:0:26206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783444252.132471:0:26206:0:(import.c:65:import_set_state_nolock()) ffff9368c9a10000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444252.132524:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575234432:12345-0@lo:8:llog_process_th.0 Request processed in 219us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.132532:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1783444252.133814:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783444252.133826:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783444252.133836:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783444252.133842:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783444252.133846:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368c511b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783444252.133858:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783444252.133864:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575234432:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1783444252.133865:0:87084:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1783444252.133919:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575234688:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783444252.133936:0:87084:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3243176146419ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783444252.133942:0:87084:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783444252.133971:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444252.134491:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575234688 00000100:00100000:0.0:1783444252.134497:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575234688 00000100:00100000:0.0:1783444252.134559:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:0.0:1783444252.134568:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575234688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444252.134603:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444252.134652:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575234688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444252.134660:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:1.0:1783444252.134947:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575234688:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783444252.135918:0:87062:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:3.0:1783444252.137648:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444252.138908:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575234560 00000100:00100000:2.0:1783444252.138919:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575234560 00000100:00100000:2.0:1783444252.138983:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783444252.138992:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:87076:x1870073575234560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444252.139226:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:87076:x1870073575234560:12345-0@lo:502:llog_process_th.0 Request processed in 234us (7025us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.139234:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783444252.139345:0:87076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87076:1870073575234560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444252.139384:0:87076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444252.139391:0:87076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.139393:0:87076:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783444252.139398:0:87076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783444252.139642:0:87061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783444252.139666:0:87061:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783444252.139686:0:87061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.139710:0:87061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444252.139718:0:87061:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9367c3a05800 from 1 10000000:01000000:0.0:1783444252.139722:0:87061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783444252.139751:0:87061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.139759:0:87061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.139769:0:87061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444252.139818:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575234816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444252.140194:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.140236:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c1089900 going to sleep for 11 seconds 00000100:00100000:0.0:1783444252.140765:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575234816 00000100:00100000:0.0:1783444252.140773:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575234816 00000100:00100000:0.0:1783444252.140838:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783444252.140847:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:87061:x1870073575234816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444252.140860:0:87068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444252.140878:0:87068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831b9f expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.140902:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 9 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.140912:0:87068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 9 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.140933:0:87068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef262e00, rc 0) 00000100:00100000:0.0:1783444252.140988:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:87061:x1870073575234816:12345-0@lo:101:mount.lustre.0 Request processed in 142us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444252.140994:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783444252.141457:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575234816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444252.141474:0:87061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.141484:0:87061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444252.142073:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575234944:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783444252.142142:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.142185:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c72273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444252.142300:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575234944 00000100:00100000:2.0:1783444252.142307:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575234944 00000100:00100000:2.0:1783444252.142352:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783444252.142361:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+9:87061:x1870073575234944:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783444252.142378:0:87075:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783444252.142395:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783444252.142399:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783444252.142403:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783444252.142405:0:87075:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 110 00000100:00100000:2.0:1783444252.142501:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+9:87061:x1870073575234944:12345-0@lo:256:mount.lustre.0 Request processed in 140us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.142509:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783444252.142625:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575234944:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783444252.143557:0:87061:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783444252.143640:0:87061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.143653:0:87061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444252.143663:0:87061:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9367c3a05800 from 1 10000000:01000000:1.0:1783444252.143666:0:87061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783444252.143700:0:87061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.143709:0:87061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.143731:0:87061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444252.143752:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444252.143859:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.143934:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c72273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444252.144540:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575235072 00000100:00100000:0.0:1783444252.144548:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575235072 00000100:00100000:0.0:1783444252.144782:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783444252.144812:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:87061:x1870073575235072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444252.144826:0:87074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444252.144843:0:87074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef263600/0x42cb6883e3831bb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831bad expref: -99 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.144867:0:87074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef263600/0x42cb6883e3831bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831bad expref: 10 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.144890:0:87074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef263600/0x42cb6883e3831bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831bad expref: 10 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.144899:0:87074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef263600, rc 0) 00000100:00100000:0.0:1783444252.144958:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575235072:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444252.144965:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783444252.145104:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444252.145120:0:87061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.145142:0:87061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444252.145219:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444252.145251:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.146204:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4cfaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444252.146253:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575235200 00000100:00100000:1.0:1783444252.146261:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575235200 00000100:00100000:1.0:1783444252.146309:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783444252.146318:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575235200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444252.146465:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575235200:12345-0@lo:501:mount.lustre.0 Request processed in 147us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.146472:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783444252.146517:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444252.146557:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444252.146623:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.146641:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444252.148903:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575235328 00000100:00100000:0.0:1783444252.148917:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575235328 00000100:00100000:0.0:1783444252.148989:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783444252.148999:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575235328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783444252.149189:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575235328:12345-0@lo:503:mount.lustre.0 Request processed in 190us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444252.149204:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783444252.149417:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444252.149953:0:87086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87086:1870073575235456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444252.150003:0:87086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.150035:0:87086:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444252.150086:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575235456 00000100:00100000:0.0:1783444252.150091:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575235456 00000100:00100000:1.0:1783444252.150217:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783444252.150226:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87086:x1870073575235456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444252.150675:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87086:x1870073575235456:12345-0@lo:502:llog_process_th.0 Request processed in 448us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.150682:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783444252.150770:0:87086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87086:1870073575235456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444252.150837:0:87086:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444252.150847:0:87086:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.150849:0:87086:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783444252.150856:0:87086:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9367c3a05800 00000020:00000080:3.0:1783444252.150859:0:87086:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783444252.150870:0:87086:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444252.150873:0:87086:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.150874:0:87086:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783444252.150877:0:87086:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444252.150879:0:87086:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444252.150881:0:87086:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783444252.150884:0:87086:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9367c3a05800 00000020:00000080:3.0:1783444252.150886:0:87086:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783444252.150962:0:87086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87086:1870073575235584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444252.151001:0:87086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.151016:0:87086:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4cfaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444252.151844:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575235584 00000100:00100000:2.0:1783444252.151851:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575235584 00000100:00100000:3.0:1783444252.151992:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783444252.152000:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87086:x1870073575235584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444252.152204:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87086:x1870073575235584:12345-0@lo:502:llog_process_th.0 Request processed in 125us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444252.152213:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783444252.152292:0:87086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87086:1870073575235584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444252.152320:0:87086:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444252.152327:0:87086:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444252.152329:0:87086:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783444252.152333:0:87086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783444252.152976:0:87061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783444252.153002:0:87061:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783444252.157893:0:87061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.157913:0:87061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444252.157998:0:87061:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783444252.158001:0:87061:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9367c3a05800 10000000:01000000:3.0:1783444252.158004:0:87061:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9367c3a05800 10000000:01000000:3.0:1783444252.158008:0:87061:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783444252.158013:0:87061:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9367c3a05800 from 1 10000000:01000000:3.0:1783444252.158017:0:87061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444252.158051:0:87061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.158059:0:87061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.158069:0:87061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444252.158093:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783444252.158155:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.159253:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444252.159906:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575235712 00000100:00100000:1.0:1783444252.159915:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575235712 00000100:00100000:1.0:1783444252.159968:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783444252.159978:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575235712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444252.159993:0:87069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444252.160008:0:87069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70800/0x42cb6883e3831bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831bbb expref: -99 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.160034:0:87069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70800/0x42cb6883e3831bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831bbb expref: 11 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.160045:0:87069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70800/0x42cb6883e3831bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831bbb expref: 11 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.160054:0:87069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70800, rc 0) 00000100:00100000:1.0:1783444252.160112:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575235712:12345-0@lo:101:mount.lustre.0 Request processed in 136us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.160119:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783444252.160430:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444252.160447:0:87061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444252.160456:0:87061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444252.160531:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444252.160565:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.161477:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444252.161516:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575235840 00000100:00100000:1.0:1783444252.161522:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575235840 00000100:00100000:1.0:1783444252.161566:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783444252.161574:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575235840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444252.161707:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575235840:12345-0@lo:501:mount.lustre.0 Request processed in 134us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.161728:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783444252.162157:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444252.162209:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444252.162250:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.162273:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444252.163265:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575235968 00000100:00100000:3.0:1783444252.163273:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575235968 00000100:00100000:3.0:1783444252.163325:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783444252.163335:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575235968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444252.163676:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575235968:12345-0@lo:503:mount.lustre.0 Request processed in 342us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444252.163684:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783444252.163775:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575235968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444252.167672:0:87089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87089:1870073575236096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444252.167762:0:87089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444252.167836:0:87089:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016e180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444252.167896:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575236096 00000100:00100000:2.0:1783444252.167905:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575236096 00000100:00100000:2.0:1783444252.167962:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783444252.167972:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87089:x1870073575236096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444252.168138:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87089:x1870073575236096:12345-0@lo:502:llog_process_th.0 Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.168146:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783444252.168536:0:87089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87089:1870073575236096:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783444252.168708:0:87089:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783444252.168722:0:87089:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9368dd0e8000) 00000020:00000080:1.0:1783444252.168750:0:87089:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1783444252.169717:0:87089:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9367c3a05800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783444252.169723:0:87089:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9367c3a05800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783444252.169726:0:87089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9367c3a05800 4 00010000:00080000:1.0:1783444252.169762:0:87089:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9367c6a4f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1783444252.177067:0:87089:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1783444252.177362:0:87089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783444252.177414:0:87089:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783444252.177430:0:87089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42cb6883e3831bd0 00000100:00080000:1.0:1783444252.177442:0:87089:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783444252.177632:0:87089:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9367c6a4f800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444252.177669:0:87089:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973ea00 x1870073575236224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444252.177694:0:87089:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783444252.178251:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575236224:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783444252.178328:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.178465:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575236224 00000100:00100000:1.0:1783444252.178474:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575236224 00000100:00100000:1.0:1783444252.178515:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1783444252.178523:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575236224:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783444252.178610:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575236224:12345-0@lo:38:llog_process_th.0 Request processed in 85us (282us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783444252.178617:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1783444252.178663:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783444252.178679:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444252.178683:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783444252.178687:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575236224:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783444252.178780:0:87089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87089:1870073575236352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444252.178853:0:87089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.178878:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575236352 00000100:00100000:1.0:1783444252.178881:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575236352 00000100:00100000:1.0:1783444252.178913:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783444252.178919:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87089:x1870073575236352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444252.179363:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87089:x1870073575236352:12345-0@lo:502:llog_process_th.0 Request processed in 443us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.179371:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783444252.179417:0:87089:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444252.179430:0:87089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87089:1870073575236352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444252.179467:0:87089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87089:1870073575236480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444252.179502:0:87089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.179529:0:87089:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd180 going to sleep for 11 seconds 00000100:00100000:3.0:1783444252.179724:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575236480 00000100:00100000:3.0:1783444252.179729:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575236480 00000100:00100000:3.0:1783444252.179771:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783444252.179779:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87089:x1870073575236480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444252.179882:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87089:x1870073575236480:12345-0@lo:502:llog_process_th.0 Request processed in 103us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444252.179889:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783444252.180705:0:87089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:87089:1870073575236480:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444252.180736:0:87089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783444252.180921:0:87061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783444252.180944:0:87061:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444252.181039:0:87061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444252.181060:0:87061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783444252.181111:0:87061:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783444252.181113:0:87061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444252.181115:0:87061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444252.181116:0:87061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444252.181118:0:87061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444252.181119:0:87061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444252.181120:0:87061:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444252.181122:0:87061:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444252.181198:0:87061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444252.181200:0:87061:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783444252.181204:0:87061:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783444252.181206:0:87061:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783444252.181207:0:87061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444252.181208:0:87061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444252.181209:0:87061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444252.181210:0:87061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444252.181211:0:87061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444252.181212:0:87061:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444252.181213:0:87061:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444252.181214:0:87061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444252.181215:0:87061:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783444252.181234:0:87061:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783444252.181248:0:87061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575236608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783444252.181292:0:87061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444252.181329:0:87061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75e5780 going to sleep for 11 seconds 00000100:00100000:3.0:1783444252.181528:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575236608 00000100:00100000:3.0:1783444252.181533:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575236608 00000100:00100000:3.0:1783444252.185444:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783444252.185471:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:87061:x1870073575236608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783444252.185509:0:87068:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783444252.185526:0:87068:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783444252.188588:0:87068:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783444252.188614:0:87068:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783444252.188808:0:87072:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444252.188814:0:87072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444252.188839:0:87072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.188862:0:87072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 11 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.188870:0:87072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.188916:0:87072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 11 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.188933:0:87072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 11 pid: 87068 timeout: 3343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444252.188961:0:87072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87072:1870073575236736:0@lo:104: 00000100:00100000:0.0:1783444252.189039:0:87072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444252.189082:0:87072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444252.189288:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575236736 00000100:00100000:1.0:1783444252.189296:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575236736 00000100:00100000:1.0:1783444252.189358:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1783444252.189367:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7269180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:87072:x1870073575236736:12345-0@lo:104: 00010000:00010000:1.0:1783444252.189394:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189451:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444252.189458:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7269180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:87072:x1870073575236736:12345-0@lo:104: Request processed in 93us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.189465:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:1.0:1783444252.189491:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444252.189498:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189505:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444252.189509:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189517:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444252.189524:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444252.189530:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444252.189557:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189564:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444252.189583:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189590:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef262600/0x42cb6883e3831b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3831ba6 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189611:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444252.189613:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444252.189615:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444252.189627:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575236864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444252.189659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444252.189702:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575236864 00000100:00100000:1.0:1783444252.189706:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575236864 00010000:00010000:1.0:1783444252.189723:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 12 pid: 87068 timeout: 3343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444252.189744:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1783444252.189750:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5935850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+12:3636:x1870073575236864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444252.189760:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444252.189765:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 12 pid: 87068 timeout: 3343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189775:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 12 pid: 87068 timeout: 3343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189812:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189821:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783444252.189836:0:6491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001022103s 00010000:00010000:1.0:1783444252.189841:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189858:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189864:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189870:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189875:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444252.189879:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189886:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189893:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.189903:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444252.189932:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5935850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+12:3636:x1870073575236864:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.189939:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1783444252.190103:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575236864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444252.190286:0:87072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262e00/0x42cb6883e3831ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3831b9f expref: 11 pid: 87068 timeout: 3343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444252.190297:0:87072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87072:1870073575236736:0@lo:104: 00010000:00010000:1.0:1783444252.190310:0:87072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.190325:0:87072:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.190331:0:87072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.190337:0:87072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262a00/0x42cb6883e3831bd7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444252.190475:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:87061:x1870073575236608:12345-0@lo:253:mount.lustre.0 Request processed in 5016us (9181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444252.190493:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783444252.190581:0:87061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:87061:1870073575236608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783444252.190592:0:87061:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783444252.190596:0:87061:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783444252.190597:0:87061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444252.190599:0:87061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444252.190605:0:87061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444252.190607:0:87061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444252.190608:0:87061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444252.190609:0:87061:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444252.190611:0:87061:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444252.190613:0:87061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444252.190614:0:87061:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783444252.190627:0:87061:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1783444252.210321:0:87061:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:1.0:1783444252.210747:0:87061:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1783444252.212263:0:87095:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783444252.212553:0:87061:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1783444252.212871:0:87095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1783444252.213133:0:87094:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:2.0:1783444252.213210:0:87094:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000100:00100000:0.0:1783444252.213381:0:87096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87096:1870073575236992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444252.213448:0:87096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444252.213482:0:87096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6b093c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444252.214242:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575236992 00000100:00100000:2.0:1783444252.214252:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575236992 00000100:00100000:2.0:1783444252.214299:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1783444252.214308:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87096:x1870073575236992:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783444252.214395:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87096:x1870073575236992:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.214402:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:0.0:1783444252.214507:0:87096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87096:1870073575236992:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1783444252.214539:0:87096:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783444252.214570:0:87096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87096:1870073575237120:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444252.214603:0:87096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444252.215245:0:87096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6b093c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444252.215293:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575237120 00000100:00100000:2.0:1783444252.215298:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575237120 00000100:00100000:2.0:1783444252.215334:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1783444252.215342:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87096:x1870073575237120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783444252.215448:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87096:x1870073575237120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.215455:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1783444252.215528:0:87096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87096:1870073575237120:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444252.215582:0:87096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87096:1870073575237248:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444252.215604:0:87096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1783444252.215776:0:87061:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783444252.215858:0:87061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783444252.216056:0:87096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6b093c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444252.216111:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575237248 00000100:00100000:2.0:1783444252.216116:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575237248 00000100:00100000:2.0:1783444252.216222:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:2.0:1783444252.216230:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87096:x1870073575237248:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783444252.216283:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87096:x1870073575237248:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.216306:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:0.0:1783444252.216381:0:87096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87096:1870073575237248:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1783444252.216422:0:87096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783444252.217305:0:87061:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783444252.217345:0:87061:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783444252.217408:0:87061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783444252.220290:0:87061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783444252.220404:0:87095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783444252.220456:0:87095:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1783444252.221995:0:87061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783444252.222058:0:87061:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783444252.222196:0:87061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783444252.222714:0:87061:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00000040:00080000:0.0:1783444252.223726:0:87096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783444252.223783:0:87096:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783444252.224213:0:87096:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1783444252.224684:0:87061:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215108 00010000:00080000:2.0:1783444252.225725:0:87097:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87097 00010000:02000000:2.0:1783444252.225781:0:87097:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1783444252.225785:0:87097:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783444252.225819:0:87097:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1783444252.226509:0:87061:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783444252.226525:0:87061:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783444252.226550:0:87061:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783444252.226570:0:87061:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783444252.229784:0:87061:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444252.230178:0:87061:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783444252.588219:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444252.880347:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444252.880529:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557760000 00000100:00100000:1.0:1783444252.880539:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557760000 00000100:00100000:1.0:1783444252.880599:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:1.0:1783444252.880609:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+5:42401:x1870073557760000:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444252.880626:0:87066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444252.880646:0:87066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3831bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a95 expref: -99 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.880675:0:87066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3831bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a95 expref: 6 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.880686:0:87066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3831bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a95 expref: 6 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.880696:0:87066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71a00, rc 0) 00000100:00100000:1.0:1783444252.880756:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557760000:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 148us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.880763:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:2.0:1783444252.891654:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444252.891777:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557760128 00000100:00100000:3.0:1783444252.891819:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557760128 00000100:00100000:3.0:1783444252.891873:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1783444252.891883:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557760128:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783444252.891910:0:87075:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783444252.891933:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783444252.891937:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783444252.891940:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783444252.891943:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783444252.891945:0:87075:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:2.0:1783444252.893561:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557760128:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 Request processed in 1670us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.893574:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1783444252.906931:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444252.906975:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444252.907016:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557760256 00000100:00100000:2.0:1783444252.907026:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557760256 00000100:00100000:2.0:1783444252.907069:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1129 00000100:00100000:2.0:1783444252.907078:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557760256:12345-192.168.204.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1783444252.907114:0:66225:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '778015c5-4969-44f5-82a5-0f6eadd152d5' at ffff9368c518c800, cookie 0x42cb6883e3831b28 00010000:00080000:2.0:1783444252.907120:0:66225:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp recovering/t103079215109 exp ffff9368c518c800 cur 3243 last 1783444252 00010000:02000400:2.0:1783444252.907130:0:66225:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1783444252.907136:0:66225:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1783444252.907171:0:66225:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783444252.907321:0:66225:0:(import.c:65:import_set_state_nolock()) ffff9368ff57f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444252.907399:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557760256:12345-192.168.204.20@tcp:38:ll_cfg_requeue.0 Request processed in 320us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.907407:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1129 00000100:00100000:1.0:1783444252.908257:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557760384 00000100:00100000:1.0:1783444252.908265:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557760384 00000100:00100000:1.0:1783444252.908310:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1783444252.908319:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557760384:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444252.908331:0:87068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444252.908352:0:87068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70a00/0x42cb6883e3831be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a9c expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.908380:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70a00/0x42cb6883e3831be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a9c expref: 7 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.908391:0:87068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70a00/0x42cb6883e3831be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a9c expref: 7 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444252.908407:0:87068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70a00, rc 0) 00000100:00100000:1.0:1783444252.908443:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+7:42401:x1870073557760384:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 126us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.908450:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1783444252.918871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444252.919532:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557753600 00000100:00100000:2.0:1783444252.919542:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557753600 00000100:00100000:2.0:1783444252.919609:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1130 00000100:00100000:2.0:1783444252.919620:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557753600:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00080000:2.0:1783444252.919990:0:66226:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215109, current: 103079215109, replaying 00000100:00100000:2.0:1783444252.920005:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557753600:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 387us (1145us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444252.920012:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1130 00010000:00080000:1.0:1783444252.920056:0:87097:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1783444252.924434:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444252.925748:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557760512 00000100:00100000:1.0:1783444252.925762:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557760512 00000100:00100000:1.0:1783444252.925847:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1783444252.925858:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+7:42401:x1870073557760512:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444252.926842:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557760512:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 175us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.926856:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1783444252.930714:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444252.930781:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557760640 00000100:00100000:2.0:1783444252.930808:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557760640 00000100:00100000:2.0:1783444252.930855:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:2.0:1783444252.930864:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557760640:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444252.931012:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557760640:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 148us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.931021:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1783444252.952673:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444252.952923:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557760768 00000100:00100000:2.0:1783444252.952934:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557760768 00000100:00100000:2.0:1783444252.952991:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:2.0:1783444252.953001:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c593c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557760768:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444252.953020:0:87066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444252.953039:0:87066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031000/0x42cb6883e3831bec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939aa3 expref: -99 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444252.953070:0:87066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031000/0x42cb6883e3831bec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939aa3 expref: 9 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444252.953082:0:87066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031000/0x42cb6883e3831bec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939aa3 expref: 9 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444252.953106:0:87066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031000, rc 0) 00000100:00100000:2.0:1783444252.954479:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c593c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557760768:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 1466us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444252.954491:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:1.0:1783444252.978084:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444252.980118:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557760896 00000100:00100000:3.0:1783444252.980133:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557760896 00000100:00100000:3.0:1783444252.980213:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1783444252.980222:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c593d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557760896:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444252.980614:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c593d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557760896:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 157us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444252.980625:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:1.0:1783444252.985656:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444252.985693:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557761024 00000100:00100000:1.0:1783444252.985704:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557761024 00000100:00100000:1.0:1783444252.985757:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:1.0:1783444252.985784:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c593cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557761024:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444252.985971:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c593cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557761024:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 190us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444252.985980:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:3.0:1783444252.995457:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444252.995527:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557761152 00000100:00100000:0.0:1783444252.995537:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557761152 00000100:00100000:0.0:1783444252.995586:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1783444252.995596:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c593e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557761152:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444252.995612:0:87066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444252.995637:0:87066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef263400/0x42cb6883e3831bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939aaa expref: -99 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.995684:0:87066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef263400/0x42cb6883e3831bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939aaa expref: 10 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.995695:0:87066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef263400/0x42cb6883e3831bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939aaa expref: 10 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444252.995704:0:87066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef263400, rc 0) 00000100:00100000:0.0:1783444252.995760:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c593e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557761152:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 165us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444252.995767:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:3.0:1783444253.006856:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444253.007056:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557761280 00000100:00100000:2.0:1783444253.007068:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557761280 00000100:00100000:2.0:1783444253.007178:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:2.0:1783444253.007189:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c593d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557761280:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.007334:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c593d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557761280:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 147us (487us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783444253.007343:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 10000000:01000000:1.0:1783444253.340966:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783444253.340976:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9367c3a05800 from 111 10000000:01000000:1.0:1783444253.340981:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783444253.341035:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.341047:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.341059:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.341084:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.341162:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.341256:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444253.356716:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575237376 00000100:00100000:3.0:1783444253.356733:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575237376 00000100:00100000:3.0:1783444253.356867:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783444253.357078:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c593ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:6503:x1870073575237376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444253.357095:0:87069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444253.357113:0:87069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1b800/0x42cb6883e3831c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831bfa expref: -99 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.357150:0:87069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1b800/0x42cb6883e3831c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831bfa expref: 11 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.357163:0:87069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1b800/0x42cb6883e3831c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831bfa expref: 11 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.357172:0:87069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1b800, rc 0) 00000100:00100000:3.0:1783444253.357252:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c593ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575237376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (16090us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444253.357260:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783444253.357346:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.357365:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.357375:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.357444:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.357484:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.366626:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.366777:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575237504 00000100:00100000:2.0:1783444253.366804:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575237504 00000100:00100000:2.0:1783444253.366862:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783444253.366881:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575237504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783444253.366905:0:87066:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783444253.366921:0:87066:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783444253.366924:0:87066:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 111 00000100:00100000:2.0:1783444253.367033:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575237504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (9548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.367054:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783444253.367397:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783444253.367455:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783444253.367465:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.367482:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444253.367493:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783444253.367495:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 52 10000000:01000000:1.0:1783444253.367498:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783444253.367526:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.367535:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.367544:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.367563:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.367593:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.367626:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.368779:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575237632 00000100:00100000:2.0:1783444253.368812:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575237632 00000100:00100000:2.0:1783444253.368861:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783444253.368946:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575237632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444253.368968:0:87068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444253.368983:0:87068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0030600/0x42cb6883e3831c0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c08 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.369009:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030600/0x42cb6883e3831c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c08 expref: 12 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.369019:0:87068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0030600/0x42cb6883e3831c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c08 expref: 12 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.369029:0:87068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030600, rc 0) 00000100:00100000:2.0:1783444253.369080:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575237632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.369087:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783444253.369193:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.369210:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c0f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.369219:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c0f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.369294:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.369323:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.370036:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444253.370907:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575237760 00000100:00100000:3.0:1783444253.370917:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575237760 00000100:00100000:3.0:1783444253.370985:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783444253.370995:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575237760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.371161:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575237760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444253.371169:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783444253.371331:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.371380:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.371432:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.371461:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.371575:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575237888 00000100:00100000:2.0:1783444253.371581:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575237888 00000100:00100000:2.0:1783444253.371616:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783444253.371623:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575237888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.371707:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575237888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.371713:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783444253.371864:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575237888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444253.372739:0:87136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783444253.373014:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783444253.373041:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444253.373052:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c0f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.373063:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c0f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444253.373084:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783444253.373087:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cd800 from 108 10000000:01000000:2.0:1783444253.373090:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783444253.373119:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.373127:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.373136:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444253.373163:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.373207:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444253.373245:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0424240 going to sleep for 11 seconds 00000100:00100000:3.0:1783444253.373327:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575238016 00000100:00100000:3.0:1783444253.373338:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575238016 00000100:00100000:3.0:1783444253.373380:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783444253.373387:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575238016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444253.373397:0:87068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444253.373407:0:87068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1ac00/0x42cb6883e3831c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c16 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.373440:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1ac00/0x42cb6883e3831c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c16 expref: 13 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.373451:0:87068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1ac00/0x42cb6883e3831c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c16 expref: 13 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.373459:0:87068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1ac00, rc 0) 00000100:00100000:3.0:1783444253.373495:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575238016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444253.373502:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783444253.373545:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444253.374056:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c1d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.374067:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c1d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.374120:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.374164:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.374187:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.374425:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575238144 00000100:00100000:2.0:1783444253.374430:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575238144 00000100:00100000:2.0:1783444253.374457:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783444253.374464:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575238144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783444253.374480:0:87075:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783444253.374496:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783444253.374500:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1783444253.374504:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1783444253.374507:0:87075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1783444253.374509:0:87075:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:2.0:1783444253.374595:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575238144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.374603:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783444253.375070:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783444253.375165:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783444253.375173:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c1d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.375182:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c1d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444253.375190:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783444253.375193:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783444253.375195:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444253.375217:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.375223:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.375231:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.375245:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.375280:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.375301:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.376961:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575238272 00000100:00100000:2.0:1783444253.376971:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575238272 00000100:00100000:2.0:1783444253.377016:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783444253.377024:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575238272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444253.377038:0:87068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444253.377054:0:87068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031c00/0x42cb6883e3831c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c24 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.377079:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031c00/0x42cb6883e3831c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c24 expref: 14 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.377088:0:87068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031c00/0x42cb6883e3831c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c24 expref: 14 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.377097:0:87068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031c00, rc 0) 00000100:00100000:2.0:1783444253.377181:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575238272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.377188:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783444253.377229:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444253.377246:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c2b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.377254:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c2b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.377335:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.377369:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.377400:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.379467:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575238400 00000100:00100000:2.0:1783444253.379483:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575238400 00000100:00100000:2.0:1783444253.379542:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783444253.379552:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575238400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.379752:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575238400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.379760:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783444253.379829:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.379995:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.380043:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.380080:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.380128:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575238528 00000100:00100000:1.0:1783444253.380133:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575238528 00000100:00100000:1.0:1783444253.380178:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783444253.380186:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575238528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.381475:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575238528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1285us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.381487:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783444253.381600:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444253.388978:0:87137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1783444253.389112:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1783444253.389149:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783444253.389160:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c2b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.389172:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c2b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444253.389181:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1783444253.389183:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ef0cd800 from 1 10000000:01000000:1.0:1783444253.389186:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783444253.389219:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.389238:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.389250:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.389274:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.389337:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.389380:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.389484:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575238656 00000100:00100000:2.0:1783444253.389492:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575238656 00000100:00100000:2.0:1783444253.389535:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783444253.389542:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575238656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444253.389561:0:87068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444253.389573:0:87068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0030000/0x42cb6883e3831c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c32 expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.389602:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030000/0x42cb6883e3831c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c32 expref: 15 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.389618:0:87068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0030000/0x42cb6883e3831c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c32 expref: 15 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.389627:0:87068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030000, rc 0) 00000100:00100000:2.0:1783444253.389670:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575238656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.389677:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783444253.389760:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.389774:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c39 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.389783:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c39 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444253.390196:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783444253.390200:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c39 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.390208:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c39 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444253.390215:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783444253.390217:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef0cd800 from 7 10000000:01000000:1.0:1783444253.390219:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783444253.390236:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.390254:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.390262:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.390275:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.390304:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.390372:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.397644:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575238784 00000100:00100000:2.0:1783444253.397661:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575238784 00000100:00100000:1.0:1783444253.399417:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783444253.399430:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575238784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.399449:0:87074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444253.399468:0:87074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d71c00/0x42cb6883e3831c47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c40 expref: -99 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.399495:0:87074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d71c00/0x42cb6883e3831c47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c40 expref: 16 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.399506:0:87074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d71c00/0x42cb6883e3831c47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c40 expref: 16 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.399516:0:87074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71c00, rc 0) 00000100:00100000:1.0:1783444253.399600:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575238784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (9294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.399607:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783444253.399754:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444253.399773:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c47 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444253.399783:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c47 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.400061:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.400115:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444253.400177:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575238912 00000100:00100000:1.0:1783444253.400180:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444253.400184:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575238912 00000100:00100000:0.0:1783444253.400266:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783444253.400275:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575238912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.400544:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575238912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444253.400552:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783444253.409623:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575238912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.409706:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.409814:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.409859:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444253.410982:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575239040 00000100:00100000:0.0:1783444253.410999:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575239040 00000100:00100000:1.0:1783444253.411078:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783444253.411092:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575239040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.411259:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575239040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.411267:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783444253.411395:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444253.417670:0:87140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444253.418883:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444253.418912:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444253.418924:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c47 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444253.418937:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c47 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444253.418948:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444253.418950:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 52 10000000:01000000:0.0:1783444253.418954:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444253.418993:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444253.419001:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444253.419012:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444253.419040:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.419114:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444253.419352:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6827780 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.420378:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575239168 00000100:00100000:2.0:1783444253.420388:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575239168 00000100:00100000:2.0:1783444253.420443:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783444253.420453:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575239168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444253.420469:0:87075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444253.420485:0:87075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031400/0x42cb6883e3831c55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c4e expref: -99 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.420510:0:87075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031400/0x42cb6883e3831c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c4e expref: 17 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.420521:0:87075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031400/0x42cb6883e3831c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c4e expref: 17 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.420538:0:87075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031400, rc 0) 00000100:00100000:2.0:1783444253.420593:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575239168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.420600:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783444253.421228:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444253.421250:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c55 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444253.421274:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c55 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444253.421351:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.421392:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444253.421468:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6827780 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.422010:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575239296 00000100:00100000:2.0:1783444253.422018:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575239296 00000100:00100000:2.0:1783444253.422091:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783444253.422100:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575239296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.422261:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575239296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.422270:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783444253.422336:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.422377:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.422435:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.422781:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444253.422841:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575239424 00000100:00100000:0.0:1783444253.422847:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575239424 00000100:00100000:0.0:1783444253.422947:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783444253.422955:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575239424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.423039:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575239424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444253.423047:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783444253.423196:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444253.424320:0:87143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783444253.424571:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783444253.424598:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444253.424609:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c55 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.424620:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c55 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444253.424629:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783444253.424704:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783444253.424708:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444253.424742:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.424751:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.424761:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.424784:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.433248:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.433332:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444253.433528:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575239552 00000100:00100000:0.0:1783444253.433540:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575239552 00000100:00100000:0.0:1783444253.433601:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783444253.433610:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575239552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444253.433627:0:87068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444253.435238:0:87068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70c00/0x42cb6883e3831c63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c5c expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.435301:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70c00/0x42cb6883e3831c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c5c expref: 18 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.435313:0:87068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70c00/0x42cb6883e3831c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c5c expref: 18 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.435323:0:87068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70c00, rc 0) 00000100:00100000:1.0:1783444253.435416:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575239552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1806us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.435425:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783444253.435751:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444253.435771:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c63 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.435781:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c63 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.435958:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.435999:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.436031:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444253.436124:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575239680 00000100:00100000:0.0:1783444253.436132:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575239680 00000100:00100000:0.0:1783444253.436184:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783444253.436193:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575239680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.436348:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575239680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444253.436372:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783444253.436733:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.436764:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.436834:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.436856:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.437093:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575239808 00000100:00100000:1.0:1783444253.437172:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575239808 00000100:00100000:1.0:1783444253.437205:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783444253.437212:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c1e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575239808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.438176:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c1e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575239808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 960us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.438187:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783444253.438245:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444253.440892:0:87145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783444253.441841:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783444253.442467:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783444253.442482:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c63 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.442495:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c63 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444253.442506:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783444253.442509:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368f9acf800 from 7 10000000:01000000:3.0:1783444253.442511:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783444253.442550:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.442558:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.442568:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.442593:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.442962:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.443004:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.444234:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575239936 00000100:00100000:1.0:1783444253.444244:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575239936 00000100:00100000:1.0:1783444253.444301:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783444253.444323:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575239936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.444339:0:87068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444253.444357:0:87068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3831c71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c6a expref: -99 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.444382:0:87068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3831c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c6a expref: 19 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.444393:0:87068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3831c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c6a expref: 19 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.444401:0:87068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70e00, rc 0) 00000100:00100000:1.0:1783444253.444459:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575239936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.444465:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783444253.444515:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575239936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.444530:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c71 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.444550:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c71 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.444623:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.444657:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.444694:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.444751:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575240064 00000100:00100000:2.0:1783444253.444756:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575240064 00000100:00100000:2.0:1783444253.444809:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783444253.444817:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575240064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.444934:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575240064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.444941:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783444253.445838:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.445882:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.445927:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.445957:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.447266:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575240192 00000100:00100000:1.0:1783444253.447279:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575240192 00000100:00100000:1.0:1783444253.447333:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783444253.447342:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575240192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.447470:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575240192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.447477:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783444253.447505:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444253.449598:0:87149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783444253.451296:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783444253.451340:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783444253.451353:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c71 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.451368:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c71 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444253.451404:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783444253.451408:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 52 10000000:01000000:1.0:1783444253.451411:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783444253.451453:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.451466:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.451477:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.451503:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.451570:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.451621:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.451754:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575240320 00000100:00100000:2.0:1783444253.451763:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575240320 00000100:00100000:2.0:1783444253.451841:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783444253.451852:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575240320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444253.451865:0:87075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444253.451895:0:87075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0030a00/0x42cb6883e3831c7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c78 expref: -99 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.451922:0:87075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030a00/0x42cb6883e3831c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c78 expref: 20 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.451932:0:87075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0030a00/0x42cb6883e3831c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c78 expref: 20 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.451941:0:87075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030a00, rc 0) 00000100:00100000:2.0:1783444253.451995:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575240320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.452002:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783444253.452169:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444253.452185:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c7f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.452194:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c7f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.452268:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.452296:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.452325:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.453755:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575240448 00000100:00100000:2.0:1783444253.453766:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575240448 00000100:00100000:2.0:1783444253.453840:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783444253.453850:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575240448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.454001:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575240448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.454010:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783444253.455060:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.455116:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e726a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.455187:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444253.455228:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6827540 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.455277:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575240576 00000100:00100000:1.0:1783444253.455283:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575240576 00000100:00100000:1.0:1783444253.455327:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783444253.455336:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575240576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.455559:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575240576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.455567:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783444253.459586:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e726a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444253.465475:0:87152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783444253.465718:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783444253.465741:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783444253.465752:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c7f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.465764:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c7f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444253.465782:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783444253.465784:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1783444253.465809:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783444253.465846:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.465854:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.465866:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.465903:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.465972:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.466013:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.466170:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575240704 00000100:00100000:2.0:1783444253.466179:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575240704 00000100:00100000:2.0:1783444253.466230:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783444253.466240:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575240704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444253.466254:0:87074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444253.466267:0:87074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031600/0x42cb6883e3831c8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c86 expref: -99 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.466303:0:87074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031600/0x42cb6883e3831c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c86 expref: 21 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.466313:0:87074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031600/0x42cb6883e3831c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c86 expref: 21 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.466322:0:87074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031600, rc 0) 00000100:00100000:2.0:1783444253.466365:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575240704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.466372:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783444253.466461:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.466475:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c8d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.466483:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c8d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.466551:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.466576:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.466599:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.466742:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575240832 00000100:00100000:2.0:1783444253.466746:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575240832 00000100:00100000:2.0:1783444253.466771:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783444253.466778:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575240832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.466943:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575240832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.466950:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783444253.467087:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.467116:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.467174:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.467198:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444253.467240:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575240960 00000100:00100000:2.0:1783444253.467244:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575240960 00000100:00100000:2.0:1783444253.467269:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783444253.467275:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575240960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.474502:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575240960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7218us (7318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444253.474518:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783444253.474712:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575240960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444253.478180:0:87153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1783444253.478483:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1783444253.478528:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783444253.478548:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c8d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.478560:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c8d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444253.478570:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783444253.478573:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef29c800 from 7 10000000:01000000:2.0:1783444253.478576:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783444253.478609:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.478618:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444253.478628:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444253.478723:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444253.478785:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444253.479002:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c698ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.479246:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575241088 00000100:00100000:1.0:1783444253.479254:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575241088 00000100:00100000:1.0:1783444253.479299:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783444253.479308:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575241088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.479322:0:87066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444253.479335:0:87066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d71e00/0x42cb6883e3831c9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831c94 expref: -99 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.479363:0:87066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d71e00/0x42cb6883e3831c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831c94 expref: 22 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.479374:0:87066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d71e00/0x42cb6883e3831c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831c94 expref: 22 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.479383:0:87066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71e00, rc 0) 00000100:00100000:1.0:1783444253.479428:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575241088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.479435:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783444253.479485:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.479500:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c9b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.479510:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c9b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444253.480251:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.480287:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.480317:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368caa40600 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.483532:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575241216 00000100:00100000:1.0:1783444253.483551:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575241216 00000100:00100000:1.0:1783444253.484873:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783444253.484884:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575241216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.485071:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575241216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (4782us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.485079:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783444253.486024:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.486086:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e726a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.486158:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444253.486194:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6827540 going to sleep for 11 seconds 00000100:00100000:3.0:1783444253.486418:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575241344 00000100:00100000:3.0:1783444253.486425:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575241344 00000100:00100000:3.0:1783444253.486499:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783444253.486508:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575241344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.486691:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575241344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444253.486699:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783444253.488778:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e726a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444253.493536:0:87154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783444253.493928:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783444253.493959:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783444253.493971:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c9b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.493982:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c9b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444253.493990:0:6503:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1783444253.493992:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9368c507b380 from 1 10000000:01000000:3.0:1783444253.493995:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783444253.494037:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.494045:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.494056:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.494164:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.494236:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.494328:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.494711:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575241472 00000100:00100000:1.0:1783444253.494719:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575241472 00000100:00100000:1.0:1783444253.494776:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783444253.494857:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575241472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.494873:0:87069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444253.494890:0:87069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70600/0x42cb6883e3831ca9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831ca2 expref: -99 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.494916:0:87069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70600/0x42cb6883e3831ca9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831ca2 expref: 23 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.494926:0:87069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70600/0x42cb6883e3831ca9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831ca2 expref: 23 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.494935:0:87069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70600, rc 0) 00000100:00100000:1.0:1783444253.495026:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575241472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.495042:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783444253.495196:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444253.495214:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831ca9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.495223:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831ca9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444253.495243:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783444253.495249:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831ca9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.495255:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831ca9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444253.495262:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783444253.495264:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:3.0:1783444253.495266:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783444253.495286:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.495294:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444253.495302:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444253.495331:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444253.495365:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444253.495428:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.495459:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575241600 00000100:00100000:1.0:1783444253.495464:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575241600 00000100:00100000:1.0:1783444253.495522:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783444253.495530:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575241600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444253.495538:0:87066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444253.495547:0:87066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5757600/0x42cb6883e3831cb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3831cb0 expref: -99 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.495646:0:87066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5757600/0x42cb6883e3831cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3831cb0 expref: 24 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.495655:0:87066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5757600/0x42cb6883e3831cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3831cb0 expref: 24 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.495661:0:87066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757600, rc 0) 00000100:00100000:1.0:1783444253.495695:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575241600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444253.495701:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783444253.495829:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444253.495843:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831cb7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444253.495852:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831cb7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444253.497103:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e726a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444253.497164:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444253.497211:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575241728 00000100:00100000:0.0:1783444253.497212:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6827a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444253.497220:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575241728 00000100:00100000:1.0:1783444253.497266:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783444253.497275:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575241728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444253.497360:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575241728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783444253.497368:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783444253.502931:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e726a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575241728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783444253.502997:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783444253.503008:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831cb7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444253.503019:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831cb7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444253.604116:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444254.620932:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444255.520081:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444255.520114:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575241856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444255.520182:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444255.520239:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575241856 00000100:00100000:3.0:1783444255.520246:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575241856 00000100:00100000:3.0:1783444255.520309:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:3.0:1783444255.520320:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575241856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444255.520350:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444255.520395:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575241856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444255.520402:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00080000:3.0:1783444255.520428:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444255.520464:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575241856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444255.520925:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444255.520939:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575241984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444255.520971:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444255.524227:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575241984 00000100:00100000:0.0:1783444255.524242:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575241984 00000100:00100000:0.0:1783444255.524319:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:0.0:1783444255.524330:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575241984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444255.524363:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444255.524437:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575241984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (3465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444255.524444:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:2.0:1783444255.524684:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575241984:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783444255.524782:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783444255.655074:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444256.677437:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444256.861002:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444256.861046:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444256.861208:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557761536 00000100:00100000:3.0:1783444256.861220:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557761536 00000100:00100000:3.0:1783444256.861293:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 852 00000100:00100000:3.0:1783444256.861304:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557761536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444256.861378:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557761536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444256.861386:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 852 00000100:00100000:0.0:1783444256.861661:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557761408 00000100:00100000:0.0:1783444256.861666:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557761408 00000100:00100000:0.0:1783444256.861715:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:0.0:1783444256.861723:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557761408:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444256.861761:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557761408:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444256.861780:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00080000:2.0:1783444256.865607:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444257.566688:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444257.566696:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444257.566699:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444257.566709:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3243 00000100:00080000:1.0:1783444257.566713:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783444257.566720:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444257.566745:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973f100 x1870073575242240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444257.566773:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444257.566777:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444257.566779:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444257.566782:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3243 00000100:00080000:1.0:1783444257.566784:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1783444257.567633:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575242368:0@lo:400:kworker.0 00000100:00100000:0.0:1783444257.567703:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444257.567745:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444257.567752:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575242112:0@lo:400:kworker.0 00000100:00100000:0.0:1783444257.567780:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444257.567862:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575242368 00000100:00100000:0.0:1783444257.567870:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575242368 00000100:00100000:0.0:1783444257.567918:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1783444257.567926:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575242368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444257.567974:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575242368:12345-0@lo:400:kworker.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444257.567995:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00080000:0.0:1783444257.568016:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444257.568049:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575242368:0@lo:400:kworker.0 00000100:00100000:0.0:1783444257.568102:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575242240:0@lo:38:kworker.0 00000100:00100000:0.0:1783444257.568125:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444257.571164:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575242240 00000100:00100000:3.0:1783444257.571179:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575242240 00000100:00100000:3.0:1783444257.571221:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00080000:1.0:1783444257.571271:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444257.571355:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5098a80 x1870073575242624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444257.571387:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575242624:0@lo:38:kworker.0 00000100:00100000:1.0:1783444257.571446:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783444257.571513:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444257.571518:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444257.571521:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444257.571526:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3243 00000100:00080000:1.0:1783444257.571529:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783444257.571533:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444257.571562:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5506d80 x1870073575242880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444257.571583:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575242880:0@lo:38:kworker.0 00000100:00100000:1.0:1783444257.571611:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444257.571655:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444257.571663:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575243008:0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.571689:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783444257.571724:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444257.571727:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444257.571729:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444257.571732:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3243 00000100:00080000:1.0:1783444257.571735:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783444257.571739:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444257.571747:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575243136:0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.571767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444257.572038:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575242240:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783444257.572081:0:71469:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3248 last 0 00000020:00000080:3.0:1783444257.572117:0:71469:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42cb6883e3831cbe 00000004:00100000:3.0:1783444257.572131:0:71469:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783444257.572256:0:71469:0:(import.c:65:import_set_state_nolock()) ffff9367c4e20800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444257.572327:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1870073575242240:12345-0@lo:38:kworker.0 Request processed in 1096us (4199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444257.572381:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5505c00 x1870073575243264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444257.572411:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783444257.572414:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444257.572424:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444257.572430:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9367c6a4f800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444257.572438:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444257.572446:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575243648:0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.572471:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444257.572501:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575243008 00000100:00100000:1.0:1783444257.572506:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575243008 00000100:00100000:1.0:1783444257.572560:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575243136 00000100:00100000:1.0:1783444257.572563:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575243136 00000100:00100000:1.0:1783444257.572585:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575243648 00000100:00100000:1.0:1783444257.572588:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575243648 00000100:00100000:1.0:1783444257.572609:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301 00000100:00100000:1.0:1783444257.572616:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575243008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.572653:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575243008:12345-0@lo:400:kworker.0 Request processed in 37us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444257.572660:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301 00000100:00100000:1.0:1783444257.572677:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:1.0:1783444257.572682:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575243136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.572708:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575243136:12345-0@lo:400:kworker.0 Request processed in 26us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444257.572714:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:1.0:1783444257.572724:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303 00000100:00100000:1.0:1783444257.572730:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575243648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.572756:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575243648:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444257.572762:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303 00000100:00080000:1.0:1783444257.572777:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444257.575259:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444257.575340:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575243648:0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.575355:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575243136:0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.575366:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575243008:0@lo:400:kworker.0 00000100:00100000:1.0:1783444257.575432:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5507100 x1870073575243776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444257.578639:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575242624 00000100:00100000:2.0:1783444257.578655:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575242624 00000100:00100000:2.0:1783444257.578867:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1783444257.578877:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575242624:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783444257.578919:0:66226:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3248 last 0 00000020:00000080:2.0:1783444257.579081:0:66226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42cb6883e3831cc5 00000004:00100000:2.0:1783444257.579099:0:66226:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783444257.579139:0:66226:0:(import.c:65:import_set_state_nolock()) ffff9368ff57e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444257.579218:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1870073575242624:12345-0@lo:38:kworker.0 Request processed in 341us (7771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444257.579226:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1783444257.579263:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575242496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444257.579309:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444257.579334:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575243392:0@lo:400:kworker.0 00000100:00100000:2.0:1783444257.579397:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444257.579421:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783444257.579428:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575242752:0@lo:400:kworker.0 00000100:00100000:2.0:1783444257.579451:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444257.579468:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575243520:0@lo:400:kworker.0 00000100:00100000:2.0:1783444257.579488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444257.580243:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575242880 00000100:00100000:2.0:1783444257.580251:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575242880 00000100:00100000:2.0:1783444257.580278:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575242496 00000100:00100000:2.0:1783444257.580281:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575242496 00000100:00100000:2.0:1783444257.580300:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575243392 00000100:00100000:2.0:1783444257.580303:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575243392 00000100:00100000:2.0:1783444257.580315:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1783444257.580322:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575242880:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783444257.580357:0:29151:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9368c518b000, cookie 0x42cb6883e3831b2f 00010000:00080000:2.0:1783444257.580362:0:29151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9368c518b000 cur 3248 last 1783444252 00000004:00100000:2.0:1783444257.580377:0:29151:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783444257.580399:0:29151:0:(import.c:65:import_set_state_nolock()) ffff9368ff57d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444257.580454:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575242880:12345-0@lo:38:kworker.0 Request processed in 132us (8842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444257.580461:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1783444257.580476:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:2.0:1783444257.580482:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fa170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3633:x1870073575242496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444257.580509:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:0.0:1783444257.580640:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575242752 00000100:00100000:0.0:1783444257.580645:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575242752 00000100:00100000:0.0:1783444257.580698:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1783444257.580705:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575242752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444257.580748:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575242752:12345-0@lo:400:kworker.0 Request processed in 44us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444257.580755:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1783444257.580935:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1783444257.581082:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3633:x1870073575243392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444257.581118:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3633:x1870073575243392:12345-0@lo:400:kworker.0 Request processed in 176us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444257.581125:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00080000:0.0:1783444257.581149:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444257.581184:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575242752:0@lo:400:kworker.0 00000100:00100000:0.0:1783444257.581196:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575243392:0@lo:400:kworker.0 00000100:00100000:2.0:1783444257.581370:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fa170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575242496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 888us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444257.581377:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1783444257.581625:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575242496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444257.585205:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575243520 00000100:00100000:2.0:1783444257.585219:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575243520 00000100:00100000:2.0:1783444257.585280:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304 00000100:00100000:2.0:1783444257.585289:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575243520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444257.585378:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575243520:12345-0@lo:400:kworker.0 Request processed in 90us (5888us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444257.585385:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304 00010000:00080000:2.0:1783444257.585428:0:87097:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1783444257.585434:0:87097:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 103079215109 00000020:00080000:2.0:1783444257.585439:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783444257.585443:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215109, next_transno: 103079215109 00010000:00080000:2.0:1783444257.585447:0:87097:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215109) 00000020:00080000:2.0:1783444257.585457:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783444257.585468:0:87097:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557753600 t103079215109 from 192.168.204.20@tcp req@ffff9368f973ea00 x1870073557753600/t0(103079215109) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:628/0 lens 528/0 e 0 to 0 dl 1783444263 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444257.588395:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444257.588460:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575243520:0@lo:400:kworker.0 00000100:00100000:3.0:1783444257.590554:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1783444257.590617:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575242112 00000100:00100000:3.0:1783444257.590626:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575242112 00000100:00100000:3.0:1783444257.590682:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783444257.590691:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575242112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444257.590815:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575242112:12345-0@lo:400:kworker.0 Request processed in 123us (23030us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444257.590822:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783444257.590878:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575243264:0@lo:38:kworker.0 00000100:00100000:3.0:1783444257.590914:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444257.590941:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575243776:0@lo:38:kworker.0 00000100:00100000:3.0:1783444257.590962:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444257.591005:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:3.0:1783444257.591018:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1783444257.591022:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1783444257.591025:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:3.0:1783444257.591039:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368f8ca7800 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:3.0:1783444257.591042:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1783444257.591087:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575242112:0@lo:400:kworker.0 00000100:00100000:3.0:1783444257.591114:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575243264 00000100:00100000:3.0:1783444257.591117:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575243264 00000100:00100000:3.0:1783444257.591134:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575243776 00000100:00100000:3.0:1783444257.591137:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575243776 00000100:00100000:3.0:1783444257.591151:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1783444257.591156:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575243264:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783444257.591181:0:66226:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3248 last 0 00000020:00000080:3.0:1783444257.591223:0:66226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x42cb6883e3831ccc 00000004:00100000:3.0:1783444257.591238:0:66226:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783444257.591265:0:66226:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444257.591304:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1870073575243264:12345-0@lo:38:kworker.0 Request processed in 146us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444257.591311:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1783444257.591325:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1783444257.591329:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575243776:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783444257.591342:0:66226:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3248 last 0 00000020:00000080:3.0:1783444257.591368:0:66226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42cb6883e3831cd3 00000004:00100000:3.0:1783444257.591374:0:66226:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783444257.591389:0:66226:0:(import.c:65:import_set_state_nolock()) ffff9368dd1ee000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444257.591419:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575243776:12345-0@lo:38:kworker.0 Request processed in 87us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444257.591425:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1783444257.591537:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575242880:0@lo:38:kworker.0 00010000:00080000:3.0:1783444257.591565:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c5098a80 x1870073575242624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444257.591578:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:3.0:1783444257.592421:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9367c5098a80 x1870073575242624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444257.592430:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783444257.592433:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444257.592437:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783444257.592442:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575242624:0@lo:38:kworker.0 00010000:00080000:3.0:1783444257.592465:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368f973f100 x1870073575242240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444257.592475:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000004:00080000:2.0:1783444257.593137:0:87097:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4779us 00000100:00080000:3.0:1783444257.593334:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9368f973f100 x1870073575242240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444257.593344:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783444257.593348:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444257.593352:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783444257.593356:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575242240:0@lo:38:kworker.0 00010000:00080000:3.0:1783444257.593405:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c5505c00 x1870073575243264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444257.593416:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:3.0:1783444257.605981:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9367c5505c00 x1870073575243264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444282 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444257.605998:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783444257.606021:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444257.606027:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783444257.606033:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575243264:0@lo:38:kworker.0 00010000:00080000:3.0:1783444257.606085:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c5507100 x1870073575243776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444257.606102:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:3.0:1783444257.606112:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783444257.606117:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783444257.606119:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783444257.606123:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575243776:0@lo:38:kworker.0 00010000:00080000:3.0:1783444257.606171:0:87307:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1783444257.606175:0:87307:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1783444257.606182:0:87307:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1783444257.608175:0:87307:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1783444257.608252:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575243904:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783444257.608330:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444257.642831:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575243904 00000100:00100000:0.0:1783444257.642847:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575243904 00000100:00100000:0.0:1783444257.642902:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:0.0:1783444257.642920:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575243904:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1783444257.642953:0:8431:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9368e69fd500 x1870073575243904/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:633/0 lens 224/0 e 0 to 0 dl 1783444268 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444257.642969:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575243904:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 52us (34638us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444257.642975:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00010000:00010000:3.0:1783444257.658149:0:87097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.658172:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.658188:0:87097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.658201:0:87097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.658224:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.658232:0:87097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.659943:0:87097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.659958:0:87097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.659965:0:87097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.659971:0:87097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1be00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444257.659976:0:87097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.659984:0:87097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.660001:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3254500) 00010000:00010000:3.0:1783444257.660004:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444257.660009:0:87097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.660015:0:87097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1be00/0x42cb6883e3831cda lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444257.660037:0:87097:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e23f1a30 reply state 000000002d62177b transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.660057:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.660077:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c3254600) 00010000:00010000:3.0:1783444257.660079:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444257.660083:0:87097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783444257.660204:0:87097:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1783444257.660230:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444257.660234:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000020:00080000:3.0:1783444257.660238:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444257.660240:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000100:00100000:2.0:1783444257.665694:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444257.669301:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557754112 00000100:00100000:3.0:1783444257.669319:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557754112 00000100:00100000:3.0:1783444257.669390:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1135 00000100:00100000:3.0:1783444257.669401:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557754112:12345-192.168.204.20@tcp:36:rm.0 00010000:00080000:3.0:1783444257.669424:0:71469:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215110, current: 103079215110, replaying 00000100:00100000:3.0:1783444257.669449:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557754112:12345-192.168.204.20@tcp:36:rm.0 Request processed in 50us (3778us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444257.669456:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1135 00000020:00080000:0.0:1783444257.669612:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.669618:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215110, next_transno: 103079215110 00010000:00080000:0.0:1783444257.669622:0:87097:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215110) 00000020:00080000:0.0:1783444257.669625:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.669636:0:87097:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557754112 t103079215110 from 192.168.204.20@tcp req@ffff9369005b0a80 x1870073557754112/t0(103079215110) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:633/0 lens 512/0 e 0 to 0 dl 1783444268 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783444257.669734:0:87097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.669751:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.669770:0:87097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.669783:0:87097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.669818:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.669826:0:87097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.669961:0:87097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.669969:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.669976:0:87097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670231:0:87097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670239:0:87097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670246:0:87097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670252:0:87097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444257.670256:0:87097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670263:0:87097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670277:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff9367c709ea00) 00010000:00010000:0.0:1783444257.670280:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783444257.670284:0:87097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670290:0:87097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e3831cf6 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670322:0:87097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670329:0:87097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670334:0:87097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670339:0:87097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444257.670343:0:87097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670349:0:87097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670356:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c709e800) 00010000:00010000:0.0:1783444257.670358:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444257.670361:0:87097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670366:0:87097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831ce8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444257.670376:0:87097:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de2f9f20 reply state 000000008867ca22 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670387:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.670393:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c3254600) 00010000:00010000:0.0:1783444257.670400:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444257.670404:0:87097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783444257.670490:0:87097:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783444257.670525:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.670529:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000020:00080000:0.0:1783444257.670534:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.670537:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000001:00080000:3.0:1783444257.670961:0:87062:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215109 is committed 00010000:00010000:0.0:1783444257.671034:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.671044:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.671050:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.671055:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1b000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444257.671070:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.671078:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.671088:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c3254600) 00010000:00010000:0.0:1783444257.671090:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444257.671094:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.671100:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b000/0x42cb6883e3831ce1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444257.678537:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444257.678683:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557755264 00000100:00100000:0.0:1783444257.678702:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557755264 00000100:00100000:0.0:1783444257.678761:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1136 00000100:00100000:0.0:1783444257.678771:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557755264:12345-192.168.204.20@tcp:101:touch.0 00010000:00080000:0.0:1783444257.678809:0:66226:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:0.0:1783444257.678828:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557755264:12345-192.168.204.20@tcp:101:touch.0 Request processed in 58us (300us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444257.678835:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1136 00000020:00080000:1.0:1783444257.678874:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444257.678879:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:1.0:1783444257.678883:0:87097:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:1.0:1783444257.678886:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444257.678895:0:87097:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557755264 t103079215111 from 192.168.204.20@tcp req@ffff9368e69fd180 x1870073557755264/t0(103079215111) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:633/0 lens 752/0 e 0 to 0 dl 1783444268 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783444257.678919:0:87097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444257.678948:0:87097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831cfd lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939a8e expref: -99 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679186:0:87097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679201:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679214:0:87097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679228:0:87097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679247:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679255:0:87097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444257.679678:0:87097:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x5:0x0], cookie = 0x42cb6883e3831a87 00000004:00080000:1.0:1783444257.679682:0:87097:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x42cb6883e3831a87 in new mfd 00010000:00010000:1.0:1783444257.679691:0:87097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679698:0:87097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 2/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679703:0:87097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679709:0:87097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444257.679713:0:87097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679721:0:87097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679734:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368c3abd900) 00010000:00010000:1.0:1783444257.679737:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444257.679741:0:87097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679747:0:87097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3831d04 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444257.679769:0:87097:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e298fac4 reply state 00000000301136ee transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679780:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.679965:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9368c3abd800) 00010000:00010000:1.0:1783444257.679969:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444257.679973:0:87097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444257.680003:0:87097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831cfd lrc: 1/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 10 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.680014:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368c3abd900) 00010000:00010000:1.0:1783444257.680017:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444257.680020:0:87097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831cfd lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a8e expref: 10 pid: 87097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.680035:0:87097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756400, rc 0) 00010000:00080000:1.0:1783444257.680118:0:87097:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783444257.680134:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444257.680137:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:1.0:1783444257.680140:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444257.680142:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00010000:00010000:0.0:1783444257.693856:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444257.718276:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444257.718420:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557755520 00000100:00100000:3.0:1783444257.718430:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557755520 00000100:00100000:3.0:1783444257.718489:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1137 00000100:00100000:3.0:1783444257.718498:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557755520:12345-192.168.204.20@tcp:36:touch.0 00010000:00080000:3.0:1783444257.718529:0:66225:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:3.0:1783444257.718564:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557755520:12345-192.168.204.20@tcp:36:touch.0 Request processed in 67us (298us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444257.718571:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1137 00000020:00080000:1.0:1783444257.718703:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444257.718708:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:1.0:1783444257.718712:0:87097:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:1.0:1783444257.718715:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444257.718731:0:87097:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557755520 t103079215112 from 192.168.204.20@tcp req@ffff9368e726a680 x1870073557755520/t0(103079215112) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:633/0 lens 488/0 e 0 to 0 dl 1783444268 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783444257.718865:0:87097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.718881:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.718893:0:87097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444257.718996:0:87097:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000720e9554 reply state 00000000bf8fe4fb transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.719008:0:87097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.719016:0:87097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9368c3abd900) 00010000:00010000:1.0:1783444257.719019:0:87097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444257.719022:0:87097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1783444257.719115:0:87097:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783444257.719136:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444257.719139:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:1.0:1783444257.719143:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444257.719145:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:3.0:1783444257.721959:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444257.722158:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557755904 00000100:00100000:1.0:1783444257.722171:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557755904 00000100:00100000:1.0:1783444257.722247:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:1.0:1783444257.722260:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2400:x1870073557755904:12345-192.168.204.20@tcp:35:touch.0 00010000:00080000:1.0:1783444257.722293:0:66228:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215113, replaying 00000100:00100000:1.0:1783444257.722327:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2400:x1870073557755904:12345-192.168.204.20@tcp:35:touch.0 Request processed in 70us (384us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444257.722336:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 220 00000020:00080000:0.0:1783444257.726422:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.726433:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215113, next_transno: 103079215113 00010000:00080000:0.0:1783444257.726438:0:87097:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (103079215113) 00000020:00080000:0.0:1783444257.726443:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.726459:0:87097:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557755904 t103079215113 from 192.168.204.20@tcp req@ffff9368e69fdf80 x1870073557755904/t0(103079215113) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:633/0 lens 392/0 e 0 to 0 dl 1783444268 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444257.726751:0:87097:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783444257.726770:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.726773:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000020:00080000:0.0:1783444257.726776:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.726778:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000100:00100000:0.0:1783444257.735825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444257.735874:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557761664 00000100:00100000:3.0:1783444257.735891:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557761664 00000100:00100000:3.0:1783444257.735973:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 855 00000100:00100000:3.0:1783444257.735988:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2400:x1870073557761664:12345-192.168.204.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1783444257.736021:0:71469:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9368e7269880 x1870073557761664/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:633/0 lens 224/0 e 0 to 0 dl 1783444268 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444257.736044:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2400:x1870073557761664:12345-192.168.204.20@tcp:400:ldlm_lock_repla.0 Request processed in 61us (264us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444257.736052:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 855 00000020:00080000:0.0:1783444257.736099:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.736106:0:87097:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215114 00010000:00080000:0.0:1783444257.736110:0:87097:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1783444257.736113:0:87097:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444257.736121:0:87097:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1783444257.736139:0:87097:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1783444257.736276:0:87097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:3.0:1783444257.748204:0:87062:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00100000:3.0:1783444257.748221:0:87062:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1783444257.748249:0:87062:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:0.0:1783444257.748345:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748361:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748371:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748378:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444257.748385:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748393:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748418:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748425:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263c00/0x42cb6883e3831cef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748463:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748470:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748477:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748494:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444257.748497:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748503:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748512:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748518:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3831d0b lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748534:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748540:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748546:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748626:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444257.748630:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748638:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748647:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.748664:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3831d19 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783444257.748759:0:87097:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1783444257.748836:0:87097:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1783444257.748857:0:87097:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9368e69fd500 x1870073575243904/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:633/0 lens 224/0 e 0 to 0 dl 1783444268 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783444257.749029:0:87097:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.20@tcp: req@ffff9368e7269880 x1870073557761664/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:633/0 lens 224/0 e 0 to 0 dl 1783444268 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1783444257.749109:0:87097:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1783444257.750437:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1783444257.750455:0:3632:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9368e69fea00 x1870073575243904/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444273 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444257.750469:0:3632:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9368e69fea00 x1870073575243904/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444273 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444257.750478:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444257.750497:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444257.750504:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575243904:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783444257.750690:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444257.750708:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575244032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444257.750866:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444257.750922:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575244032 00000100:00100000:0.0:1783444257.750930:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575244032 00000100:00100000:0.0:1783444257.750990:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:0.0:1783444257.751001:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575244032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783444257.751929:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00100000:0.0:1783444257.752015:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575244032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1014us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444257.752102:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1783444257.752255:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575244032:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1783444257.773026:0:87097:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac1c4801be10 00100000:10000000:0.0:1783444257.773047:0:87097:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1783444257.773878:0:87083:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:1.0:1783444257.773951:0:87083:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87083:1870073575244160:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783444257.774073:0:87083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444257.774183:0:87083:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c67b8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444257.774215:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575244160 00000100:00100000:1.0:1783444257.774225:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575244160 00000100:00100000:1.0:1783444257.774289:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5860 00000100:00100000:1.0:1783444257.774301:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:87083:x1870073575244160:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783444257.774342:0:26211:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -593 00002000:02000040:1.0:1783444257.774347:0:26211:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:769) 00000004:00080000:3.0:1783444257.774422:0:87085:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:3.0:1783444257.774582:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87085:1870073575244288:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783444257.774619:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444257.774643:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444257.774660:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575244288 00000100:00100000:3.0:1783444257.774664:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575244288 00000100:00100000:3.0:1783444257.774845:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:3.0:1783444257.774855:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:87085:x1870073575244288:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783444257.774874:0:26208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -95 00002000:02000040:3.0:1783444257.774884:0:26208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:769) 00002000:00010000:1.0:1783444257.781965:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.782025:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.782049:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.782075:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.782083:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.782907:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.782927:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.782937:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.782965:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444257.784388:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.784405:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784423:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.784428:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.784435:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784450:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784460:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784477:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784503:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444257.784922:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.784929:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784940:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.784943:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.784947:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784957:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784966:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.784994:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786447:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783444257.786469:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444257.786478:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786500:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.786506:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786519:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786544:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786553:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3831d20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786577:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444257.786581:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786588:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.786592:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786600:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786610:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786625:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3831d27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786640:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.786644:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786651:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.786654:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786663:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786674:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786682:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3831d2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786704:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.786706:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.786709:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.786847:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.786854:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786873:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.786876:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.786883:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786896:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786906:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786914:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786932:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.786941:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.786946:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786953:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.786957:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786964:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.786986:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.787002:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3831d35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.787017:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.787018:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.787020:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.788074:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.788266:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.788276:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788292:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.788296:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.788302:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788315:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788327:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788337:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788368:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.788379:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.788384:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788391:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.788396:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788405:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788422:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788431:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3831d3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788449:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.788451:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.788453:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.788521:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.788527:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788536:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.788548:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.788552:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788561:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788570:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788577:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788591:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.788598:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.788602:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788609:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.788613:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788620:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788630:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788649:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3831d43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788786:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.788812:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.788814:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.788861:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.788867:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788876:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.788879:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.788883:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788893:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788901:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788910:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788927:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444257.788980:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.788986:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.788994:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.788998:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.789002:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789011:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789019:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789027:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789039:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444257.789046:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444257.789049:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789068:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.789073:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789202:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789218:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789226:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3831d4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789244:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.789247:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789254:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.789258:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789266:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789278:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789286:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3831d51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789312:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.789314:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.789317:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.789369:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.789375:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789384:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.789388:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.789392:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789401:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789409:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789418:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789433:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.789440:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.789445:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789463:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.789467:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789475:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789487:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789495:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3831d58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789511:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.789513:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.789515:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.789563:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.789569:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789577:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.789580:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.789585:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789595:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789610:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789618:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.789633:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.789642:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.789647:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790049:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.790070:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790081:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790256:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790276:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3831d5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790295:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.790312:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.790314:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.790393:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.790398:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790407:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.790416:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.790421:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790431:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790439:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790451:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790468:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.790476:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.790480:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790487:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.790497:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790516:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790535:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790543:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3831d66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790555:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.790557:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.790558:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.790606:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.790612:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790620:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.790623:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.790627:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790636:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790643:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790657:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790669:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.790676:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.790680:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790687:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.790690:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790698:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790710:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790717:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3831d6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790730:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.790732:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.790734:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.790766:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.790780:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.790812:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790820:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.790824:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.790828:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790837:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790846:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783444257.790847:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1783444257.790857:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790871:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.790878:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.790882:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790889:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.790893:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790901:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790919:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790926:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3831d74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.790942:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.790944:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.790946:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.790994:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.791000:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791009:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.791012:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.791016:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791024:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791031:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791038:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791083:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444257.791392:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.791398:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791407:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.791411:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.791415:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791425:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.791480:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.791487:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.791497:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.791501:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.791510:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.791525:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.791533:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3831d7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.791559:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.791561:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.791562:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.791749:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791757:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791781:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444257.791858:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.791864:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791873:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.791882:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.791887:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791903:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791912:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791920:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791936:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444257.791945:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444257.791949:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791955:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.791959:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791967:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791978:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.791997:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3831d82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792013:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444257.792016:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792022:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.792025:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792032:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792043:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792051:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3831d89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792076:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.792079:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.792081:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.792272:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.792343:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.792350:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792363:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.792366:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.792371:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792380:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792389:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792396:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792443:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444257.792484:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.792489:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792497:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.792500:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.792504:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792513:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792532:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792539:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792567:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444257.792572:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792580:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.792585:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792593:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792604:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792611:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e3831d90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792626:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.792629:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792635:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.792644:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792652:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792772:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.792781:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.792782:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.792784:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.792911:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444257.792916:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e3831d97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444257.792978:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.792983:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.792991:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.792994:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.792998:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793007:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793017:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793036:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.793074:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.793079:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.793086:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.793090:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.793098:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.793109:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793183:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:1.0:1783444257.793225:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.793231:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793239:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.793242:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.793246:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793256:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793264:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793272:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793284:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444257.793325:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.793330:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793344:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.793348:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.793352:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793361:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793369:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793376:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793385:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444257.793427:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.793432:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793440:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.793443:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.793447:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793456:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793476:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793484:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793493:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783444257.793530:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.793535:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793543:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.793546:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.793550:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793558:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793566:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793573:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793592:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783444257.793636:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.793641:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793648:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.793651:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.793669:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793678:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793686:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793694:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793703:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783444257.793740:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.793745:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793752:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.793761:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.793765:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793774:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793782:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793814:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793824:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783444257.793865:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.793870:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793878:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.793881:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.793885:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793894:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793902:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793916:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793925:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783444257.793967:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.793973:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793982:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.793984:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.793988:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.793997:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.794005:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.794012:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.794021:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783444257.794072:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.794078:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.794093:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.794096:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.794100:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.794109:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794274:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3831d9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794305:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783444257.794309:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794316:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.794321:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794330:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794345:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794353:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e3831da5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794364:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783444257.794368:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794374:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.794378:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794397:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794409:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794425:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3831dac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794438:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783444257.794441:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794448:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.794451:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794458:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794469:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794476:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e2557c7/0x42cb6883e3831db3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794501:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783444257.794505:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794512:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.794515:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794523:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794533:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794540:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001503a445/0x42cb6883e3831dba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794552:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783444257.794556:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794562:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.794566:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794586:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794598:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794606:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3831dc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794619:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444257.794622:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794629:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.794632:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794640:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794661:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794669:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3831dc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794693:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444257.794698:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794705:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.794708:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794715:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794725:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794732:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3831dcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794745:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.794748:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794764:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.794767:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794811:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794824:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794833:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e3831dd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.794847:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.794848:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.794851:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.794868:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.794875:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.795032:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795040:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795072:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444257.795248:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.795254:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795261:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.795265:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795273:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795284:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795297:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3831ddd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795312:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.795314:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.795316:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444257.795389:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.795395:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795405:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.795409:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.795414:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795425:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795443:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795451:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795495:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444257.795536:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.795541:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795549:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.795552:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.795557:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795566:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795574:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.795582:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795810:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444257.795817:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795825:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.795829:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795838:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795851:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795858:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e3831de4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795874:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.795877:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795903:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.795907:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795914:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795926:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.795935:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.795937:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.795939:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.796392:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444257.796438:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3831deb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444257.796529:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.796535:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796544:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.796547:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.796551:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796561:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796568:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796575:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.796606:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.796612:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.796620:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.796624:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.796632:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.796646:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.796676:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.796678:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.796681:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.796808:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444257.796813:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3831df2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444257.796881:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444257.796886:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796895:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:1.0:1783444257.796898:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444257.796902:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796911:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796919:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796927:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.796939:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444257.797215:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.797221:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.797229:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.797233:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.797242:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.797254:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.797262:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3831df9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.797278:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.797280:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.797282:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.797289:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.797847:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444257.802603:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444257.802619:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.802645:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:3.0:1783444257.802652:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444257.802661:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.802687:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.802702:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.802713:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.802753:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444257.803013:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.803040:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.803050:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1be00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.803069:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.803079:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444257.803198:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444257.803204:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803213:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:3.0:1783444257.803216:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444257.803220:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803239:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803248:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803257:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803278:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444257.803287:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803289:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444257.803294:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.803297:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e44673f4/0x42cb6883e3831e00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803303:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1bc00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.803307:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803316:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.803321:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.803323:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.803324:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.803326:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803335:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002dd6e6a/0x42cb6883e3831e07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.803356:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.803359:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.803361:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783444257.803368:0:26211:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:1.0:1783444257.803497:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:87083:x1870073575244160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29190us (29432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444257.803510:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5860 00000100:00100000:3.0:1783444257.803534:0:87083:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87083:1870073575244160:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783444257.803557:0:87083:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x301:0x0] from OST, last_created [0x280000401:0x301:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:2.0:1783444257.803653:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575244416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444257.803655:0:87083:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87083:1870073575244544:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783444257.803815:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444257.803826:0:87083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444257.803857:0:87083:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7227180 going to sleep for 11 seconds 00000100:00100000:3.0:1783444257.803988:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575244416 00000100:00100000:3.0:1783444257.803997:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575244416 00000100:00100000:3.0:1783444257.804051:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:3.0:1783444257.804077:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575244416:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444257.804132:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575244544 00000100:00100000:3.0:1783444257.804137:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575244544 00000100:00100000:3.0:1783444257.804173:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5862 00000100:00100000:3.0:1783444257.804182:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:87083:x1870073575244544:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783444257.804248:0:26204:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 770 00002000:00000024:0.0:1783444257.810958:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444257.811182:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575244416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7100us (7390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444257.811199:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00002000:00010000:0.0:1783444257.811371:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.811381:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811403:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.811415:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.811423:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811442:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811454:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811463:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811486:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444257.811502:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783444257.811509:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575244416:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783444257.811510:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811524:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.811529:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811538:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811561:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811579:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3831e0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811602:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.811604:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.811606:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444257.811674:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.811680:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811688:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.811770:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.811774:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811784:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811814:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811893:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811921:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.811973:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.811978:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.811987:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.811989:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.811993:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812003:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812010:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812018:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.812030:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444257.812037:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444257.812046:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812050:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.812069:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.812070:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.812076:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812084:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444257.812095:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.812111:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.812119:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e3831e15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.812137:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.812140:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444257.812141:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.812168:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812193:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812205:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812213:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e3831e1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812228:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.812230:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.812232:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444257.812276:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.812281:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812290:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.812293:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.812298:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812307:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812316:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812330:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812354:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.812395:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.812400:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812410:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.812414:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.812417:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812426:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812434:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812442:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812456:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444257.812462:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444257.812466:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812479:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.812482:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812490:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812500:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812507:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e3831e23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812519:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.812521:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812526:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.812529:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812536:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812545:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812558:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e3831e2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812571:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.812573:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.812575:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444257.812616:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.812622:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812629:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.812633:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.812637:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.812647:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.813011:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.813088:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813160:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813222:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783444257.813275:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:87083:x1870073575244544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9090us (9485us total) trans 4294969448 rc 0/0 00002000:00010000:0.0:1783444257.813286:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1783444257.813289:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5862 00010000:00010000:0.0:1783444257.813291:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813300:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.813302:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.813306:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813315:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813323:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813331:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813358:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444257.813366:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813374:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.813378:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813401:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813416:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813425:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813445:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444257.813448:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813455:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.813458:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813467:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813477:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813484:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.813486:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.813494:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.813555:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783444257.813560:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e3831e38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444257.813618:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.813623:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813631:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.813640:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.813644:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813654:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813662:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.813669:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813751:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444257.813758:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813766:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.813770:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813779:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444257.813853:0:87083:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87083:1870073575244544:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783444257.813873:0:87083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x301:0x0]-[0x280000401:0x321:0x0] 00010000:00010000:3.0:1783444257.813894:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.813905:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.813906:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.813908:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.813976:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.814052:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783444257.814065:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831e3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444257.815085:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.815164:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815179:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.815184:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.815189:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815202:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815221:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815229:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815253:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.815310:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.815315:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815323:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.815326:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.815329:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815338:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815346:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815353:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815422:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444257.815475:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.815482:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815490:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.815494:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.815496:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815503:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815509:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.815514:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815549:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444257.815555:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815561:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.815564:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815571:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815585:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815589:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3831e46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815604:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444257.815607:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815618:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.815620:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815625:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815631:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815635:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e3831e4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815641:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.815643:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815648:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.815650:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815654:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815659:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.815670:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.815672:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.815673:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.816223:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783444257.816283:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783444257.816368:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783444257.816375:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3831e54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444257.816474:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.816481:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.816496:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.816499:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.816504:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.816515:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.816524:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.816531:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.816561:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.816567:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.816576:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444257.816581:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.816590:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.816606:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.816616:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.816618:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.816620:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.816684:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783444257.816695:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3831e5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444257.816736:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.816740:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.816746:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.816748:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.816750:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.816761:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.816767:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.816771:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817253:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444257.817296:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444257.817301:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444257.817306:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444257.817310:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.817312:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.817314:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817319:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.817322:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.817327:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.817331:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817336:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.817344:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817344:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.817353:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3831e62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817363:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444257.817368:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.817369:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.817371:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.817375:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.817423:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.817429:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817437:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.817440:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.817444:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817453:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817460:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817466:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817490:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444257.817528:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.817534:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817547:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.817551:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.817555:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817564:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817572:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817580:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817591:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783444257.817632:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.817637:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817646:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.817649:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.817653:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817661:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.817680:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817778:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783444257.817785:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817810:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.817814:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817904:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817917:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817925:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f454f871/0x42cb6883e3831e69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817941:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444257.817945:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817952:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.817955:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817963:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817974:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.817982:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baae635b/0x42cb6883e3831e70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818006:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444257.818010:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818017:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.818020:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818028:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818039:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818046:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d3cc6e9/0x42cb6883e3831e77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818068:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.818070:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.818072:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.818081:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.818191:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444257.818200:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.818247:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818271:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.818329:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.818336:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818346:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.818349:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.818353:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818369:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818372:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444257.818377:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818378:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818386:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.818387:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818413:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.818459:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444257.818460:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818463:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818470:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818472:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.818475:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.818479:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818482:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818489:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818490:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000387dc32f/0x42cb6883e3831e7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818503:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444257.818507:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818514:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.818517:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818525:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818535:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818536:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818544:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da66f5d/0x42cb6883e3831e85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818545:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818558:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444257.818562:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444257.818565:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818565:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.818573:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444257.818576:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818584:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.818595:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444257.818606:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.818611:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818619:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.818628:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.818633:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818642:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818649:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818657:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818682:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.818732:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.818737:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818745:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.818748:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.818752:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818760:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818768:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818782:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818813:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444257.818821:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444257.818836:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818844:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.818848:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818856:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818868:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818876:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081065b9e/0x42cb6883e3831e93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818888:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.818890:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818907:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.818910:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818918:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818928:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818935:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002a0c538/0x42cb6883e3831e9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.818946:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.818948:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.818950:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444257.818992:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.818997:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819005:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.819009:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.819013:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819021:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819036:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819043:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819066:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444257.819075:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.819078:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819085:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.819089:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819107:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819119:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819126:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d3b19f/0x42cb6883e3831ea1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819139:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.819147:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.819149:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444257.819193:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.819198:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819206:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.819210:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.819214:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819223:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819245:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.819247:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3831e8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819254:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.819262:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.819263:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.819265:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.819272:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.819375:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444257.819382:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.819386:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819393:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.819397:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819418:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819429:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819437:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd281fb/0x42cb6883e3831ea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819451:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.819453:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.819455:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444257.819498:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.819503:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819511:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.819514:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.819518:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819525:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819532:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819544:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819562:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.819604:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.819609:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819617:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.819620:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.819624:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819632:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819640:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819647:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819659:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444257.819694:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.819700:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819712:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.819715:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.819718:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819727:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819735:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819742:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819755:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783444257.819763:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444257.819767:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819774:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.819777:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819785:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819875:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819883:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002fd4943/0x42cb6883e3831eaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819895:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444257.819898:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819904:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.819908:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819916:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819925:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819932:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa97fe91/0x42cb6883e3831eb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819941:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.819944:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819955:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.819959:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819967:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819976:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819982:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d203f8/0x42cb6883e3831ebd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.819993:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.819995:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.819997:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444257.820042:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.820047:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820055:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.820072:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.820076:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820085:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820100:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820107:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820121:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444257.820130:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.820134:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820141:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.820145:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820154:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820168:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820177:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef2b3b0f/0x42cb6883e3831ec4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444257.820191:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.820195:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.820204:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.820211:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.820211:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444257.820263:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.820270:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820277:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.820280:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.820284:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820293:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820301:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820308:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820335:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444257.820378:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.820383:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820391:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.820394:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.820398:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820414:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820422:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820428:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820440:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444257.820484:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444257.820489:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820497:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=3248s v=(0 0) 00010000:00010000:0.0:1783444257.820501:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444257.820505:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820513:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820521:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820540:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820553:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783444257.820562:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444257.820567:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820573:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.820577:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820585:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820596:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820603:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dc2e292/0x42cb6883e3831ecb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820616:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444257.820620:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820638:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.820642:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820650:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820661:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820669:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efb574ec/0x42cb6883e3831ed2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820682:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444257.820685:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820692:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444257.820697:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820704:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820713:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444257.820725:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3831ed9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444257.820739:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.820740:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.820743:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444257.820746:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.821351:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444257.821359:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783444257.822026:0:26208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:2.0:1783444257.822231:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:87085:x1870073575244288:12345-0@lo:5:osp-pre-1-0.0 Request processed in 47369us (47602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444257.822246:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00000100:00100000:3.0:1783444257.822284:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87085:1870073575244288:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783444257.822311:0:87085:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x301:0x0] from OST, last_created [0x2c0000401:0x301:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:3.0:1783444257.822402:0:87085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4b28380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87085:1870073575244800:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783444257.822408:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444257.822421:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575244672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444257.822446:0:87085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444257.822453:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444257.822474:0:87085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7227cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444257.822490:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575244800 00000100:00100000:3.0:1783444257.822497:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575244800 00000100:00100000:3.0:1783444257.822549:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5863 00000100:00100000:3.0:1783444257.822559:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:87085:x1870073575244800:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783444257.822608:0:8421:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 770 00000100:00100000:3.0:1783444257.825599:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:87085:x1870073575244800:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3031us (3142us total) trans 4294969452 rc 0/0 00000100:00100000:3.0:1783444257.825618:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00000100:00100000:3.0:1783444257.825681:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575244672 00000100:00100000:3.0:1783444257.825703:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575244672 00000100:00100000:3.0:1783444257.825760:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:3.0:1783444257.825770:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575244672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444257.825836:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444257.825881:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575244672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444257.825888:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:2.0:1783444257.825903:0:87085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4b28380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87085:1870073575244800:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783444257.825922:0:87085:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x301:0x0]-[0x2c0000401:0x321:0x0] 00000100:00100000:3.0:1783444257.825930:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575244672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444257.866162:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444257.866262:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557761792 00000100:00100000:0.0:1783444257.866276:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557761792 00000100:00100000:0.0:1783444257.866344:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:0.0:1783444257.866355:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557761792:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444257.866445:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557761792:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444257.866454:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:0.0:1783444257.868288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444257.868369:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557761920 00000100:00100000:1.0:1783444257.868380:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557761920 00000100:00100000:1.0:1783444257.868506:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 856 00000100:00100000:1.0:1783444257.868516:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557761920:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444257.868600:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557761920:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444257.868618:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 856 00000001:00100000:3.0:1783444258.100869:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:2.0:1783444258.220304:0:87349:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783444258.722993:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783444259.319634:0:87403:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783444259.320056:0:87403:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783444259.742182:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783444260.308262:0:87453:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783444260.308504:0:87453:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783444260.637962:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575244928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444260.638094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444260.638640:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575244928 00000100:00100000:3.0:1783444260.638650:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575244928 00000100:00100000:3.0:1783444260.638755:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:3.0:1783444260.638767:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575244928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444260.638832:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444260.638894:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575244928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444260.638902:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:0.0:1783444260.639314:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575245056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444260.639358:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783444260.639518:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444260.639571:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575244928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444260.639652:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575245056 00000100:00100000:3.0:1783444260.639659:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575245056 00000100:00100000:3.0:1783444260.639708:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:3.0:1783444260.639716:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575245056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444260.639737:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444260.639805:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575245056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444260.639813:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:1.0:1783444260.639889:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575245056:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783444260.640013:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783444260.767424:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444261.789203:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444262.508984:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444262.509361:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557762048 00000100:00100000:1.0:1783444262.509382:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557762048 00000100:00100000:1.0:1783444262.509505:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1138 00000100:00100000:1.0:1783444262.509521:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66738:x1870073557762048:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444262.509553:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444262.509592:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3831ee0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ab1 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444262.509690:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831ee7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444262.509708:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444262.509724:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444262.509860:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783444262.509865:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444262.509918:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444262.509957:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3831ee0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ab1 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444262.509992:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ab1 expref: 7 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444262.510022:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c498b900) 00010000:00010000:1.0:1783444262.510026:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444262.510031:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26000, rc 0) 00000100:00080000:2.0:1783444262.510170:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444262.510211:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66738:x1870073557762048:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 685us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444262.510224:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1138 00000100:00100000:2.0:1783444262.519393:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444262.519502:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557762176 00000100:00100000:0.0:1783444262.519516:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557762176 00000100:00100000:0.0:1783444262.519587:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1139 00000100:00100000:0.0:1783444262.519599:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66738:x1870073557762176:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1783444262.519665:0:80475:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00100000:0.0:1783444262.519756:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+7:66738:x1870073557762176:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 158us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444262.519764:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1139 00000100:00100000:3.0:1783444262.541656:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444262.542479:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557762304 00000100:00100000:1.0:1783444262.542490:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557762304 00000100:00100000:1.0:1783444262.542580:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1140 00000100:00100000:1.0:1783444262.542593:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66738:x1870073557762304:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1783444262.542639:0:66226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444262.542715:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66738:x1870073557762304:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 125us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444262.542723:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1140 00000100:00080000:2.0:1783444262.542813:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444262.550357:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444262.550475:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557762432 00000100:00100000:2.0:1783444262.550486:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557762432 00000100:00100000:2.0:1783444262.550536:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5864 00000100:00100000:2.0:1783444262.550545:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1870073557762432:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:2.0:1783444262.550582:0:8824:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp t0 exp 0000000000000000 cur 3253 last 0 00000020:00000080:2.0:1783444262.550616:0:8824:0:(genops.c:1406:class_connect()) connect: client 778015c5-4969-44f5-82a5-0f6eadd152d5, cookie 0x42cb6883e3831eee 00002000:00100000:2.0:1783444262.550631:0:8824:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 778015c5-4969-44f5-82a5-0f6eadd152d5/ffff9369006a2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783444262.550648:0:8824:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783444262.550717:0:8824:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783444262.550747:0:8824:0:(import.c:65:import_set_state_nolock()) ffff9369006a2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444262.550879:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557762432:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 333us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444262.550887:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5864 00000100:00100000:3.0:1783444262.559145:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444262.570119:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557762560 00000100:00100000:0.0:1783444262.570141:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557762560 00000100:00100000:0.0:1783444262.570331:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1824 00000100:00100000:0.0:1783444262.570344:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66738:x1870073557762560:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1783444262.570385:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444262.570500:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66738:x1870073557762560:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 158us (11367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444262.570508:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1824 00000100:00080000:2.0:1783444262.573691:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444262.584052:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444262.585959:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557762688 00000100:00100000:3.0:1783444262.585982:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557762688 00000100:00100000:3.0:1783444262.586043:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5865 00000100:00100000:3.0:1783444262.586054:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2400:x1870073557762688:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:3.0:1783444262.586098:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp t0 exp 0000000000000000 cur 3253 last 0 00000020:00000080:3.0:1783444262.586130:0:26209:0:(genops.c:1406:class_connect()) connect: client 778015c5-4969-44f5-82a5-0f6eadd152d5, cookie 0x42cb6883e3831ef5 00002000:00100000:3.0:1783444262.586143:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 778015c5-4969-44f5-82a5-0f6eadd152d5/ffff9368dd20b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783444262.586185:0:26209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783444262.586258:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783444262.586297:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9368dd20c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444262.586391:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557762688:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 336us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.586400:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5865 00000100:00100000:1.0:1783444262.589237:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444262.589335:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557762816 00000100:00100000:0.0:1783444262.589356:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557762816 00000100:00100000:0.0:1783444262.589432:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1825 00000100:00100000:0.0:1783444262.589444:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66738:x1870073557762816:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1783444262.589480:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444262.589545:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:66738:x1870073557762816:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444262.589553:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1825 00000100:00080000:2.0:1783444262.589618:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444262.686585:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444262.686616:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575245440:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.686702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444262.686815:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575245440 00000100:00100000:1.0:1783444262.686823:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575245440 00000100:00100000:1.0:1783444262.686879:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1783444262.686887:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575245440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.686958:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575245440:12345-0@lo:400:kworker.0 Request processed in 71us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444262.686983:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:1.0:1783444262.687011:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444262.687070:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575245440:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.687110:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575245568:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.687133:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444262.687182:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444262.687188:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575245952:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.687214:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444262.687254:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575245952 00000100:00100000:1.0:1783444262.687258:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575245952 00000100:00100000:1.0:1783444262.687298:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305 00000100:00100000:1.0:1783444262.687306:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575245952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.687340:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575245952:12345-0@lo:400:kworker.0 Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444262.687346:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305 00000100:00080000:1.0:1783444262.687368:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444262.687384:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575245952:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.687415:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575246080:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.687438:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444262.687488:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444262.687495:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575246464:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.687518:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444262.687555:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575246592:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.687577:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444262.688043:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575245184:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688079:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444262.688114:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575245696:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688137:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444262.688154:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575246208:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688171:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444262.688186:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575246720:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688205:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444262.688224:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783444262.688230:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575245312:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688254:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444262.688270:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575245824:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688291:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444262.688307:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575246336:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444262.688368:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575245568 00000100:00100000:3.0:1783444262.688374:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575245568 00000100:00100000:3.0:1783444262.688409:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575245696 00000100:00100000:3.0:1783444262.688412:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575245696 00000100:00100000:3.0:1783444262.688442:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575246208 00000100:00100000:3.0:1783444262.688445:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575246208 00000100:00100000:3.0:1783444262.688469:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575246720 00000100:00100000:3.0:1783444262.688473:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575246720 00000100:00100000:3.0:1783444262.688486:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575245312 00000100:00100000:3.0:1783444262.688488:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575245312 00000100:00100000:3.0:1783444262.688502:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1783444262.688508:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575245568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688555:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575245568:12345-0@lo:400:kworker.0 Request processed in 46us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.688562:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1783444262.688576:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1783444262.688582:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575245696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688612:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575245696:12345-0@lo:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.688618:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1783444262.688628:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1783444262.688632:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575246208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688657:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575246208:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.688663:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1783444262.688673:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1783444262.688678:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575246720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688701:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575246720:12345-0@lo:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.688706:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1783444262.688715:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1783444262.688728:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575245312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688755:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575245312:12345-0@lo:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.688760:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00080000:3.0:1783444262.688833:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444262.688837:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444262.688891:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575245312:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688901:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575245696:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688910:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575246208:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.688920:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575246720:0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.689241:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575245568:0@lo:400:kworker.0 00000100:00100000:2.0:1783444262.689338:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575246080 00000100:00100000:2.0:1783444262.689355:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575246080 00000100:00100000:2.0:1783444262.689404:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575246464 00000100:00100000:2.0:1783444262.689416:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575246464 00000100:00100000:2.0:1783444262.689441:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575246592 00000100:00100000:2.0:1783444262.689444:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575246592 00000100:00100000:2.0:1783444262.689478:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:2.0:1783444262.689486:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575246080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444262.689535:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575246080:12345-0@lo:400:kworker.0 Request processed in 50us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444262.689542:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:2.0:1783444262.689554:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:2.0:1783444262.689560:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575246464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444262.689587:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575246464:12345-0@lo:400:kworker.0 Request processed in 28us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444262.689593:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:2.0:1783444262.689604:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1783444262.689609:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575246592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444262.689636:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575246592:12345-0@lo:400:kworker.0 Request processed in 27us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444262.689642:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1783444262.689685:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575246592:0@lo:400:kworker.0 00000100:00100000:2.0:1783444262.689696:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575246464:0@lo:400:kworker.0 00000100:00100000:2.0:1783444262.689709:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575246080:0@lo:400:kworker.0 00000100:00080000:3.0:1783444262.690289:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444262.690294:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444262.692095:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575245824 00000100:00100000:0.0:1783444262.692114:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575245824 00000100:00100000:0.0:1783444262.692187:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575246336 00000100:00100000:0.0:1783444262.692193:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575246336 00000100:00100000:0.0:1783444262.692224:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:0.0:1783444262.692234:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575245824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.692711:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:3.0:1783444262.692722:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575246336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444262.692830:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575245824:12345-0@lo:400:kworker.0 Request processed in 597us (4535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444262.692838:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:0.0:1783444262.692873:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575246848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444262.692908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444262.693050:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575246848 00000100:00100000:0.0:1783444262.693055:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575246848 00000100:00100000:0.0:1783444262.693074:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1783444262.693078:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575246848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444262.693096:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:0.0:1783444262.693132:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575246848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444262.693138:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1783444262.693180:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575246848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444262.695075:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575245184 00000100:00100000:1.0:1783444262.695092:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575245184 00000100:00100000:1.0:1783444262.695167:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783444262.695177:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575245184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444262.725020:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575246336:12345-0@lo:400:kworker.0 Request processed in 32284us (36671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.725039:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:0.0:1783444262.731213:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575245824:0@lo:400:kworker.0 00000100:00100000:0.0:1783444262.731253:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575246336:0@lo:400:kworker.0 00000100:00100000:1.0:1783444262.743020:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575245184:12345-0@lo:400:kworker.0 Request processed in 47832us (54927us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444262.743039:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783444262.751564:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575245184:0@lo:400:kworker.0 00010000:00010000:1.0:1783444262.813114:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444262.987410:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444262.987468:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444262.987512:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444262.987545:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444262.987600:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444262.987744:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557762944 00000100:00100000:1.0:1783444262.987756:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557762944 00000100:00100000:1.0:1783444262.987863:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:1.0:1783444262.987873:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557762944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444262.987950:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557762944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 78us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444262.987971:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:1.0:1783444262.988009:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557763328 00000100:00100000:1.0:1783444262.988012:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557763328 00000100:00100000:1.0:1783444262.988042:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557763456 00000100:00100000:1.0:1783444262.988045:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557763456 00000100:00100000:1.0:1783444262.988064:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2309 00000100:00100000:1.0:1783444262.988069:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557763328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444262.988095:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557763328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444262.988101:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2309 00000100:00100000:1.0:1783444262.988112:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2310 00000100:00100000:1.0:1783444262.988117:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557763456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444262.988137:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557763456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444262.988143:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2310 00000100:00100000:3.0:1783444262.989720:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557763072 00000100:00100000:3.0:1783444262.989733:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557763072 00000100:00100000:3.0:1783444262.989827:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557763200 00000100:00100000:3.0:1783444262.989832:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557763200 00000100:00100000:3.0:1783444262.989860:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 863 00000100:00100000:3.0:1783444262.989868:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2403:x1870073557763072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444262.989975:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2403:x1870073557763072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 107us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.989984:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 863 00000100:00100000:3.0:1783444262.990001:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 864 00000100:00100000:3.0:1783444262.990008:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557763200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444262.990038:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557763200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 31us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444262.990045:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 864 00000100:00100000:2.0:1783444263.197277:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575246976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444263.197360:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444263.197515:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575246976 00000100:00100000:0.0:1783444263.197523:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575246976 00000100:00100000:0.0:1783444263.197579:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:0.0:1783444263.197589:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575246976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783444263.197625:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00100000:0.0:1783444263.197676:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575246976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444263.197699:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:0.0:1783444263.197747:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575246976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444263.197932:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444263.197942:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575247104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444263.197989:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444263.198018:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575247104 00000100:00100000:0.0:1783444263.198022:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575247104 00000100:00100000:0.0:1783444263.198050:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1783444263.198056:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575247104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444263.198070:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444263.198105:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575247104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444263.198112:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1783444263.198146:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575247104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444263.202828:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444263.202855:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575247232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444263.202926:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444263.203043:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575247232 00000100:00100000:2.0:1783444263.203053:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575247232 00000100:00100000:2.0:1783444263.203106:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:2.0:1783444263.203116:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575247232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444263.203139:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444263.203190:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575247232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444263.203196:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:1.0:1783444263.203477:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575247232:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1783444263.721138:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:3.0:1783444263.721157:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969448 is committed 00000001:00100000:1.0:1783444263.722632:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:1.0:1783444263.722644:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969452 is committed 00010000:00010000:0.0:1783444263.837043:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444264.863276:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444265.759651:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575247360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444265.759735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444265.760034:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575247360 00000100:00100000:1.0:1783444265.760043:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575247360 00000100:00100000:1.0:1783444265.760096:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:1.0:1783444265.760105:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575247360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444265.760137:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444265.760187:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575247360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444265.760194:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:1.0:1783444265.760244:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575247360:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783444265.760917:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444265.763444:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575247488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444265.763850:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444265.768497:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575247488 00000100:00100000:2.0:1783444265.768511:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575247488 00000100:00100000:2.0:1783444265.768985:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1783444265.769000:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575247488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444265.769037:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783444265.769048:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444265.769124:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575247488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (5275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444265.775203:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:1.0:1783444265.777829:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575247488:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783444265.886113:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444266.910476:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444267.805086:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575247616:0@lo:400:kworker.0 00000100:00100000:0.0:1783444267.805619:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444267.806992:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575247616 00000100:00100000:3.0:1783444267.807006:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575247616 00000100:00100000:3.0:1783444267.807066:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783444267.807077:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575247616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.807150:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575247616:12345-0@lo:400:kworker.0 Request processed in 74us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444267.807158:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783444267.807380:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575247616:0@lo:400:kworker.0 00000100:00100000:0.0:1783444267.808767:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575247744:0@lo:400:kworker.0 00000100:00100000:0.0:1783444267.808858:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444267.808914:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444267.808921:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575247872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444267.808943:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575247744 00000100:00100000:0.0:1783444267.808948:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444267.808950:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575247744 00000100:00100000:0.0:1783444267.808975:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575247872 00000100:00100000:0.0:1783444267.808993:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575247872 00000100:00100000:3.0:1783444267.809000:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1783444267.809008:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575247744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444267.809022:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:0.0:1783444267.809027:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575247872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444267.809054:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444267.809064:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575247744:12345-0@lo:400:kworker.0 Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444267.809079:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:0.0:1783444267.809083:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575247872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444267.809089:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00080000:3.0:1783444267.809101:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444267.809124:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575247872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444267.809135:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575247744:0@lo:400:kworker.0 00000100:00100000:0.0:1783444267.813655:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444267.814744:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444267.814776:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575248128:0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.814907:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444267.815015:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575248128 00000100:00100000:2.0:1783444267.815024:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575248128 00000100:00100000:2.0:1783444267.815083:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1783444267.815091:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575248128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444267.815141:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575248128:12345-0@lo:400:kworker.0 Request processed in 51us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444267.815147:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00080000:3.0:1783444267.816009:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444267.816066:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575248128:0@lo:400:kworker.0 00000100:00100000:0.0:1783444267.825024:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575248000:0@lo:400:kworker.0 00000100:00100000:0.0:1783444267.825118:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444267.825265:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575248000 00000100:00100000:3.0:1783444267.825274:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575248000 00000100:00100000:3.0:1783444267.825345:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1783444267.825356:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575248000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.825413:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575248000:12345-0@lo:400:kworker.0 Request processed in 60us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444267.825420:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00080000:0.0:1783444267.825517:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444267.825551:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575248000:0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.826935:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575248384:0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.826996:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444267.827028:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575248896:0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.827073:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444267.827096:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783444267.827102:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575248256:0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.827125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444267.827145:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575248768:0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.827180:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444267.827212:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575248384 00000100:00100000:1.0:1783444267.827218:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575248384 00000100:00100000:1.0:1783444267.827262:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:1.0:1783444267.827270:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575248384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.827321:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575248384:12345-0@lo:400:kworker.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444267.827328:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00100000:1.0:1783444267.827355:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575248256 00000100:00100000:1.0:1783444267.827358:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575248256 00000100:00100000:1.0:1783444267.827391:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575248768 00000100:00100000:1.0:1783444267.827394:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575248768 00000100:00100000:1.0:1783444267.827411:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1783444267.827417:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575248256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.827448:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575248256:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444267.827454:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1783444267.827467:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1783444267.827473:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575248768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.827499:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575248768:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444267.827513:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1783444267.827550:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575248256:0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.827562:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575248768:0@lo:400:kworker.0 00000100:00100000:1.0:1783444267.827570:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575248384:0@lo:400:kworker.0 00000100:00080000:1.0:1783444267.827594:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444267.827695:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575248896 00000100:00100000:2.0:1783444267.827705:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575248896 00000100:00100000:2.0:1783444267.827747:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:2.0:1783444267.827754:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575248896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444267.827809:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575248896:12345-0@lo:400:kworker.0 Request processed in 55us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444267.827815:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00100000:3.0:1783444267.828114:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575248512:0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828148:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444267.828184:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575249024:0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444267.828224:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783444267.828230:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575248640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828249:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444267.828264:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575249152:0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444267.828304:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575248512 00000100:00100000:3.0:1783444267.828308:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575248512 00000100:00100000:3.0:1783444267.828341:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575249024 00000100:00100000:3.0:1783444267.828344:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575249024 00000100:00100000:3.0:1783444267.828361:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575248640 00000100:00100000:3.0:1783444267.828363:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575248640 00000100:00100000:3.0:1783444267.828382:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312 00000100:00100000:3.0:1783444267.828388:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575248512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828423:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575248512:12345-0@lo:400:kworker.0 Request processed in 35us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444267.828429:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312 00000100:00100000:3.0:1783444267.828443:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313 00000100:00100000:3.0:1783444267.828449:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575249024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828474:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575249024:12345-0@lo:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444267.828479:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313 00000100:00100000:3.0:1783444267.828489:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314 00000100:00100000:3.0:1783444267.828495:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575248640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828520:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575248640:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444267.828527:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314 00000100:00100000:3.0:1783444267.828554:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575249152 00000100:00100000:3.0:1783444267.828557:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575249152 00000100:00100000:3.0:1783444267.828580:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1783444267.828586:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575249152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828614:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575249152:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444267.828621:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1783444267.828653:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575248640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828679:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575249152:0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828688:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575248512:0@lo:400:kworker.0 00000100:00100000:3.0:1783444267.828695:0:3635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969452 gen 2 00000100:00100000:3.0:1783444267.828708:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575249024:0@lo:400:kworker.0 00000100:00080000:1.0:1783444267.828960:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444267.828964:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444267.828985:0:3634:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000100:00100000:1.0:1783444267.828996:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575248896:0@lo:400:kworker.0 00010000:00010000:0.0:1783444267.934352:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444268.112067:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444268.112119:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444268.112150:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444268.112187:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444268.112207:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444268.112236:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557764096 00000100:00100000:2.0:1783444268.112245:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557764096 00000100:00100000:2.0:1783444268.112296:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557763968 00000100:00100000:2.0:1783444268.112299:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557763968 00000100:00100000:2.0:1783444268.112322:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2315 00000100:00100000:2.0:1783444268.112332:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557764096:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444268.112404:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557764096:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444268.112412:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2315 00000100:00100000:2.0:1783444268.112429:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2316 00000100:00100000:2.0:1783444268.112437:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557763968:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444268.112461:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557763968:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444268.112467:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2316 00000100:00100000:3.0:1783444268.112723:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557763840 00000100:00100000:3.0:1783444268.112729:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557763840 00000100:00100000:3.0:1783444268.112770:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557763712 00000100:00100000:3.0:1783444268.112773:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557763712 00000100:00100000:3.0:1783444268.112837:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 871 00000100:00100000:3.0:1783444268.112844:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557763840:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444268.112885:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557763840:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444268.112891:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 871 00000100:00100000:3.0:1783444268.112903:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 872 00000100:00100000:3.0:1783444268.112908:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2403:x1870073557763712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444268.112927:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2403:x1870073557763712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 19us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444268.112933:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 872 00000100:00100000:1.0:1783444268.113334:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557763584 00000100:00100000:1.0:1783444268.113341:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557763584 00000100:00100000:1.0:1783444268.113382:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:1.0:1783444268.113389:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557763584:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444268.113417:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557763584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 30us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444268.113424:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00080000:1.0:1783444268.113577:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783444268.113581:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444268.113584:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444268.113587:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444268.317167:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575249408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444268.317258:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444268.317308:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444268.317315:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575249280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444268.317341:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444268.317483:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575249280 00000100:00100000:2.0:1783444268.317503:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575249280 00000100:00100000:2.0:1783444268.317565:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:2.0:1783444268.317576:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575249280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444268.317608:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444268.317657:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575249280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444268.317665:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00100000:3.0:1783444268.317754:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575249280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444268.318823:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575249408 00000100:00100000:0.0:1783444268.318830:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575249408 00000100:00100000:0.0:1783444268.318890:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:0.0:1783444268.318898:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575249408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783444268.318926:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00100000:0.0:1783444268.318985:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575249408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444268.318991:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:0.0:1783444268.319026:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575249408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444268.319932:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444268.319951:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575249536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444268.319999:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444268.320445:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575249536 00000100:00100000:2.0:1783444268.320452:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575249536 00000100:00100000:2.0:1783444268.320501:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:2.0:1783444268.320510:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575249536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444268.320537:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444268.320594:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575249536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444268.320601:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:1.0:1783444268.320680:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575249536:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783444268.957048:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783444268.970651:0:87646:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:3.0:1783444269.981427:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783444270.817514:0:87694:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1783444270.878949:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575249664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444270.879022:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444270.879078:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575249664 00000100:00100000:1.0:1783444270.879085:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575249664 00000100:00100000:1.0:1783444270.879135:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:1.0:1783444270.879145:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575249664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444270.879172:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444270.879217:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575249664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444270.879225:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00080000:1.0:1783444270.879253:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444270.879304:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575249664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444270.879446:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444270.879456:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575249792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444270.879486:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444270.879512:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575249792 00000100:00100000:0.0:1783444270.879516:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575249792 00000100:00100000:0.0:1783444270.879544:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1783444270.879551:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575249792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444270.879567:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444270.879601:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575249792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444270.879608:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00080000:0.0:1783444270.879623:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444270.879643:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575249792:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783444271.006380:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444272.029076:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444272.749043:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444272.749132:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557764224 00000100:00100000:3.0:1783444272.749142:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557764224 00000100:00100000:3.0:1783444272.749218:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1141 00000100:00100000:3.0:1783444272.749230:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+7:67207:x1870073557764224:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444272.749266:0:66226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00080000:0.0:1783444272.749513:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444272.749548:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+7:67207:x1870073557764224:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 319us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444272.749556:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1141 00000100:00100000:1.0:1783444272.760246:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444272.760336:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557764352 00000100:00100000:3.0:1783444272.760345:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557764352 00000100:00100000:3.0:1783444272.760503:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1142 00000100:00100000:3.0:1783444272.760516:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:67207:x1870073557764352:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444272.760559:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444272.760637:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:67207:x1870073557764352:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 124us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444272.760643:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1142 00000100:00100000:1.0:1783444272.768502:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444272.768669:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557764480 00000100:00100000:2.0:1783444272.768680:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557764480 00000100:00080000:0.0:1783444272.768820:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444272.768826:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444272.771018:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1834 00000100:00100000:2.0:1783444272.771036:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:67207:x1870073557764480:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444272.771069:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444272.771154:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:67207:x1870073557764480:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 123us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444272.771161:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1834 00000100:00100000:2.0:1783444272.774939:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444272.775042:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557764608 00000100:00100000:0.0:1783444272.775052:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557764608 00000100:00100000:0.0:1783444272.775130:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1835 00000100:00100000:0.0:1783444272.775141:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:67207:x1870073557764608:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1783444272.775174:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444272.775247:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:67207:x1870073557764608:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.775255:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1835 00000100:00080000:1.0:1783444272.775335:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444272.835639:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444272.835894:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557764736 00000100:00100000:1.0:1783444272.835906:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557764736 00000100:00100000:1.0:1783444272.835977:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1143 00000100:00100000:1.0:1783444272.835988:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+7:67224:x1870073557764736:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444272.836012:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444272.836037:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ab8 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836107:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836123:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836153:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836173:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836181:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836187:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836273:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831f11 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836282:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831f11 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836288:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831f11 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444272.836331:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783444272.836336:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444272.836360:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831f11 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836373:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836379:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836396:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836402:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444272.836407:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836415:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836441:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c498b900) 00010000:00010000:1.0:1783444272.836444:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444272.836449:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836455:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836468:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836475:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836481:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836486:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444272.836489:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836506:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836515:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9368c3d5b800) 00010000:00010000:1.0:1783444272.836517:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444272.836519:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836525:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836555:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ab8 expref: 9 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836570:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831f11 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ab8 expref: 8 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.836578:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368c3d5bb00) 00010000:00010000:1.0:1783444272.836580:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444272.836582:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26e00, rc 0) 00000100:00100000:1.0:1783444272.836662:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67224:x1870073557764736:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 675us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444272.836670:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1143 00000100:00100000:3.0:1783444272.853036:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444272.854180:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557764992 00000100:00100000:2.0:1783444272.854206:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557764992 00000100:00100000:2.0:1783444272.854342:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1144 00000100:00100000:2.0:1783444272.854352:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67224:x1870073557764992:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444272.854375:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444272.854401:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f18 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939abf expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854488:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854502:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854514:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854528:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854535:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854541:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854626:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854634:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854640:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854653:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854659:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444272.854664:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854673:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854686:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368c3d5bb00) 00010000:00010000:2.0:1783444272.854689:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444272.854695:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854701:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f1f lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854716:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854721:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854725:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854729:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444272.854731:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854747:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854754:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9368d4c9ae00) 00010000:00010000:2.0:1783444272.854757:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444272.854760:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854764:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f26 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854858:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f18 lrc: 1/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939abf expref: 9 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854868:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368c3d5bb00) 00010000:00010000:2.0:1783444272.854870:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783444272.854874:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f18 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939abf expref: 9 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.854884:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11600, rc 0) 00000100:00100000:2.0:1783444272.854984:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67224:x1870073557764992:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 633us (1958us total) trans 0 rc 301/301 00000100:00100000:2.0:1783444272.854992:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1144 00000100:00100000:3.0:1783444272.859558:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444272.859745:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557765248 00000100:00100000:1.0:1783444272.859759:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557765248 00000100:00100000:1.0:1783444272.859853:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1145 00000100:00100000:1.0:1783444272.859864:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67224:x1870073557765248:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444272.859906:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444272.859929:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ac6 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444272.860040:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783444272.860170:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ac6 expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.860187:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c498b900) 00010000:00010000:1.0:1783444272.860191:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444272.860195:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831f2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ac6 expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444272.860208:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26c00, rc 0) 00000100:00100000:1.0:1783444272.860273:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+9:67224:x1870073557765248:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 412us (731us total) trans 107374182401 rc 301/301 00000100:00100000:1.0:1783444272.860280:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1145 00000100:00100000:1.0:1783444272.866075:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444272.866210:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557765376 00000100:00100000:2.0:1783444272.866220:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557765376 00000100:00100000:2.0:1783444272.866281:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1146 00000100:00100000:2.0:1783444272.866291:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+9:67224:x1870073557765376:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1783444272.866390:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866408:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866420:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866447:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866456:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866463:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866543:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866551:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866558:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444272.866746:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444272.866766:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866820:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866834:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 2/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866840:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866846:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444272.866851:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866859:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866872:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff9368c3d5bb00) 00010000:00010000:2.0:1783444272.866875:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444272.866880:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866886:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3831f3b lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866912:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866918:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866923:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866928:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444272.866937:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866943:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866951:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff9368d4c9ae00) 00010000:00010000:2.0:1783444272.866954:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444272.866957:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866962:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3831f42 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866976:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866982:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866987:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.866991:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444272.866994:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.867000:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.867228:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff9368cdf77800) 00010000:00010000:2.0:1783444272.867231:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444272.867240:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444272.867246:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3831f49 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444272.867336:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+9:67224:x1870073557765376:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1044us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444272.867345:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1146 00000100:00100000:3.0:1783444272.876096:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444272.876359:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557765632 00000100:00100000:1.0:1783444272.876370:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557765632 00000100:00100000:1.0:1783444272.876531:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:1.0:1783444272.876542:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f95bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+9:67224:x1870073557765632:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1783444272.876883:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f95bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67224:x1870073557765632:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 341us (798us total) trans 107374182402 rc 0/0 00000100:00100000:1.0:1783444272.876891:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:1.0:1783444272.925360:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575250304:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.925573:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.925668:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575250816:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.925697:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.925721:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575251328:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.925757:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.925816:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1783444272.925823:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575249920:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.925852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.925881:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575250432:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.925900:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.925916:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575250944:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.925936:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.925953:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575251456:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.925973:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.925999:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575250048:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.926023:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.926038:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575250560:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.926060:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.926077:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575251072:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.926103:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.926122:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783444272.926128:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575250176:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.926149:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.926165:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575250688:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.926197:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444272.926214:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575251200:0@lo:400:kworker.0 00000100:00100000:1.0:1783444272.926233:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444272.926575:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575250816 00000100:00100000:3.0:1783444272.926586:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575250816 00000100:00100000:3.0:1783444272.926650:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575251328 00000100:00100000:3.0:1783444272.926654:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575251328 00000100:00100000:3.0:1783444272.926671:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575250688 00000100:00100000:3.0:1783444272.926681:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575250688 00000100:00100000:3.0:1783444272.926706:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575251200 00000100:00100000:3.0:1783444272.926709:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575251200 00000100:00100000:3.0:1783444272.926745:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:3.0:1783444272.926755:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575250816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444272.926849:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575250816:12345-0@lo:400:kworker.0 Request processed in 96us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444272.926857:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000100:00100000:3.0:1783444272.926874:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318 00000100:00100000:3.0:1783444272.926880:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575251328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444272.927152:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575251328:12345-0@lo:400:kworker.0 Request processed in 271us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444272.927160:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318 00000100:00100000:3.0:1783444272.927172:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319 00000100:00100000:3.0:1783444272.927178:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575250688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444272.927209:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575250688:12345-0@lo:400:kworker.0 Request processed in 32us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444272.927215:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319 00000100:00100000:3.0:1783444272.927225:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:3.0:1783444272.927231:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575251200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444272.927255:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575251200:12345-0@lo:400:kworker.0 Request processed in 25us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444272.927260:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00000100:00100000:0.0:1783444272.927392:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575250304 00000100:00100000:0.0:1783444272.927397:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575250304 00000100:00100000:0.0:1783444272.927439:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575250432 00000100:00100000:0.0:1783444272.927443:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575250432 00000100:00100000:0.0:1783444272.927457:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575250944 00000100:00100000:0.0:1783444272.927459:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575250944 00000100:00100000:0.0:1783444272.927469:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575251456 00000100:00100000:0.0:1783444272.927472:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575251456 00000100:00100000:0.0:1783444272.927481:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575250048 00000100:00100000:0.0:1783444272.927483:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575250048 00000100:00100000:0.0:1783444272.927495:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575250176 00000100:00100000:0.0:1783444272.927497:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575250176 00000100:00100000:0.0:1783444272.927509:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1783444272.927515:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575250304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.927549:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575250304:12345-0@lo:400:kworker.0 Request processed in 34us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.927554:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1783444272.927568:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1783444272.927573:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575250432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.927609:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575250432:12345-0@lo:400:kworker.0 Request processed in 36us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.927614:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1783444272.927625:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1783444272.927630:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575250944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.927656:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575250944:12345-0@lo:400:kworker.0 Request processed in 26us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.927661:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1783444272.927672:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1783444272.927677:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575251456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.927701:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575251456:12345-0@lo:400:kworker.0 Request processed in 24us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.927714:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1783444272.927726:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1783444272.927731:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575250048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.927761:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575250048:12345-0@lo:400:kworker.0 Request processed in 30us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.927767:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1783444272.927807:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1783444272.927814:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575250176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.927840:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575250176:12345-0@lo:400:kworker.0 Request processed in 28us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.927846:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1783444272.927910:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575249920 00000100:00100000:0.0:1783444272.927914:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575249920 00000100:00100000:0.0:1783444272.927943:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783444272.927950:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575249920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.927984:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575249920:12345-0@lo:400:kworker.0 Request processed in 34us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.927990:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783444272.928039:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575250560 00000100:00100000:0.0:1783444272.928043:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575250560 00000100:00100000:0.0:1783444272.928063:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575251072 00000100:00100000:0.0:1783444272.928065:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575251072 00000100:00100000:0.0:1783444272.928078:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:0.0:1783444272.928083:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575250560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928110:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575250560:12345-0@lo:400:kworker.0 Request processed in 27us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.928124:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:0.0:1783444272.928134:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:0.0:1783444272.928139:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575251072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928163:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575251072:12345-0@lo:400:kworker.0 Request processed in 24us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444272.928168:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00080000:0.0:1783444272.928440:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444272.928446:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444272.928448:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444272.928451:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444272.928516:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575249920:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928532:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575250432:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928541:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575250944:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928554:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575251456:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928564:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575250304:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928575:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575250816:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928589:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575251328:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928659:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575250176:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928669:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575250688:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928678:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575251200:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928688:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575250048:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928704:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575250560:0@lo:400:kworker.0 00000100:00100000:0.0:1783444272.928713:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575251072:0@lo:400:kworker.0 00000100:00100000:3.0:1783444272.930260:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444272.930279:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575251584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444272.930339:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444272.930829:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575251584 00000100:00100000:2.0:1783444272.930838:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575251584 00000100:00100000:2.0:1783444272.930901:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1783444272.930910:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575251584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444272.930938:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444272.930993:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575251584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444272.931001:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1783444272.931047:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575251584:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783444273.055021:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444273.233316:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444273.233440:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557765760 00000100:00100000:2.0:1783444273.233450:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557765760 00000100:00100000:2.0:1783444273.233515:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:2.0:1783444273.233526:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557765760:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444273.233614:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557765760:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444273.233621:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1783444273.437152:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575251712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444273.437227:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444273.437352:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575251968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444273.437385:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444273.437414:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444273.437420:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575251840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444273.437445:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444273.437528:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575251712 00000100:00100000:2.0:1783444273.437536:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575251712 00000100:00100000:3.0:1783444273.437548:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575251840 00000100:00100000:3.0:1783444273.437552:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575251840 00000100:00100000:2.0:1783444273.437579:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575251968 00000100:00100000:3.0:1783444273.437591:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1783444273.437594:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575251968 00000100:00100000:3.0:1783444273.437600:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575251840:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444273.437609:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1783444273.437614:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575251712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444273.437628:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000004:00000024:3.0:1783444273.437632:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00100000:3.0:1783444273.437669:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575251840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444273.437673:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575251712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444273.437676:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1783444273.437678:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1783444273.437691:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:2.0:1783444273.437698:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575251968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444273.437717:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444273.437747:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575251712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444273.437752:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575251968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444273.437757:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:0.0:1783444273.438636:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575251840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444273.438651:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575251968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783444274.077268:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444275.101039:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444275.997083:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575252096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444275.997243:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444275.997328:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575252096 00000100:00100000:3.0:1783444275.997338:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575252096 00000100:00100000:3.0:1783444275.997409:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:3.0:1783444275.997421:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575252096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444275.997459:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444275.998031:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575252096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 612us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444275.998040:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00080000:3.0:1783444275.998064:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444275.998079:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575252224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444275.998110:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444275.998289:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575252224 00000100:00100000:1.0:1783444275.998295:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575252224 00000100:00100000:1.0:1783444275.998334:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:1.0:1783444275.998342:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575252224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444275.998359:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444275.998395:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575252224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444275.998401:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:2.0:1783444275.998471:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575252096:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783444275.998586:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444275.998609:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575252224:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444276.126352:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444277.151278:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444278.047172:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444278.047195:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575252352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444278.047264:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444278.047312:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575252352 00000100:00100000:2.0:1783444278.047331:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575252352 00000100:00100000:2.0:1783444278.047380:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1783444278.047390:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575252352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444278.047441:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444278.047657:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575252352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.047687:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1783444278.047742:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575252352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444278.048407:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444278.048518:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575252608:0@lo:400:kworker.0 00000100:00100000:0.0:1783444278.048563:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444278.048588:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444278.048594:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575252736:0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.048616:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575252864:0@lo:400:kworker.0 00000100:00100000:0.0:1783444278.048617:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444278.048649:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575252608 00000100:00100000:3.0:1783444278.048653:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444278.048654:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575252608 00000100:00100000:3.0:1783444278.048684:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575252480:0@lo:400:kworker.0 00000100:00100000:0.0:1783444278.048708:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575252736 00000100:00100000:0.0:1783444278.048711:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575252736 00000100:00100000:3.0:1783444278.048714:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444278.048729:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575252864 00000100:00100000:0.0:1783444278.048731:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575252864 00000100:00100000:0.0:1783444278.048749:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1783444278.048754:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1783444278.048756:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575252608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.048760:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575252736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444278.048844:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575252608:12345-0@lo:400:kworker.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444278.048851:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1783444278.048867:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1783444278.048873:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575252864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444278.048904:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575252864:12345-0@lo:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444278.048910:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1783444278.048947:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575252608:0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.049131:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575252736:12345-0@lo:400:kworker.0 Request processed in 371us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444278.049138:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00080000:3.0:1783444278.049155:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444278.049159:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444278.049223:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575252480 00000100:00100000:3.0:1783444278.049227:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575252480 00000100:00100000:3.0:1783444278.049643:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783444278.049651:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575252480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.049699:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575252480:12345-0@lo:400:kworker.0 Request processed in 49us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444278.049705:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783444278.049746:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575252864:0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.049754:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575252480:0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.049781:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575252736:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.050908:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575252992:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.050955:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444278.050992:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575253504:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051015:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444278.051035:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444278.051042:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575253376:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051064:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444278.051077:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575253120:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051092:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575252992 00000100:00100000:2.0:1783444278.051098:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575252992 00000100:00100000:3.0:1783444278.051106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444278.051134:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575253632:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051136:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575253504 00000100:00100000:2.0:1783444278.051138:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575253504 00000100:00100000:3.0:1783444278.051155:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444278.051156:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1783444278.051163:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575252992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051207:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575252992:12345-0@lo:400:kworker.0 Request processed in 44us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.051215:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1783444278.051217:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575253888:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051229:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1783444278.051234:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575253504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051260:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575253504:12345-0@lo:400:kworker.0 Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.051265:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1783444278.051287:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575253376 00000100:00100000:2.0:1783444278.051291:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575253376 00000100:00100000:2.0:1783444278.051342:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575253632 00000100:00100000:2.0:1783444278.051345:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575253632 00000100:00100000:2.0:1783444278.051366:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:2.0:1783444278.051372:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575253376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444278.051401:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444278.051403:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575253376:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.051409:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1783444278.051446:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783444278.051455:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575253248:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051488:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:3.0:1783444278.051491:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444278.051509:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575253760:0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.051542:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444278.051568:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575253120 00000100:00100000:3.0:1783444278.051572:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575253120 00000100:00100000:3.0:1783444278.051597:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1783444278.051603:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575253120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051614:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575253632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051640:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575253632:12345-0@lo:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.051646:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:3.0:1783444278.051649:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575253120:12345-0@lo:400:kworker.0 Request processed in 47us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444278.051656:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1783444278.051656:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575253248 00000100:00100000:2.0:1783444278.051658:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575253248 00000100:00100000:3.0:1783444278.051684:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575253760 00000100:00100000:3.0:1783444278.051687:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575253760 00000100:00100000:2.0:1783444278.051692:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:2.0:1783444278.051697:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575253248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.051707:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:3.0:1783444278.051712:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575253760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051726:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575253248:12345-0@lo:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.051732:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:3.0:1783444278.051735:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575253760:12345-0@lo:400:kworker.0 Request processed in 24us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444278.051741:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00080000:2.0:1783444278.051748:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444278.051752:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444278.051755:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444278.051763:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575253888 00000100:00100000:2.0:1783444278.051766:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575253888 00000100:00100000:3.0:1783444278.051776:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575253248:0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.051801:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575253760:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051807:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1783444278.051811:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575253120:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051813:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575253888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444278.051819:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575253632:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051846:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575253888:12345-0@lo:400:kworker.0 Request processed in 33us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.051857:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1783444278.051902:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575253888:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051929:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575253376:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051938:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575252992:0@lo:400:kworker.0 00000100:00100000:2.0:1783444278.051946:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575253504:0@lo:400:kworker.0 00010000:00010000:1.0:1783444278.179703:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444278.354256:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444278.354298:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444278.354330:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444278.354352:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444278.354374:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444278.354403:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557766400 00000100:00100000:2.0:1783444278.354422:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557766400 00000100:00100000:2.0:1783444278.354488:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557766272 00000100:00100000:2.0:1783444278.354491:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557766272 00000100:00100000:2.0:1783444278.354517:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2325 00000100:00100000:2.0:1783444278.354529:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557766400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444278.354617:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557766400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.354625:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2325 00000100:00100000:2.0:1783444278.354642:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2326 00000100:00100000:2.0:1783444278.354648:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557766272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444278.354687:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557766272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.354710:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2326 00000100:00100000:2.0:1783444278.354729:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557766144 00000100:00100000:2.0:1783444278.354733:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557766144 00000100:00100000:2.0:1783444278.354761:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557766016 00000100:00100000:2.0:1783444278.354764:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557766016 00000100:00100000:2.0:1783444278.354785:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 885 00000100:00100000:2.0:1783444278.354820:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557766144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444278.354852:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557766144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 34us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.354858:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 885 00000100:00100000:2.0:1783444278.354871:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 886 00000100:00100000:2.0:1783444278.354876:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2403:x1870073557766016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444278.354904:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2403:x1870073557766016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.354910:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 886 00000100:00080000:2.0:1783444278.354930:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444278.354935:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444278.354938:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444278.354940:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444278.355129:0:87069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557765888 00000100:00100000:3.0:1783444278.355135:0:87069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557765888 00000100:00100000:3.0:1783444278.355166:0:87069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:3.0:1783444278.355173:0:87069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557765888:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444278.355200:0:87069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557765888:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444278.355205:0:87069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:0.0:1783444278.557246:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575254016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444278.557320:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444278.557426:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575254016 00000100:00100000:2.0:1783444278.557434:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575254016 00000100:00100000:2.0:1783444278.557492:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1783444278.557501:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575254016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444278.557531:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444278.557581:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575254016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.557606:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1783444278.557651:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575254016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444278.564313:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783444278.564339:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575254144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444278.564418:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444278.564465:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575254272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444278.564495:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444278.564598:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575254144 00000100:00100000:2.0:1783444278.564608:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575254144 00000100:00100000:2.0:1783444278.564680:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:2.0:1783444278.564690:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575254144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444278.564730:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00100000:2.0:1783444278.564824:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575254144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444278.564831:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1783444278.564976:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575254272 00000100:00100000:3.0:1783444278.564981:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575254272 00000100:00100000:3.0:1783444278.565022:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:3.0:1783444278.565030:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575254272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444278.565060:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444278.565095:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575254272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444278.565101:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:0.0:1783444278.565459:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575254144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444278.565475:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575254272:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1783444279.075015:0:87062:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182402 is committed 00010000:00010000:3.0:1783444279.197383:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783444280.013070:0:87889:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 13:11:19 (1783444279) 00000100:00100000:3.0:1783444280.105062:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444280.105391:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557766528 00000100:00100000:2.0:1783444280.105404:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557766528 00000100:00100000:2.0:1783444280.105489:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1147 00000100:00100000:2.0:1783444280.105500:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67807:x1870073557766528:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444280.105523:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444280.105543:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3831f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939acd expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105627:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105652:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105666:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105682:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783444280.105691:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783444280.105697:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105704:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105751:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105759:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105766:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105773:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444280.105778:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105786:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105815:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c498b900) 00010000:00010000:2.0:1783444280.105818:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444280.105824:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105830:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3831f57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105840:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105852:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105858:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105863:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444280.105866:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105872:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105880:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9368cdf77b00) 00010000:00010000:2.0:1783444280.105883:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444280.105886:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105892:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3831f5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105928:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3831f50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939acd expref: 9 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105939:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c498b900) 00010000:00010000:2.0:1783444280.105941:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444280.105945:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3831f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939acd expref: 9 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444280.105965:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11a00, rc 0) 00000100:00100000:2.0:1783444280.106034:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67807:x1870073557766528:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 536us (983us total) trans 0 rc 301/301 00000100:00100000:2.0:1783444280.106042:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1147 00000100:00100000:2.0:1783444280.108824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444280.108876:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557766784 00000100:00100000:3.0:1783444280.108886:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557766784 00000100:00100000:3.0:1783444280.108945:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1148 00000100:00100000:3.0:1783444280.108956:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67807:x1870073557766784:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444280.108982:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444280.108986:0:66225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783444280.109016:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26000/0x42cb6883e3831ee7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ab1 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109038:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c498b900) 00010000:00010000:3.0:1783444280.109048:0:66225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444280.109065:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831f65 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ad4 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109168:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109181:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109203:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109215:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109222:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109229:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109694:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109705:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109713:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444280.109730:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:3.0:1783444280.109759:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109767:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109773:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109779:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109785:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444280.109820:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109829:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109839:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15c700) 00010000:00010000:3.0:1783444280.109842:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444280.109846:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109852:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831f6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444280.109862:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eeab7654 reply state 000000000a0d3664 transno 107374182403 ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109884:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109890:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9367cd15c000) 00010000:00010000:3.0:1783444280.109892:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444280.109895:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783444280.109922:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831f65 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109939:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.109946:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:3.0:1783444280.109948:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444280.109951:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05800, rc 0) 00000100:00100000:3.0:1783444280.110018:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67807:x1870073557766784:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1064us (1201us total) trans 107374182403 rc 0/0 00000100:00100000:3.0:1783444280.110026:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1148 00000100:00100000:2.0:1783444280.123049:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444280.123473:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557767040 00000100:00100000:3.0:1783444280.123484:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557767040 00000100:00100000:3.0:1783444280.123547:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1149 00000100:00100000:3.0:1783444280.123558:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67807:x1870073557767040:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444280.123582:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444280.123618:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939adb expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.123742:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.123767:0:66223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 11 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.123777:0:66223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.123832:0:66223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 11 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444280.123846:0:66223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 11 pid: 66225 timeout: 3371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444280.123874:0:66223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575254400:192.168.204.20@tcp:104: 00000100:00100000:3.0:1783444280.123954:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bea480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444280.142064:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444280.142114:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557767168 00000100:00100000:0.0:1783444280.142125:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557767168 00010000:00010000:0.0:1783444280.142161:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 12 pid: 66225 timeout: 3371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444280.142229:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2544 00000100:00100000:0.0:1783444280.142239:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2402:x1870073557767168:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444280.142259:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444280.142268:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 12 pid: 66225 timeout: 3371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444280.142282:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 12 pid: 66225 timeout: 3371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444280.142309:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:0.0:1783444280.142316:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444280.142325:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444280.142333:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444280.142354:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444280.142408:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2402:x1870073557767168:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 170us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444280.142416:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2544 00010000:00010000:1.0:1783444280.143327:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3831f7a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ad4 expref: 11 pid: 66225 timeout: 3371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444280.143344:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575254400:192.168.204.20@tcp:104: 00010000:00010000:1.0:1783444280.143367:0:66223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.143376:0:66223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.143382:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444280.143402:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1783444280.144335:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144348:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144355:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144361:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444280.144365:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144373:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144387:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:1.0:1783444280.144390:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783444280.144395:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144401:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e3831f8f lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144463:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831f88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939adb expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144473:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15c400) 00010000:00010000:1.0:1783444280.144475:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444280.144479:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05c00/0x42cb6883e3831f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939adb expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444280.144504:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05c00, rc 0) 00000100:00100000:1.0:1783444280.144620:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67807:x1870073557767040:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 21063us (21578us total) trans 107374182404 rc 301/301 00000100:00100000:1.0:1783444280.144628:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1149 00000100:00100000:0.0:1783444280.159291:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444280.159437:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557767424 00000100:00100000:3.0:1783444280.159447:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557767424 00000100:00100000:3.0:1783444280.159504:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:3.0:1783444280.159515:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67807:x1870073557767424:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1783444280.159910:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+11:67807:x1870073557767424:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 394us (629us total) trans 107374182405 rc 0/0 00000100:00100000:3.0:1783444280.159918:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:3.0:1783444280.168051:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444280.168155:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557767680 00000100:00100000:2.0:1783444280.168167:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557767680 00000100:00100000:2.0:1783444280.168358:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:2.0:1783444280.168370:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+11:67807:x1870073557767680:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1783444280.168916:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+12:67807:x1870073557767680:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 546us (874us total) trans 107374182406 rc 0/0 00000100:00100000:2.0:1783444280.168925:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 223 00010000:00010000:1.0:1783444280.221006:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444281.118130:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444281.118165:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575254528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444281.118240:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444281.118399:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575254528 00000100:00100000:0.0:1783444281.118409:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575254528 00000100:00100000:0.0:1783444281.118472:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:0.0:1783444281.118498:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575254528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444281.118532:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444281.118587:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575254528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444281.118593:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:0.0:1783444281.118648:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575254528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444281.118668:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444281.118677:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575254656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444281.118718:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444281.118747:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575254656 00000100:00100000:2.0:1783444281.118751:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575254656 00000100:00100000:2.0:1783444281.118776:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:2.0:1783444281.118782:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575254656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444281.118816:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444281.118864:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575254656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444281.118870:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:2.0:1783444281.118910:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575254656:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783444281.120883:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444281.120899:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1783444281.211829:0:87062:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182406 is committed 00010000:00010000:0.0:1783444281.213351:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.213369:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.213376:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.213383:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444281.213388:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.213396:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.213416:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9367cd15c000) 00010000:00010000:0.0:1783444281.213419:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444281.213424:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.213430:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05400/0x42cb6883e3831f73 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.248660:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444281.332169:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444281.332429:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557767808 00000100:00100000:1.0:1783444281.332441:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557767808 00000100:00100000:1.0:1783444281.332522:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1150 00000100:00100000:1.0:1783444281.332534:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+7:67822:x1870073557767808:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444281.332561:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444281.332589:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e3831f9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ae2 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.332669:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3831fa4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.332683:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3831fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.332694:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3831fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444281.332739:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783444281.332744:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444281.332770:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3831fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.332848:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e3831f9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ae2 expref: 9 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.332877:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3831fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ae2 expref: 8 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.332887:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c6b5e600) 00010000:00010000:1.0:1783444281.332890:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444281.332893:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27a00, rc 0) 00000100:00100000:0.0:1783444281.333127:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67822:x1870073557767808:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 593us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444281.333136:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1150 00000100:00100000:1.0:1783444281.339503:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444281.347643:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557767936 00000100:00100000:0.0:1783444281.347659:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557767936 00000100:00100000:0.0:1783444281.347820:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1151 00000100:00100000:0.0:1783444281.347831:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67822:x1870073557767936:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1783444281.347940:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00000100:00100000:0.0:1783444281.348040:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67822:x1870073557767936:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 212us (8550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444281.348050:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1151 00000100:00100000:3.0:1783444281.351942:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444281.352029:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557768064 00000100:00100000:2.0:1783444281.352041:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557768064 00000100:00100000:2.0:1783444281.352132:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1152 00000100:00100000:2.0:1783444281.352145:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:67822:x1870073557768064:12345-192.168.204.20@tcp:41:lfs.0 00000100:00080000:3.0:1783444281.352267:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1783444281.352335:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444281.352407:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:67822:x1870073557768064:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 266us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444281.352414:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1152 00000100:00100000:2.0:1783444281.357763:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444281.358091:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557768192 00000100:00100000:0.0:1783444281.358113:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557768192 00000100:00080000:2.0:1783444281.358171:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444281.358187:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1844 00000100:00100000:0.0:1783444281.358197:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:67822:x1870073557768192:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1783444281.358225:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444281.358422:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:67822:x1870073557768192:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 226us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444281.358430:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1844 00000100:00100000:1.0:1783444281.364240:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444281.364339:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557768320 00000100:00100000:2.0:1783444281.364349:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557768320 00000100:00080000:3.0:1783444281.364398:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444281.364450:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1845 00000100:00100000:2.0:1783444281.364461:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:67822:x1870073557768320:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444281.364488:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444281.364562:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:67822:x1870073557768320:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 103us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444281.364570:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1845 00000100:00100000:3.0:1783444281.399205:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444281.402397:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557768576 00000100:00100000:0.0:1783444281.402417:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557768576 00000100:00100000:0.0:1783444281.402550:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1153 00000100:00100000:0.0:1783444281.402562:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67829:x1870073557768576:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00010000:0.0:1783444281.402654:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444281.402694:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3831fa4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ae2 expref: 8 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.402715:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c6b5e600) 00010000:00010000:0.0:1783444281.402728:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444281.402852:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.402867:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.402878:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.402890:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.402897:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.402903:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403329:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403339:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403346:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403352:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444281.403365:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403375:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403386:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7f86500) 00010000:00010000:0.0:1783444281.403389:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444281.403393:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403399:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262000/0x42cb6883e3831fab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444281.403414:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000921fc1d4 reply state 0000000003a90a6f transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403426:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444281.403432:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86a00) 00010000:00010000:0.0:1783444281.403435:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444281.403437:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444281.403539:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+9:67829:x1870073557768576:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 978us (4344us total) trans 107374182407 rc 0/0 00000100:00100000:0.0:1783444281.403549:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1153 00000100:00100000:1.0:1783444281.422188:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444281.422959:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557768704 00000100:00100000:3.0:1783444281.422972:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557768704 00000100:00100000:3.0:1783444281.423046:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1154 00000100:00100000:3.0:1783444281.423068:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+9:67832:x1870073557768704:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444281.423098:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444281.423121:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831fb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ae9 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.423189:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831fc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.423205:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.423217:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444281.423261:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444281.423265:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444281.423653:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.423683:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831fb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ae9 expref: 11 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.423701:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ae9 expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.423720:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15c700) 00010000:00010000:3.0:1783444281.423723:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444281.423727:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05a00, rc 0) 00000100:00100000:3.0:1783444281.424034:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67832:x1870073557768704:12345-192.168.204.20@tcp:101:rm.0 Request processed in 977us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444281.424043:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1154 00000100:00100000:2.0:1783444281.441300:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444281.451139:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557768832 00000100:00100000:3.0:1783444281.451160:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557768832 00000100:00100000:3.0:1783444281.452914:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1155 00000100:00100000:3.0:1783444281.452932:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67832:x1870073557768832:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444281.452955:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444281.452979:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831fc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939af0 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453049:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453064:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453076:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453087:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453094:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453116:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453309:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04400/0x42cb6883e3831fdc lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453318:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04400/0x42cb6883e3831fdc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453325:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04400/0x42cb6883e3831fdc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444281.453372:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783444281.453376:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444281.453396:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04400/0x42cb6883e3831fdc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453408:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04400/0x42cb6883e3831fdc lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453419:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453426:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453432:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453440:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453457:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444281.453462:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453469:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453484:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15c700) 00010000:00010000:3.0:1783444281.453487:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444281.453492:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453499:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3831fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453512:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453518:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453523:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453528:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444281.453531:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453537:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453556:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86a00) 00010000:00010000:3.0:1783444281.453558:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444281.453562:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453568:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.453595:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3831fc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939af0 expref: 12 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.458756:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04400/0x42cb6883e3831fdc lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939af0 expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.458775:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9367cd15c200) 00010000:00010000:3.0:1783444281.458779:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444281.458783:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04400, rc 0) 00000100:00100000:3.0:1783444281.458912:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+11:67832:x1870073557768832:12345-192.168.204.20@tcp:101:rm.0 Request processed in 5984us (17622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444281.458921:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1155 00000100:00100000:3.0:1783444281.474989:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444281.475175:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557769088 00000100:00100000:1.0:1783444281.475186:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557769088 00000100:00100000:1.0:1783444281.475250:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1156 00000100:00100000:1.0:1783444281.475261:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:67832:x1870073557769088:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1783444281.475319:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783444281.475349:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04400/0x42cb6883e3831fdc lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939af0 expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475371:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9367cd15c200) 00010000:00010000:1.0:1783444281.475390:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05a00/0x42cb6883e3831fc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ae9 expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475400:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15c700) 00010000:00010000:1.0:1783444281.475406:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444281.475443:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475456:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475466:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475479:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475487:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475493:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475587:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475595:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.475604:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478003:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478024:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478035:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478051:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478058:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478064:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478092:0:67017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444281.478117:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478124:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478130:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478136:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444281.478141:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478148:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478160:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9368c6b5e100) 00010000:00010000:1.0:1783444281.478163:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783444281.478167:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478182:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e3831ff1 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478204:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478210:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478215:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478220:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478225:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444281.478227:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478233:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478241:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c6b5ec00) 00010000:00010000:1.0:1783444281.478243:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444281.478247:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478253:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3831fe3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444281.478267:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031280364 reply state 00000000509498e3 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478287:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444281.478294:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86a00) 00010000:00010000:1.0:1783444281.478296:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444281.478300:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444281.478387:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:67832:x1870073557769088:12345-192.168.204.20@tcp:36:rm.0 Request processed in 3124us (3404us total) trans 107374182408 rc 0/0 00000100:00100000:1.0:1783444281.478396:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1156 00010000:00010000:3.0:1783444281.478874:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444281.478882:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.478889:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444281.478893:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.478912:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.478923:0:10324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9368c6b5e100) 00010000:00010000:3.0:1783444281.478926:0:10324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783444281.478930:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.478935:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26400/0x42cb6883e3831ff8 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444281.478949:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444281.478951:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444281.478953:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444282.272048:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444283.165114:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575255168:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165240:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575255680:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165269:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165289:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575256192:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165321:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165349:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1783444283.165356:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575254784:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165386:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165413:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575255296:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165434:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165454:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575255808:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165473:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165488:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575256320:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165547:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575255040:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165571:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165601:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575255552:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165623:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165639:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575256064:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165660:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165676:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783444283.165682:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575254912:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165704:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165721:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575255424:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165743:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165759:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575255936:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.165776:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.165825:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575255168 00000100:00100000:1.0:1783444283.165834:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575255168 00000100:00100000:1.0:1783444283.165882:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575255296 00000100:00100000:1.0:1783444283.165886:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575255296 00000100:00100000:1.0:1783444283.165900:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575255808 00000100:00100000:1.0:1783444283.165902:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575255808 00000100:00100000:1.0:1783444283.165912:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575256320 00000100:00100000:1.0:1783444283.165914:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575256320 00000100:00100000:1.0:1783444283.165923:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575255040 00000100:00100000:1.0:1783444283.165925:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575255040 00000100:00100000:1.0:1783444283.165936:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575254912 00000100:00100000:1.0:1783444283.165938:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575254912 00000100:00100000:1.0:1783444283.165952:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1783444283.165960:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575255168:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444283.165985:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd10b100 x1870073575255168/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1783444294 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444283.166035:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575255168:12345-0@lo:400:kworker.0 Request processed in 74us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166044:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1783444283.166064:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1783444283.166070:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575255296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.166096:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575255296:12345-0@lo:400:kworker.0 Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166102:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1783444283.166113:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1783444283.166118:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575255808:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444283.166128:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd108a80 x1870073575255808/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1783444294 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444283.166153:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575255808:12345-0@lo:400:kworker.0 Request processed in 35us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166158:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1783444283.166169:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1783444283.166175:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575256320:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444283.166185:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd108e00 x1870073575256320/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1783444294 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444283.166210:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575256320:12345-0@lo:400:kworker.0 Request processed in 36us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166216:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1783444283.166228:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1783444283.166234:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575255040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.166276:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575255040:12345-0@lo:400:kworker.0 Request processed in 42us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166282:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1783444283.166295:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1783444283.166302:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575254912:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444283.166313:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c4acaa00 x1870073575254912/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1783444294 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444283.166340:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575254912:12345-0@lo:400:kworker.0 Request processed in 38us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166346:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1783444283.166366:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575255680 00000100:00100000:1.0:1783444283.166370:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575255680 00000100:00100000:1.0:1783444283.166395:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575256192 00000100:00100000:1.0:1783444283.166397:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575256192 00000100:00100000:1.0:1783444283.166415:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575255552 00000100:00100000:1.0:1783444283.166417:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575255552 00000100:00100000:1.0:1783444283.166436:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575256064 00000100:00100000:1.0:1783444283.166439:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575256064 00000100:00100000:1.0:1783444283.166460:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:1.0:1783444283.166466:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575255680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.166497:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575255680:12345-0@lo:400:kworker.0 Request processed in 31us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166504:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:1.0:1783444283.166515:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:1.0:1783444283.166521:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575256192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.166546:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575256192:12345-0@lo:400:kworker.0 Request processed in 25us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166560:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:1.0:1783444283.166571:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:1.0:1783444283.166589:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575255552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.166619:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575255552:12345-0@lo:400:kworker.0 Request processed in 43us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166624:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:1.0:1783444283.166634:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:1.0:1783444283.166640:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575256064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.166664:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575256064:12345-0@lo:400:kworker.0 Request processed in 24us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166670:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:1.0:1783444283.166692:0:87074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575254784 00000100:00100000:1.0:1783444283.166696:0:87074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575254784 00000100:00100000:1.0:1783444283.166717:0:87074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783444283.166723:0:87074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575254784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.166751:0:87074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575254784:12345-0@lo:400:kworker.0 Request processed in 28us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166757:0:87074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783444283.166821:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575255424 00000100:00100000:1.0:1783444283.166825:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575255424 00000100:00100000:1.0:1783444283.166848:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575255936 00000100:00100000:1.0:1783444283.166850:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575255936 00000100:00100000:1.0:1783444283.166866:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:1.0:1783444283.166872:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575255424:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444283.166886:0:29151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c4ac8700 x1870073575255424/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1783444294 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444283.166927:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575255424:12345-0@lo:400:kworker.0 Request processed in 55us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166934:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:1.0:1783444283.166946:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:1.0:1783444283.166952:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575255936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.166977:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575255936:12345-0@lo:400:kworker.0 Request processed in 26us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.166983:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00080000:1.0:1783444283.167003:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444283.167007:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444283.167009:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444283.167012:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444283.167052:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575254912:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167063:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575255424:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167073:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575255936:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167082:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575255040:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167092:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575255552:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167101:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575256064:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167140:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575254784:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167151:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575255296:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167161:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575255808:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167170:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575256320:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167192:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575255168:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167202:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575255680:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.167211:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575256192:0@lo:400:kworker.0 00000100:00100000:1.0:1783444283.172453:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444283.172477:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575256448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444283.172551:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444283.172614:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575256448 00000100:00100000:1.0:1783444283.172622:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575256448 00000100:00100000:1.0:1783444283.172669:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1783444283.172679:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575256448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444283.172725:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444283.172776:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575256448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444283.172783:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1783444283.172856:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575256448:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783444283.294694:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444283.471372:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444283.471420:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444283.471458:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444283.471481:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444283.471509:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444283.471556:0:87075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557769216 00000100:00100000:0.0:1783444283.471576:0:87075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557769216 00000100:00100000:0.0:1783444283.471642:0:87075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:3.0:1783444283.472265:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557769600 00000100:00100000:3.0:1783444283.472271:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557769600 00000100:00100000:3.0:1783444283.472317:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557769728 00000100:00100000:3.0:1783444283.472321:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557769728 00000100:00100000:3.0:1783444283.472343:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2331 00000100:00100000:3.0:1783444283.472353:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557769600:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444283.472431:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557769600:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 79us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444283.472440:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2331 00000100:00100000:3.0:1783444283.472458:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2332 00000100:00100000:3.0:1783444283.472465:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557769728:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444283.472490:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557769728:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444283.472504:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2332 00000100:00080000:3.0:1783444283.472523:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444283.472621:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444283.472823:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557769344 00000100:00100000:2.0:1783444283.472840:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557769344 00000100:00100000:2.0:1783444283.472948:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557769472 00000100:00100000:2.0:1783444283.472953:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557769472 00000100:00100000:2.0:1783444283.472983:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 893 00000100:00100000:2.0:1783444283.472991:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2403:x1870073557769344:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000080:2.0:1783444283.473026:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68e7800 x1870073557769344/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:659/0 lens 224/224 e 0 to 0 dl 1783444294 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444283.473069:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2403:x1870073557769344:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 79us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444283.473076:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 893 00000100:00100000:2.0:1783444283.473091:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 894 00000100:00100000:2.0:1783444283.473097:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557769472:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444283.473122:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557769472:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444283.473128:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 894 00000100:00080000:2.0:1783444283.473144:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444283.473147:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444283.473327:0:87075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557769216:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444283.473359:0:87075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557769216:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444283.473367:0:87075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:0.0:1783444283.676970:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444283.677000:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575256576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444283.677092:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444283.677141:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575256576 00000100:00100000:0.0:1783444283.677148:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575256576 00000100:00100000:0.0:1783444283.677196:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:0.0:1783444283.677203:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575256576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444283.677233:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444283.677274:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575256576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444283.677281:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:0.0:1783444283.677328:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575256576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444283.678616:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575256704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444283.678664:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444283.678710:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575256704 00000100:00100000:3.0:1783444283.678715:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575256704 00000100:00100000:3.0:1783444283.678750:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:3.0:1783444283.678756:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575256704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444283.678784:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00010000:00000080:3.0:1783444283.678814:0:8430:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ea494a80 x1870073575256704/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/368 e 0 to 0 dl 1783444294 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444283.678851:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575256704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444283.678858:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:3.0:1783444283.678894:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575256704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444283.679609:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444283.679620:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575256832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444283.679654:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444283.679686:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575256832 00000100:00100000:0.0:1783444283.679690:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575256832 00000100:00100000:0.0:1783444283.679721:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:0.0:1783444283.679729:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575256832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444283.679766:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444283.679840:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575256832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444283.679847:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:0.0:1783444283.679886:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575256832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783444284.318963:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444285.350733:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444286.239382:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575256960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444286.239464:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444286.239537:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575256960 00000100:00100000:0.0:1783444286.239545:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575256960 00000100:00100000:0.0:1783444286.239605:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:0.0:1783444286.239615:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575256960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444286.239646:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444286.239692:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575256960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444286.239699:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00080000:0.0:1783444286.239719:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444286.239751:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575256960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444286.240889:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444286.240905:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575257088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444286.240953:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444286.241183:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575257088 00000100:00100000:1.0:1783444286.241189:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575257088 00000100:00100000:1.0:1783444286.241239:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1783444286.241247:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575257088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444286.241269:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444286.241313:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575257088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444286.241320:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00080000:0.0:1783444286.243563:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444286.243635:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575257088:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783444286.391317:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783444287.154711:0:87062:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:1.0:1783444287.154770:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154782:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154891:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154898:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444287.154904:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154912:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154932:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86a00) 00010000:00010000:1.0:1783444287.154936:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444287.154940:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154945:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef262e00/0x42cb6883e3831fb2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154966:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154972:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154978:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.154990:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444287.154994:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.155000:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.155009:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86a00) 00010000:00010000:1.0:1783444287.155012:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444287.155015:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444287.155021:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3831fea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444287.456065:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444288.285101:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575257472:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.285200:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444288.285249:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575257984:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.285294:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444288.285314:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575258496:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.285336:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444288.285378:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783444288.285384:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575257600:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.285409:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444288.285427:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575258112:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.285453:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444288.285499:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575258624:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.285524:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444288.285565:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575257472 00000100:00100000:1.0:1783444288.285575:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575257472 00000100:00100000:1.0:1783444288.285646:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1783444288.285658:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575257472:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444288.285704:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e380b480 x1870073575257472/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:664/0 lens 224/224 e 0 to 0 dl 1783444299 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444288.285754:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575257472:12345-0@lo:400:kworker.0 Request processed in 98us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.285763:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1783444288.285832:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575257600 00000100:00100000:1.0:1783444288.285836:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575257600 00000100:00100000:1.0:1783444288.285865:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1783444288.285872:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575257600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.285906:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575257600:12345-0@lo:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.285912:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1783444288.285934:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575257984 00000100:00100000:1.0:1783444288.285938:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575257984 00000100:00100000:1.0:1783444288.285963:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575258496 00000100:00100000:1.0:1783444288.285966:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575258496 00000100:00100000:1.0:1783444288.285982:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:1.0:1783444288.285987:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575257984:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444288.286002:0:29151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e3808380 x1870073575257984/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:664/0 lens 224/224 e 0 to 0 dl 1783444299 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444288.286030:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575257984:12345-0@lo:400:kworker.0 Request processed in 43us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.286045:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:1.0:1783444288.286059:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:1.0:1783444288.286064:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575258496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.286094:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575258496:12345-0@lo:400:kworker.0 Request processed in 29us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.286099:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:1.0:1783444288.286123:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575258112 00000100:00100000:1.0:1783444288.286127:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575258112 00000100:00100000:1.0:1783444288.286154:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575258624 00000100:00100000:1.0:1783444288.286158:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575258624 00000100:00100000:1.0:1783444288.286176:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:1.0:1783444288.286182:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575258112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.286219:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575258112:12345-0@lo:400:kworker.0 Request processed in 36us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.286225:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:1.0:1783444288.286237:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:1.0:1783444288.286243:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575258624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.286272:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575258624:12345-0@lo:400:kworker.0 Request processed in 29us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.286278:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00080000:1.0:1783444288.286298:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444288.286303:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444288.286306:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444288.286371:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575257600:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.286384:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575258112:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.286406:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575258624:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.286415:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575257472:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.286425:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575257984:0@lo:400:kworker.0 00000100:00100000:1.0:1783444288.286435:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575258496:0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.286927:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575257344:0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.286980:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444288.287021:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575257856:0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.287047:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444288.287069:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575258368:0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.287092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444288.287109:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575258880:0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.287127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444288.287155:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783444288.287161:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575257216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444288.287184:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444288.287202:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575257728:0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.287222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444288.287235:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575258240:0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.287414:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444288.287437:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575258752:0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.287462:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444288.287508:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575257856 00000100:00100000:3.0:1783444288.287514:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575257856 00000100:00100000:3.0:1783444288.287654:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575258368 00000100:00100000:3.0:1783444288.287658:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575258368 00000100:00100000:3.0:1783444288.287672:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575258880 00000100:00100000:3.0:1783444288.287674:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575258880 00000100:00100000:3.0:1783444288.287684:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575257728 00000100:00100000:3.0:1783444288.287687:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575257728 00000100:00100000:3.0:1783444288.287702:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1783444288.287709:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575257856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.287759:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575257856:12345-0@lo:400:kworker.0 Request processed in 50us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.287766:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1783444288.287782:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1783444288.287810:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575258368:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783444288.287824:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f57c3100 x1870073575258368/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:664/0 lens 224/224 e 0 to 0 dl 1783444299 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444288.287854:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575258368:12345-0@lo:400:kworker.0 Request processed in 66us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.287866:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1783444288.287877:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1783444288.287883:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575258880:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783444288.287896:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f57c0000 x1870073575258880/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:664/0 lens 224/224 e 0 to 0 dl 1783444299 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444288.287919:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575258880:12345-0@lo:400:kworker.0 Request processed in 37us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.287925:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1783444288.287935:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1783444288.287940:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575257728:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1783444288.287950:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f57c3b80 x1870073575257728/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:664/0 lens 224/224 e 0 to 0 dl 1783444299 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444288.287973:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575257728:12345-0@lo:400:kworker.0 Request processed in 33us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.287978:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1783444288.287997:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575257216 00000100:00100000:3.0:1783444288.288001:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575257216 00000100:00100000:3.0:1783444288.288040:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:3.0:1783444288.288047:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575257216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444288.288083:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444288.288116:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575257216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.288123:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:3.0:1783444288.288153:0:87066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575257344 00000100:00100000:3.0:1783444288.288157:0:87066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575257344 00000100:00100000:3.0:1783444288.288189:0:87066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783444288.288195:0:87066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575257344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.288229:0:87066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575257344:12345-0@lo:400:kworker.0 Request processed in 34us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.288236:0:87066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783444288.288291:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575258240 00000100:00100000:3.0:1783444288.288294:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575258240 00000100:00100000:3.0:1783444288.288324:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575258752 00000100:00100000:3.0:1783444288.288327:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575258752 00000100:00100000:3.0:1783444288.288345:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:3.0:1783444288.288350:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575258240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.288381:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575258240:12345-0@lo:400:kworker.0 Request processed in 31us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.288388:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:3.0:1783444288.288399:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:3.0:1783444288.288404:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575258752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444288.288432:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575258752:12345-0@lo:400:kworker.0 Request processed in 28us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.288438:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00080000:3.0:1783444288.288475:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444288.291269:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575257216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444288.291300:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575257728:0@lo:400:kworker.0 00000100:00100000:2.0:1783444288.291316:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575258240:0@lo:400:kworker.0 00000100:00100000:2.0:1783444288.291331:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575258752:0@lo:400:kworker.0 00000100:00100000:2.0:1783444288.291356:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575257344:0@lo:400:kworker.0 00000100:00100000:2.0:1783444288.291370:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575257856:0@lo:400:kworker.0 00000100:00100000:2.0:1783444288.291386:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575258368:0@lo:400:kworker.0 00000100:00100000:2.0:1783444288.291399:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575258880:0@lo:400:kworker.0 00000100:00080000:3.0:1783444288.292141:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444288.292145:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1783444288.411171:0:88285:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:0.0:1783444288.477085:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444288.517412:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444288.519671:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557769856 00000100:00100000:3.0:1783444288.519689:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557769856 00000100:00080000:1.0:1783444288.519782:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444288.519816:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1157 00000100:00100000:3.0:1783444288.519831:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+7:67900:x1870073557769856:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444288.519854:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444288.519894:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939af7 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.520183:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3832006 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.520199:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3832006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.520213:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3832006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444288.520272:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444288.520277:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444288.520327:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3832006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.520364:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05600/0x42cb6883e3831fff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939af7 expref: 9 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.520387:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3832006 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939af7 expref: 8 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.520396:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15c700) 00010000:00010000:3.0:1783444288.520400:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444288.520405:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04000, rc 0) 00010000:00000080:3.0:1783444288.520416:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8f800 x1870073557769856/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:664/0 lens 576/688 e 0 to 0 dl 1783444299 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444288.521103:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67900:x1870073557769856:12345-192.168.204.20@tcp:101:dd.0 Request processed in 1272us (3704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.521128:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1157 00000100:00100000:0.0:1783444288.527696:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444288.527900:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557770112 00000100:00100000:3.0:1783444288.527912:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557770112 00000100:00100000:3.0:1783444288.528008:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1158 00000100:00100000:3.0:1783444288.528022:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:67900:x1870073557770112:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444288.528048:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444288.528052:0:66225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783444288.528081:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04000/0x42cb6883e3832006 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939af7 expref: 8 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528102:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15c700) 00010000:00010000:3.0:1783444288.528115:0:66225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444288.528130:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e383200d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939afe expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528270:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528284:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528295:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528310:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528318:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528344:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528415:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528423:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528443:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444288.528565:0:66225:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1783444288.528569:0:66225:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1783444281 00000004:00010000:3.0:1783444288.528572:0:66225:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1783444281 00000004:00010000:3.0:1783444288.528574:0:66225:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1783444281 00000004:00010000:3.0:1783444288.528577:0:66225:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:3.0:1783444288.528581:0:66225:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:3.0:1783444288.528588:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528595:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528613:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528620:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528628:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444288.528640:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528649:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528659:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15c200) 00010000:00010000:3.0:1783444288.528662:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444288.528666:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528673:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04c00/0x42cb6883e3832014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528684:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528690:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528696:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528701:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444288.528703:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528709:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528715:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9367cd15c000) 00010000:00010000:3.0:1783444288.528718:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444288.528728:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528734:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e383201b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528773:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e383200d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528822:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444288.528831:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367cd15c400) 00010000:00010000:3.0:1783444288.528835:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1783444288.528839:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04e00, rc 0) 00010000:00000080:3.0:1783444288.528848:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8e300 x1870073557770112/t107374182409(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:664/0 lens 752/824 e 0 to 0 dl 1783444299 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444288.528919:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+9:67900:x1870073557770112:12345-192.168.204.20@tcp:101:dd.0 Request processed in 902us (1233us total) trans 107374182409 rc 0/0 00000100:00100000:3.0:1783444288.528928:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1158 00000100:00100000:3.0:1783444288.534246:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444288.534321:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557770240 00000100:00100000:1.0:1783444288.534338:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557770240 00000100:00100000:1.0:1783444288.534436:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1159 00000100:00100000:1.0:1783444288.534449:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:67900:x1870073557770240:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444288.534499:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444288.534530:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e3832030 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b05 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.534577:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3832037 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.534596:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3832037 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.534611:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3832037 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.534762:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e3832030 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b05 expref: 11 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.534785:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3832037 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b05 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.534839:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367cd15c400) 00010000:00010000:1.0:1783444288.534843:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783444288.534847:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27a00, rc 0) 00010000:00000080:1.0:1783444288.534859:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c2c89f80 x1870073557770240/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:664/0 lens 568/1272 e 0 to 0 dl 1783444299 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444288.535075:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67900:x1870073557770240:12345-192.168.204.20@tcp:101:dd.0 Request processed in 629us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.535084:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1159 00000100:00100000:0.0:1783444288.540751:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444288.543739:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557770496 00000100:00100000:1.0:1783444288.543760:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557770496 00000100:00100000:1.0:1783444288.543892:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1160 00000100:00100000:1.0:1783444288.543908:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+10:67900:x1870073557770496:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1783444288.544107:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.544298:0:80475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.544310:0:80475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.544365:0:80475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444288.544385:0:80475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 10 pid: 66225 timeout: 3379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444288.544425:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80475:1870073575259008:192.168.204.20@tcp:104: 00000100:00100000:1.0:1783444288.545032:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c61b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444288.551450:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444288.551620:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557770624 00000100:00100000:2.0:1783444288.551636:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557770624 00010000:00010000:2.0:1783444288.551698:0:8436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 11 pid: 66225 timeout: 3379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444288.551751:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2545 00000100:00100000:2.0:1783444288.551763:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2403:x1870073557770624:12345-192.168.204.20@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1783444288.551785:0:8436:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 11 pid: 66225 timeout: 3379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444288.551823:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 11 pid: 66225 timeout: 3379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444288.551838:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 11 pid: 66225 timeout: 3379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444288.551849:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367cd15c400) 00010000:00010000:2.0:1783444288.551853:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1783444288.551857:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444288.551870:0:8436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444288.551878:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444288.551913:0:8436:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 11 pid: 66225 timeout: 3379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444288.552001:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2403:x1870073557770624:12345-192.168.204.20@tcp:102:ldlm_bl.0 Request processed in 239us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444288.552011:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2545 00000100:00100000:0.0:1783444288.555081:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:80475:1870073575259008:192.168.204.20@tcp:104: 00010000:00010000:0.0:1783444288.555125:0:80475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444288.555141:0:80475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444288.555148:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444288.556136:0:80475:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1783444288.556142:0:80475:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783444281 -> 1783444289 00000004:00010000:0.0:1783444288.556146:0:80475:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783444281 -> 1783444281 00000004:00010000:0.0:1783444288.556148:0:80475:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783444281 -> 1783444289 00000004:00010000:0.0:1783444288.556151:0:80475:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1783444288.556160:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008b20ec3 reply state 00000000b8d87c4d transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444288.556185:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444288.556197:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367cd15c400) 00010000:00010000:0.0:1783444288.556202:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444288.556208:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1783444288.556308:0:80475:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8ce00 x1870073557770496/t107374182410(0) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:664/0 lens 488/456 e 0 to 0 dl 1783444299 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444288.556949:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+12:67900:x1870073557770496:12345-192.168.204.20@tcp:36:dd.0 Request processed in 13041us (16209us total) trans 107374182410 rc 0/0 00000100:00100000:0.0:1783444288.556961:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1160 00000100:00100000:0.0:1783444288.567083:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444288.567192:0:66245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557770752 00000100:00100000:3.0:1783444288.567212:0:66245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557770752 00002000:00010000:3.0:1783444288.567281:0:66245:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:3.0:1783444288.567289:0:66245:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9368e7c8c700 with x1870073557770752 00000100:00100000:3.0:1783444288.567349:0:66245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1783444288.567361:0:66245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2404:x1870073557770752:12345-192.168.204.20@tcp:10:dd.0 00000004:00010000:2.0:1783444288.567994:0:66245:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1783444288.568009:0:66245:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783444289 -> 1783444289 00000004:00010000:2.0:1783444288.568012:0:66245:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783444281 -> 1783444281 00000004:00010000:2.0:1783444288.568014:0:66245:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783444289 -> 1783444289 00000004:00010000:2.0:1783444288.568017:0:66245:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783444288.568047:0:66245:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8c700 x1870073557770752/t107374182411(0) o10->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:664/0 lens 440/432 e 0 to 0 dl 1783444299 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444288.568143:0:66245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2404:x1870073557770752:12345-192.168.204.20@tcp:10:dd.0 Request processed in 783us (1079us total) trans 107374182411 rc 0/0 00000100:00100000:2.0:1783444288.568163:0:66245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00002000:00010000:2.0:1783444288.568168:0:66245:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:2.0:1783444288.568171:0:66245:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9368e7c8c700 with x1870073557770752 00000100:00100000:0.0:1783444288.577687:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444288.577744:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771008 00000100:00100000:3.0:1783444288.577807:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771008 00000100:00100000:3.0:1783444288.577899:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:3.0:1783444288.577913:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+13:67900:x1870073557771008:12345-192.168.204.20@tcp:35:dd.0 00010000:00000080:3.0:1783444288.578202:0:76566:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8dc00 x1870073557771008/t107374182412(0) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:664/0 lens 392/456 e 0 to 0 dl 1783444299 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444288.578299:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+14:67900:x1870073557771008:12345-192.168.204.20@tcp:35:dd.0 Request processed in 389us (624us total) trans 107374182412 rc 0/0 00000100:00100000:3.0:1783444288.578307:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:0.0:1783444288.595615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444288.595663:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444288.595703:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444288.595835:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444288.596142:0:87068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771136 00000100:00100000:3.0:1783444288.596156:0:87068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771136 00000100:00100000:3.0:1783444288.596223:0:87068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:3.0:1783444288.596234:0:87068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557771136:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444288.596339:0:87068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557771136:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 106us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.596349:0:87068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:0.0:1783444288.596577:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771392 00000100:00100000:0.0:1783444288.596583:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771392 00000100:00100000:0.0:1783444288.596636:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771520 00000100:00100000:0.0:1783444288.596639:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771520 00000100:00100000:0.0:1783444288.596673:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2337 00000100:00100000:0.0:1783444288.596681:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557771392:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444288.596734:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557771392:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 54us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444288.596742:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2337 00000100:00100000:0.0:1783444288.596764:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2338 00000100:00100000:0.0:1783444288.596772:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557771520:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444288.596820:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557771520:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 49us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444288.596827:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2338 00000100:00100000:2.0:1783444288.597043:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771264 00000100:00100000:2.0:1783444288.597048:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771264 00000100:00100000:2.0:1783444288.597089:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 901 00000100:00100000:2.0:1783444288.597097:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557771264:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444288.597130:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557771264:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 35us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444288.597137:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 901 00000100:00080000:3.0:1783444288.598595:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444288.598608:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444288.598612:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444288.797250:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c2c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575259136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444288.797360:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444288.797498:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444288.797508:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575259264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444288.797552:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444288.797587:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575259392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444288.798099:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444288.798251:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575259264 00000100:00100000:1.0:1783444288.798260:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575259264 00000100:00100000:1.0:1783444288.798330:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575259392 00000100:00100000:1.0:1783444288.798334:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575259392 00000100:00100000:1.0:1783444288.798354:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:1.0:1783444288.798363:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575259264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444288.798404:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444288.798492:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575259264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.798500:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00100000:1.0:1783444288.798522:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:0.0:1783444288.799075:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575259264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444288.802910:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575259392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444288.802977:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444288.803382:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575259392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4847us (5278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444288.803394:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:2.0:1783444288.804405:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575259392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444288.804801:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575259136 00000100:00100000:3.0:1783444288.804811:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575259136 00000100:00100000:3.0:1783444288.805020:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:3.0:1783444288.805032:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575259136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444288.805075:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444839424 avail 1298599936 00010000:00000080:3.0:1783444288.805093:0:8430:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e380b800 x1870073575259136/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:664/0 lens 224/368 e 0 to 0 dl 1783444299 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444288.805179:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575259136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (7819us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444288.805200:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1783444288.805291:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c2c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575259136:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783444289.502513:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.526976:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783444290.604087:0:88382:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783444290.604154:0:88382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.604170:0:88382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.604176:0:88382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.604183:0:88382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.604215:0:88382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783444290.604221:0:88382:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783444290.604247:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783444290.604251:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783444290.604257:0:88382:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783444290.604283:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783444290.604409:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444290.604418:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.604427:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1aa00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444290.604431:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.604450:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444290.604457:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444290.604463:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783444290.604465:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783444290.604468:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783444290.604496:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.604504:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444290.604527:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.604534:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3831bbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831bc2 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.604546:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444290.604547:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444290.604549:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444290.604568:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575259520:0@lo:39:umount.0 00000100:00100000:0.0:1783444290.604653:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444290.604707:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575259520 00000100:00100000:0.0:1783444290.604714:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575259520 00000100:00100000:0.0:1783444290.604763:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1783444290.604773:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575259520:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783444290.604961:0:66226:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831cd3 00000100:00080000:0.0:1783444290.604979:0:66226:0:(import.c:65:import_set_state_nolock()) ffff9368dd1ee000 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1783444290.605010:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368eb7a9180 x1870073575259520/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:666/0 lens 224/224 e 0 to 0 dl 1783444301 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444290.605058:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3632:x1870073575259520:12345-0@lo:39:umount.0 Request processed in 285us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444290.605067:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000020:00000080:0.0:1783444290.605078:0:66226:0:(genops.c:906:class_export_put()) final put ffff9367c6a4f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783444290.605118:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c6a4f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783444290.605171:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd1ee000 for lustre-MDT0000 00010000:00010000:0.0:1783444290.605183:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783444290.605208:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783444290.606325:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575259648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444290.606384:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444290.606481:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575259648 00000100:00100000:2.0:1783444290.606488:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575259648 00000100:00100000:2.0:1783444290.606539:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1783444290.606548:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575259648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444290.606563:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444290.606586:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70800/0x42cb6883e3831bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831bbb expref: 24 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.606602:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444290.606639:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3634:x1870073575259648:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444290.606646:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1783444290.606683:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575259648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444290.606889:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575259520:0@lo:39:umount.0 00000100:00080000:2.0:1783444290.609169:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783444290.609180:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783444290.609189:0:88382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783444290.612768:0:88382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.612979:0:88382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.612989:0:88382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613010:0:88382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613035:0:88382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444290.613042:0:88382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613049:0:88382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613055:0:88382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613061:0:88382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613074:0:88382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444290.613080:0:88382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613086:0:88382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613092:0:88382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613099:0:88382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613125:0:88382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783444290.613130:0:88382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613137:0:88382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613143:0:88382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613149:0:88382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444290.613159:0:88382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1783444290.613162:0:88382:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1783444290.613196:0:88382:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1783444290.613201:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1783444290.613204:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1783444290.613210:0:88382:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1783444290.614412:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444290.614423:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614444:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444290.614449:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614474:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444290.614481:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444290.614488:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444290.614491:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1783444290.614493:0:10324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1783444290.614535:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614542:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444290.614575:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614583:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e3831ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831adb expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614603:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444290.614607:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614613:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444290.614617:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614624:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444290.614641:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444290.614647:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444290.614649:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783444290.614650:0:10324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783444290.614664:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614670:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444290.614676:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614682:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3831bfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831c01 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614690:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444290.614694:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614699:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444290.614702:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614708:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444290.614714:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444290.614730:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783444290.614732:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783444290.614734:0:10324:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783444290.614751:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614756:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444290.614782:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614817:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3831bad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831bb4 expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614827:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444290.614830:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614836:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444290.614839:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614846:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444290.614851:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444290.614856:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444290.614858:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783444290.614860:0:10324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783444290.614880:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614885:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444290.614891:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614898:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3831ac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3831acd expref: -99 pid: 87061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.614908:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.614910:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.614912:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.614920:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444290.614938:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575259776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444290.615007:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444290.615066:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444290.615073:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575259904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444290.615094:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444290.615127:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575260160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444290.615149:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444290.615168:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444290.615174:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575260032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444290.615196:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444290.615224:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575259776 00000100:00100000:1.0:1783444290.615233:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575259776 00000100:00100000:1.0:1783444290.615276:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575259904 00000100:00100000:1.0:1783444290.615280:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575259904 00000100:00100000:1.0:1783444290.615296:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575260160 00000100:00100000:1.0:1783444290.615386:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575260160 00000100:00100000:1.0:1783444290.615412:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575260032 00000100:00100000:1.0:1783444290.615415:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575260032 00000100:00100000:1.0:1783444290.615443:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783444290.615452:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+26:3635:x1870073575259776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444290.615465:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444290.615482:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1ba00/0x42cb6883e3831adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831ad4 expref: 26 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.615495:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444290.615534:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3635:x1870073575259776:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444290.615542:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1783444290.615561:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783444290.615567:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575259904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444290.615574:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444290.615583:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1b800/0x42cb6883e3831c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831bfa expref: 24 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.615592:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444290.615613:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3635:x1870073575259904:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444290.615619:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1783444290.615631:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1783444290.615635:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3634:x1870073575260160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444290.615642:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444290.615651:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1b600/0x42cb6883e3831acd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831ac6 expref: 22 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.615669:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444290.615698:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3634:x1870073575260160:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444290.615704:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:1.0:1783444290.615718:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1783444290.615723:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5936850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3634:x1870073575260032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444290.615732:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444290.615740:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef263600/0x42cb6883e3831bb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831bad expref: 20 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.615749:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444290.615769:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5936850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3634:x1870073575260032:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444290.615775:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1783444290.615875:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575260032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444290.615886:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575260160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444290.615914:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575259904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444290.615922:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575259776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444290.617894:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1783444290.618213:0:88382:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:1.0:1783444290.620972:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783444290.621587:0:87062:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182412 is committed 00010000:00010000:0.0:1783444290.621706:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.621733:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.621740:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.621747:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444290.621759:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.621768:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.621786:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367cd15c400) 00010000:00010000:0.0:1783444290.621809:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444290.621815:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.621821:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e383203e lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783444290.622034:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1783444290.622044:0:88382:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9367c6a4b800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444290.622051:0:88382:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368ff57c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444290.622056:0:88382:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9367c4e21800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444290.622060:0:88382:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c518b000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444290.622067:0:88382:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c518c800 778015c5-4969-44f5-82a5-0f6eadd152d5 192.168.204.20@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 107374182412 stale:0 00000020:00080000:3.0:1783444290.622072:0:88382:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9368c5078000) has exports, disconnecting them 00000020:00080000:3.0:1783444290.622077:0:88382:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9367c6a4b800), last request at 1783444257 00000020:00000080:3.0:1783444290.622084:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831ccc 00000100:00080000:3.0:1783444290.622092:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9367c6a4c000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783444290.622117:0:88382:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367c6a4b800): rc 0 00000020:00000080:3.0:1783444290.622120:0:88382:0:(genops.c:906:class_export_put()) final put ffff9367c6a4b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783444290.622132:0:88382:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368ff57c800), last request at 1783444288 00000020:00000080:3.0:1783444290.622135:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831cc5 00000100:00080000:3.0:1783444290.622139:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9368ff57e800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783444290.622156:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c6a4b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783444290.622210:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c6a4c000 for lustre-MDT0000 00000020:00080000:3.0:1783444290.622223:0:88382:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368ff57c800): rc 0 00000020:00000080:3.0:1783444290.622225:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368ff57c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783444290.622230:0:88382:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9367c4e21800), last request at 1783444288 00000020:00000080:3.0:1783444290.622234:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831cbe 00000100:00080000:3.0:1783444290.622237:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9367c4e20800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783444290.622259:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff57c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783444290.622283:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff57e800 for lustre-MDT0000 00000020:00080000:3.0:1783444290.622300:0:88382:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367c4e21800): rc 0 00010000:00010000:0.0:1783444290.622453:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444290.622903:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.622976:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783444290.623026:0:88382:0:(genops.c:906:class_export_put()) final put ffff9367c4e21800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783444290.623037:0:88382:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c518b000), last request at 1783444252 00000020:00000080:3.0:1783444290.623045:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b2f 00000100:00080000:3.0:1783444290.623058:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9368ff57d000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783444290.623084:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c4e21800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783444290.623156:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c4e20800 for lustre-MDT0000 00000020:00080000:3.0:1783444290.623170:0:88382:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c518b000): rc 0 00000020:00000080:3.0:1783444290.623172:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368c518b000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1783444290.623180:0:88382:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.20@tcp (ffff9368c518c800), last request at 1783444288 00000020:00000080:3.0:1783444290.623184:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b28 00000020:00010000:3.0:1783444290.623191:0:88382:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368c518c800: total 1 00000100:00080000:3.0:1783444290.623195:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9368ff57f000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783444290.623211:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783444290.623240:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff57d000 for lustre-MDT0000 00000020:00080000:3.0:1783444290.623251:0:88382:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368c518c800): rc 0 00000004:00000080:3.0:1783444290.623259:0:88382:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac1c41ccfae0 00000100:00080000:3.0:1783444290.623279:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783444290.623283:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:0.0:1783444290.623323:0:6494:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368c518c800: total 0 00010000:00010000:0.0:1783444290.623392:0:6494:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368c518c800, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1783444290.623421:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444290.623427:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04e00/0x42cb6883e3832022 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 4 pid: 66225 timeout: 3379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.623462:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3831f11 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ab8 expref: 3 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.623479:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3832037 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b05 expref: 2 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444290.623494:0:6494:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368c518c800, canceled 3 locks, left on hash table 0. 00000100:00080000:3.0:1783444290.626168:0:88382:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783444290.626206:0:88382:0:(import.c:65:import_set_state_nolock()) ffff936901dbd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783444290.626313:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c2c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575260288:0@lo:39:umount.0 00000100:00100000:1.0:1783444290.626389:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444290.626509:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575260288 00000100:00100000:3.0:1783444290.626516:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575260288 00000100:00100000:3.0:1783444290.626564:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:3.0:1783444290.626573:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575260288:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783444290.626601:0:23687:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b6e 00000100:00080000:3.0:1783444290.626609:0:23687:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444290.626631:0:23687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411432 00000100:00100000:3.0:1783444290.626774:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3632:x1870073575260288:12345-0@lo:39:umount.0 Request processed in 201us (384us total) trans 77309411433 rc 0/0 00000100:00080000:1.0:1783444290.626842:0:3632:0:(import.c:65:import_set_state_nolock()) ffff936901dbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783444290.626850:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c2c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575260288:0@lo:39:umount.0 00000100:00080000:1.0:1783444290.626934:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783444290.626937:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:1.0:1783444290.626949:0:88382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783444290.627045:0:88382:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783444290.627056:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9368ef129800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783444290.627067:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783444290.627069:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969452 gen 3 00000004:00080000:1.0:1783444290.627078:0:88382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783444290.627150:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575260416:0@lo:9:umount.0 00000100:00100000:1.0:1783444290.627182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444290.627213:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575260416 00000100:00100000:1.0:1783444290.627217:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575260416 00000100:00100000:1.0:1783444290.627259:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5866 00000100:00100000:1.0:1783444290.627265:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575260416:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783444290.627280:0:26204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b8a 00000100:00080000:1.0:1783444290.627285:0:26204:0:(import.c:65:import_set_state_nolock()) ffff9367c17b6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783444290.627321:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:1.0:1783444290.627417:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575260416:12345-0@lo:9:umount.0 Request processed in 151us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444290.627424:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5866 00010000:00010000:1.0:1783444290.627456:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783444290.627472:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef129800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783444290.627476:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783444290.627477:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783444290.627480:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575260416:0@lo:9:umount.0 00000100:00080000:1.0:1783444290.627497:0:88382:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783444290.627514:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9368c511b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783444290.627528:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575260544:0@lo:9:umount.0 00000100:00100000:1.0:1783444290.627551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783444290.627610:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368c5078000) has no exports 00000100:00100000:1.0:1783444290.628442:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575260544 00000100:00100000:1.0:1783444290.628452:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575260544 00000100:00100000:1.0:1783444290.628499:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5867 00000100:00100000:1.0:1783444290.628508:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575260544:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783444290.628532:0:26211:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b98 00000100:00080000:1.0:1783444290.628539:0:26211:0:(import.c:65:import_set_state_nolock()) ffff9368c9a10000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783444290.628576:0:26211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:1.0:1783444290.628699:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575260544:12345-0@lo:9:umount.0 Request processed in 192us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444290.628707:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5867 00010000:00010000:1.0:1783444290.628731:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783444290.628756:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368c511b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783444290.628764:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783444290.628766:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783444290.628769:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575260544:0@lo:9:umount.0 00010000:00010000:2.0:1783444290.634227:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444290.634977:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444290.634986:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444290.638431:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000020:00080000:1.0:1783444290.638712:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368c5078000) has no exports 00000020:00000080:0.0:1783444290.685966:0:6494:0:(genops.c:906:class_export_put()) final put ffff9368c518c800/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444290.686009:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518c800/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-MDT0000 00000020:00000080:0.0:1783444290.686084:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff57f000 for lustre-MDT0000 00010000:00010000:0.0:1783444290.686121:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444290.686123:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444290.686126:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783444290.709540:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b44 00000020:00000080:1.0:1783444290.709558:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368c3fa5800/lustre-QMT0000_UUID 00000020:01000000:1.0:1783444290.709576:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783444290.709658:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c3fa5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783444290.709728:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444290.709741:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783444290.709746:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9368e7124d40) has no exports 00000020:00000080:2.0:1783444290.710630:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b3d 00000020:00000080:2.0:1783444290.710638:0:88382:0:(genops.c:906:class_export_put()) final put ffff9367c5030800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444290.710673:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5030800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783444290.710730:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444290.710740:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783444290.710744:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368ef334000/lustre-QMT0000_UUID 00000020:00000080:2.0:1783444290.710746:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef334000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783444290.710750:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1783444290.711401:0:88382:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9368dccad2a0 - data ffff9367c18cabd0/ffff9367c4186000 00000020:01000000:2.0:1783444290.711577:0:88382:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c32ef1e0 - data ffff9368ff8086c0/ffff9367c6d5fc00 00000100:00080000:2.0:1783444290.763516:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783444290.763527:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783444290.763544:0:88382:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9367c2c88e00 x1870073575260288/t77309411433(77309411433) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444300 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444290.763574:0:88382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783444290.765467:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783444290.765474:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:2.0:1783444290.765536:0:88382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444290.765538:0:88382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783444290.766197:0:87082:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783444290.766202:0:87082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:1.0:1783444290.766214:0:87082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:2.0:1783444290.771700:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783444290.771708:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969452 gen 4 00000004:00080000:2.0:1783444290.771728:0:88382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444290.771730:0:88382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783444290.775025:0:87084:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783444290.775035:0:87084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:1.0:1783444290.775068:0:87084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:2.0:1783444290.776362:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831ae9 00000020:00000080:2.0:1783444290.776377:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368cabcb800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444290.776484:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cabcb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783444290.777066:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831afe 00000020:00000080:2.0:1783444290.777073:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368f8ca2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783444290.777079:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783444290.777086:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1783444290.777095:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444290.777105:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783444290.777121:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9368c50799c0) has no exports 00000004:01000000:2.0:1783444290.777278:0:88382:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783444290.777286:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b91 00000020:00000080:2.0:1783444290.777292:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368dd1e8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783444290.777299:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783444290.777306:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1e8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783444290.777314:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444290.777322:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783444290.777325:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9368dd0eb380) has no exports 00000020:00000080:2.0:1783444290.777331:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b83 00000020:00000080:2.0:1783444290.777334:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368c511f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444290.777344:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c511f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783444290.777691:0:88382:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783444290.777697:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783444290.777701:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969452 gen 5 00000004:00080000:2.0:1783444290.777706:0:88382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444290.777709:0:88382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783444290.777729:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c511b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783444290.777762:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444290.777770:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444290.777773:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368dd209800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444290.777775:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd209800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783444290.777780:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444290.777871:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b75 00000020:00000080:2.0:1783444290.777875:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368f8ca4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783444290.777881:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783444290.777888:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783444290.777897:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444290.777902:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783444290.777904:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9367c1e83380) has no exports 00000020:00000080:2.0:1783444290.777916:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b67 00000020:00000080:2.0:1783444290.777919:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368ef12f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444290.777929:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef12f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783444290.778234:0:88382:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783444290.778238:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783444290.778240:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:2.0:1783444290.778243:0:88382:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444290.778245:0:88382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783444290.778259:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef129800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783444290.778285:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444290.778291:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444290.778294:0:88382:0:(genops.c:906:class_export_put()) final put ffff93690069f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444290.778296:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff93690069f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783444290.778300:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1783444290.778342:0:88382:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783444290.778348:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b59 00000020:00000080:2.0:1783444290.778352:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368c511d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783444290.778359:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1783444290.778365:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c511d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783444290.778374:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444290.778379:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783444290.778381:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9368e7123380) has no exports 00000020:00000080:2.0:1783444290.778385:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b52 00000020:00000080:2.0:1783444290.778388:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368cabcd000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444290.778397:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cabcd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783444290.783885:0:88382:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783444290.783897:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783444290.783903:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783444290.783914:0:88382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444290.783950:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff936901dbd800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783444290.784001:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444290.784017:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444290.784023:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368c511b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444290.784027:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c511b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783444290.784041:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444290.784307:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444290.784313:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444290.784316:0:88382:0:(genops.c:906:class_export_put()) final put ffff9367c4489800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444290.784319:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c4489800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783444290.784323:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444290.784386:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b05 00000020:00000080:0.0:1783444290.784393:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368f8ca6800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783444290.784402:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783444290.784411:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783444290.784421:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444290.784427:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783444290.784443:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9367c1e80000) has no exports 00000020:00000080:0.0:1783444290.784468:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444290.784472:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444290.784475:0:88382:0:(genops.c:906:class_export_put()) final put ffff93690069a800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783444290.784477:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff93690069a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783444290.784481:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444290.784524:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831b0c 00000020:00000080:0.0:1783444290.784529:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368f8ca3800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444290.784541:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783444290.784550:0:88382:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9367c3a05800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783444290.784554:0:88382:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9367c3a05800 3 00000020:01000004:0.0:1783444290.784557:0:88382:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9367c3a05800 from lustre-MDT0000 00000020:00000080:0.0:1783444290.784580:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444290.784585:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783444290.784588:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368cabc8800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783444290.784590:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cabc8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783444290.784597:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783444290.784627:0:88382:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783444290.784630:0:88382:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783444290.784634:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783444290.784637:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444290.784640:0:88382:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783444290.784646:0:88382:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9368c518e000 c89ab73b-dbb2-4305-b221-37cc64d61227 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444290.784654:0:88382:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9368ff68f800 fea1b1de-aca2-4501-86bf-fe28138c0593 192.168.204.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444290.784658:0:88382:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff9368dd0e99c0) has exports, disconnecting them 00000020:00080000:0.0:1783444290.784663:0:88382:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9368c518e000), last request at 1783444251 00000020:00000080:0.0:1783444290.784680:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831ab8 00000020:00010000:0.0:1783444290.784684:0:88382:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368c518e000: total 0 00000100:00080000:0.0:1783444290.784688:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9368c518e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444290.784708:0:88382:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c518e000): rc 0 00000020:00080000:0.0:1783444290.784712:0:88382:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.20@tcp (ffff9368ff68f800), last request at 1783444251 00000020:00000080:0.0:1783444290.784751:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831ab1 00000020:00010000:0.0:1783444290.784754:0:88382:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368ff68f800: total 0 00000100:00080000:0.0:1783444290.784756:0:88382:0:(import.c:65:import_set_state_nolock()) ffff9368ff68a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444290.784765:0:88382:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368ff68f800): rc 0 00000020:00080000:0.0:1783444290.784769:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9368dd0e99c0) has no exports 00000100:00100000:0.0:1783444290.784860:0:87069:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9369005b4200:87069] 2 exiting: rc = 0 00000020:00010000:1.0:1783444290.785011:0:10324:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368c518e000: total 0 00010000:00010000:1.0:1783444290.785016:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.785053:0:10324:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368c518e000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783444290.785085:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70c00/0x42cb6883e3831c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c5c expref: 14 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785099:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3831c71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c6a expref: 13 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785109:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0030600/0x42cb6883e3831c0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c08 expref: 12 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785154:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031600/0x42cb6883e3831c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c86 expref: 11 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785173:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1ac00/0x42cb6883e3831c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c16 expref: 10 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785184:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0030a00/0x42cb6883e3831c7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c78 expref: 9 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785195:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0030000/0x42cb6883e3831c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c32 expref: 8 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785209:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71e00/0x42cb6883e3831c9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c94 expref: 7 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785219:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031c00/0x42cb6883e3831c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c24 expref: 6 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785229:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70600/0x42cb6883e3831ca9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831ca2 expref: 5 pid: 87069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785254:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5757600/0x42cb6883e3831cb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831cb0 expref: 4 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785264:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71c00/0x42cb6883e3831c47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c40 expref: 3 pid: 87074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785273:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031400/0x42cb6883e3831c55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3831c4e expref: 2 pid: 87075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785281:0:10324:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368c518e000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783444290.785300:0:10324:0:(genops.c:906:class_export_put()) final put ffff9368c518e000/c89ab73b-dbb2-4305-b221-37cc64d61227 00000020:00010000:1.0:1783444290.785314:0:10324:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368ff68f800: total 1 00010000:00010000:1.0:1783444290.785329:0:10324:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368ff68f800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783444290.785345:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70a00/0x42cb6883e3831be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a9c expref: 5 pid: 87068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785358:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef263400/0x42cb6883e3831bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939aaa expref: 4 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785371:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3831bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939a95 expref: 3 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785384:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031000/0x42cb6883e3831bec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939aa3 expref: 2 pid: 87066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444290.785396:0:10324:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368ff68f800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1783444290.785405:0:10324:0:(genops.c:906:class_export_put()) final put ffff9368ff68f800/fea1b1de-aca2-4501-86bf-fe28138c0593 00010000:00010000:1.0:1783444290.785409:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.785411:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.785418:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444290.785426:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444290.785464:0:87074:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9368dcc6e000:87074] 3 exiting: rc = 0 00000020:00000080:1.0:1783444290.785511:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518e000/c89ab73b-dbb2-4305-b221-37cc64d61227 for MGS 00000020:00000080:1.0:1783444290.785539:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68f800/fea1b1de-aca2-4501-86bf-fe28138c0593 for MGS 00000020:00000080:1.0:1783444290.785549:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c518e800 for MGS 00000020:00000080:1.0:1783444290.785553:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff68a800 for MGS 00000100:00100000:0.0:1783444290.787957:0:87075:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff9368e7900400:87075] 4 exiting: rc = 0 00000100:00100000:0.0:1783444290.788069:0:87068:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9368e70f4800:87068] 1 exiting: rc = 0 00000100:00100000:0.0:1783444290.788126:0:87066:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9367c1e32200:87066] 0 exiting: rc = 1 00000100:00100000:1.0:1783444290.788228:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788237:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788243:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788250:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788256:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788262:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788269:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788275:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788281:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788286:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788292:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788298:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788304:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788309:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788316:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788323:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788329:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788335:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788340:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788345:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788350:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788356:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788361:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788367:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788372:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788377:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788382:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788402:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788407:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788412:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788418:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788424:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788438:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788446:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788452:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788458:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788464:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788470:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788476:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788481:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788487:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788492:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788497:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788503:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788508:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788513:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788519:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788525:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788530:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788536:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788541:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788546:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788551:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788556:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788562:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788568:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788573:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788579:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788586:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788592:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788599:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788606:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788620:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444290.788625:0:88382:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1783444290.789696:0:88382:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c4c3dc00 - data ffff9368f62105e8/ffff9368c706c800 00000020:01000000:1.0:1783444290.789854:0:88382:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9368dc8d8300 - data ffff9368ff8e65e8/ffff9368f5356400 00000020:00000080:1.0:1783444290.790278:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831aaa 00000020:00000080:1.0:1783444290.790287:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368ff68d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444290.790303:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1783444290.790314:0:88382:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9367c3a05800 from MGS, refs=2 00000020:01000004:1.0:1783444290.790318:0:88382:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9367c3a05800 2 00000020:01000004:1.0:1783444290.790321:0:88382:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9367c3a05800 from MGS 00000020:00000080:1.0:1783444290.790347:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444290.790355:0:88382:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783444290.790358:0:88382:0:(genops.c:906:class_export_put()) final put ffff9367c229b800/MGS 00000020:00000080:1.0:1783444290.790360:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c229b800/MGS for MGS 00000020:01000000:1.0:1783444290.790366:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783444290.790453:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783444290.790458:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444290.790467:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783444290.790474:0:88382:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9368eb6fc000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783444290.790480:0:88382:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9368dd0e8000) has exports, disconnecting them 00000020:00080000:1.0:1783444290.790486:0:88382:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9368eb6fc000), last request at 1783444252 00000020:00000080:1.0:1783444290.790490:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831bd0 00000020:00080000:1.0:1783444290.790501:0:88382:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368eb6fc000): rc 0 00000020:00000080:1.0:1783444290.790507:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368eb6fc000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783444290.790527:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb6fc000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783444290.791305:0:88382:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783444290.791313:0:88382:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444290.791317:0:88382:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783444290.791322:0:88382:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444290.791341:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c6a4f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783444290.791462:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444290.791470:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783444290.791474:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368eb6fb800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783444290.791476:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb6fb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783444290.791482:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783444290.791551:0:88382:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9367c3a05800 1 00000020:00000080:0.0:1783444290.791556:0:88382:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831a9c 00000020:00000080:0.0:1783444290.791561:0:88382:0:(genops.c:906:class_export_put()) final put ffff936901f90000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783444290.791568:0:88382:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783444290.791576:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff936901f90000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444290.791584:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444290.791588:0:88382:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783444290.791591:0:88382:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9368c507cd40) has no exports 00000020:00000080:0.0:1783444290.886406:0:88382:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444290.886420:0:88382:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783444290.886767:0:88382:0:(genops.c:906:class_export_put()) final put ffff9368f98b7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444290.886774:0:88382:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f98b7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783444290.886880:0:88382:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783444290.887035:0:88382:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9368f98b3000 00000020:02000400:0.0:1783444290.887102:0:88382:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1783444291.361021:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575260672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444291.361100:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444291.361150:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575260672 00000100:00100000:0.0:1783444291.361156:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575260672 00000100:00100000:0.0:1783444291.361197:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:0.0:1783444291.361204:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575260672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444291.361231:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444291.361282:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575260672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444291.361288:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:0.0:1783444291.361391:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575260672:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783444291.361538:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444291.361548:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444291.361555:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575260800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444291.361582:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444291.361608:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575260800 00000100:00100000:2.0:1783444291.361617:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575260800 00000100:00100000:2.0:1783444291.361643:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:2.0:1783444291.361649:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575260800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444291.361664:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444291.361694:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575260800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444291.361699:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00080000:2.0:1783444291.361712:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444291.361730:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575260800:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783444291.549220:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444292.574313:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444293.406173:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575261056:0@lo:400:kworker.0 00000100:00100000:1.0:1783444293.406246:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444293.406281:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575261568:0@lo:400:kworker.0 00000100:00100000:1.0:1783444293.406308:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444293.406353:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783444293.406360:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575260928:0@lo:400:kworker.0 00000400:00000100:1.0:1783444293.406394:0:3634:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575260928 offset 0 length 224: 4 00000100:00100000:1.0:1783444293.406417:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575261440:0@lo:400:kworker.0 00000100:00100000:1.0:1783444293.406442:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444293.406454:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575261184:0@lo:400:kworker.0 00000100:00100000:1.0:1783444293.406460:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575261952:0@lo:400:kworker.0 00000100:00100000:1.0:1783444293.406500:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444293.406528:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575261056 00000100:00100000:2.0:1783444293.406537:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575261056 00000100:00100000:2.0:1783444293.406604:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575261440 00000100:00100000:2.0:1783444293.406608:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575261440 00000100:00100000:0.0:1783444293.406631:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575261312:0@lo:400:kworker.0 00000100:00100000:2.0:1783444293.406649:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575261952 00000100:00100000:2.0:1783444293.406654:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575261952 00000100:00100000:0.0:1783444293.406668:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444293.406677:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1783444293.406685:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575261824:0@lo:400:kworker.0 00000100:00100000:2.0:1783444293.406692:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575261440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444293.406714:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444293.406752:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575261568 00000100:00100000:0.0:1783444293.406757:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575261568 00000100:00100000:0.0:1783444293.406786:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1783444293.406835:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3634:x1870073575261568:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444293.406843:0:8431:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783444293.406878:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3634:x1870073575261568:12345-0@lo:400:kworker.0 Request processed in 53us (568us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444293.406884:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1783444293.406906:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575261312 00000100:00100000:0.0:1783444293.406910:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575261312 00000100:00100000:0.0:1783444293.406925:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1783444293.406929:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3634:x1870073575261056:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444293.406944:0:80475:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783444293.406971:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3634:x1870073575261056:12345-0@lo:400:kworker.0 Request processed in 40us (725us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444293.406976:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1783444293.406989:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1783444293.406993:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3634:x1870073575261952:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444293.406997:0:80475:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783444293.407016:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3634:x1870073575261952:12345-0@lo:400:kworker.0 Request processed in 22us (517us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444293.407021:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1783444293.407031:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1783444293.407035:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3636:x1870073575261312:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444293.407040:0:80475:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783444293.407067:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3636:x1870073575261312:12345-0@lo:400:kworker.0 Request processed in 29us (399us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444293.407072:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1783444293.407093:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575261824 00000100:00100000:0.0:1783444293.407096:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575261824 00000100:00100000:0.0:1783444293.407128:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:0.0:1783444293.407137:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575261824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444293.407171:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575261440:12345-0@lo:400:kworker.0 Request processed in 483us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444293.407184:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1783444293.407186:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575261824:12345-0@lo:400:kworker.0 Request processed in 46us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444293.407195:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00080000:2.0:1783444293.407209:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444293.407216:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444293.407239:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1783444293.407240:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444293.407247:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783444293.407253:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783444293.407267:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783444293.407269:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575261696:0@lo:400:kworker.0 00000100:00080000:0.0:1783444293.407274:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3248 00000100:00080000:0.0:1783444293.407282:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444293.407305:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444293.407311:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e786b100 x1870073575262080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444293.407332:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575261312:0@lo:400:kworker.0 00000100:00100000:0.0:1783444293.407352:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575261824:0@lo:400:kworker.0 00000100:00100000:0.0:1783444293.407392:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575261184 00000100:00100000:0.0:1783444293.407396:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575261184 00000100:00100000:0.0:1783444293.407423:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1783444293.407428:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575261184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444293.407460:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575261184:12345-0@lo:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444293.407467:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1783444293.407649:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e786b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575262080:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783444293.407681:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444293.407734:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575261440:0@lo:400:kworker.0 00000100:00080000:1.0:1783444293.407746:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444293.407749:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783444293.407752:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783444293.407755:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444293.407758:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3248 00000100:00080000:1.0:1783444293.407763:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444293.407777:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c308dc00 x1870073575262208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444293.407811:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575261952:0@lo:400:kworker.0 00000100:00100000:2.0:1783444293.407868:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575261184:0@lo:400:kworker.0 00000100:00100000:2.0:1783444293.407891:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575261696 00000100:00100000:2.0:1783444293.407895:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575261696 00000100:00100000:2.0:1783444293.407925:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:2.0:1783444293.407932:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575261696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444293.407969:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575261696:12345-0@lo:400:kworker.0 Request processed in 38us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444293.407977:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000100:00080000:2.0:1783444293.408399:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444293.408403:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444293.408425:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575261696:0@lo:400:kworker.0 00000100:00100000:2.0:1783444293.408458:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575262208:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783444293.408488:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444293.408516:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575262080 00000100:00100000:2.0:1783444293.408521:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575262080 00000100:00100000:2.0:1783444293.408538:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575262208 00000100:00100000:3.0:1783444293.408713:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1783444293.408720:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575262080:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1783444293.408741:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444293.408781:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575262080:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 60us (1099us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444293.408802:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:1.0:1783444293.408925:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444293.408929:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:3.0:1783444293.408930:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:02000400:1.0:1783444293.408934:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783444293.408939:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:1.0:1783444293.408941:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783444293.408944:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e786b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575262080:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1783444293.408957:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3248 00000100:00080000:1.0:1783444293.408963:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444293.408981:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c308fb80 x1870073575262336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444293.409006:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575261056:0@lo:400:kworker.0 00000100:00080000:1.0:1783444293.409021:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444293.409024:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783444293.409027:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783444293.409031:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444293.409034:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3248 00000100:00080000:1.0:1783444293.409038:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444293.409049:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c308f100 x1870073575262464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444293.409057:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575261568:0@lo:400:kworker.0 00000100:00100000:3.0:1783444293.409104:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575262336:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783444293.409132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444293.409156:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575262464:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783444293.409179:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444293.409211:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575262464 00000100:00100000:3.0:1783444293.409215:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575262464 00000100:00100000:3.0:1783444293.409235:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:3.0:1783444293.409239:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575262464:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783444293.409249:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444293.409276:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575262464:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 36us (97us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444293.409284:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00080000:3.0:1783444293.409312:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444293.409322:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444293.409325:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575262464:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783444293.409978:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575262336 00000100:00100000:1.0:1783444293.409986:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575262336 00000100:00100000:1.0:1783444293.410025:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1783444293.410031:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575262336:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1783444293.410046:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444293.410093:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575262336:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 60us (958us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444293.410094:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575262208 00000100:00100000:1.0:1783444293.410102:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1783444293.410124:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1783444293.410129:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575262208:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1783444293.410150:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444293.410179:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575262208:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 49us (1691us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444293.410185:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00080000:3.0:1783444293.411604:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444293.411614:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444293.411620:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575262336:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1783444293.411634:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444293.411637:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444293.411640:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575262208:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1783444293.598894:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444293.709735:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444293.709853:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444293.709956:0:66247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771648 00000100:00100000:3.0:1783444293.709967:0:66247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771648 00000100:00100000:3.0:1783444293.710027:0:66247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1783444293.710038:0:66247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2404:x1870073557771648:12345-192.168.204.20@tcp:4:dd.0 00000020:00080000:3.0:1783444293.710047:0:66247:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.204.20@tcp 00000100:00100000:3.0:1783444293.710110:0:66247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2404:x1870073557771648:12345-192.168.204.20@tcp:4:dd.0 Request processed in 73us (320us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444293.710118:0:66247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1783444293.711005:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771776 00000100:00100000:2.0:1783444293.711014:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771776 00000100:00100000:2.0:1783444293.711060:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1168 00000100:00100000:2.0:1783444293.711066:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1870073557771776:12345-192.168.204.20@tcp:16:kworker.0 00000020:00080000:2.0:1783444293.711074:0:67017:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.204.20@tcp 00000100:00100000:2.0:1783444293.711117:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1870073557771776:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 49us (1400us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783444293.711125:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1168 00000400:00000100:0.0:1783444293.713982:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557771904 offset 0 length 224: 4 00000100:00100000:3.0:1783444293.723885:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444293.723930:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444293.723967:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444293.724004:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444293.724048:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557772032 00000100:00100000:3.0:1783444293.724062:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557772032 00000100:00100000:3.0:1783444293.724128:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557772416 00000100:00100000:3.0:1783444293.724131:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557772416 00000100:00100000:3.0:1783444293.724150:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 904 00000100:00100000:3.0:1783444293.724159:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557772032:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444293.724255:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557772032:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444293.724263:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 904 00000100:00100000:3.0:1783444293.724282:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1169 00000100:00100000:3.0:1783444293.724286:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557772416:12345-192.168.204.20@tcp:38:ptlrpcd_01_01.0 00010000:00020000:3.0:1783444293.724313:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444293.724344:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557772416:12345-192.168.204.20@tcp:38:ptlrpcd_01_01.0 Request processed in 56us (340us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444293.724350:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1169 00000100:00100000:1.0:1783444293.724892:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557772160 00000100:00100000:1.0:1783444293.724899:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557772160 00000100:00100000:1.0:1783444293.724951:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557772288 00000100:00100000:1.0:1783444293.724955:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557772288 00000100:00100000:1.0:1783444293.724978:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2341 00000100:00100000:1.0:1783444293.724986:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557772160:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444293.725021:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2403:x1870073557772160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444293.725029:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2341 00000100:00100000:1.0:1783444293.725043:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2342 00000100:00100000:1.0:1783444293.725049:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557772288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444293.725069:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557772288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444293.725075:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2342 00000100:00080000:2.0:1783444293.725265:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444293.725269:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444293.725271:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783444294.621214:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444295.644954:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783444295.969460:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444295.969473:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368c9a14000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444295.969501:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a14000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783444295.969545:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c9a10000 for lustre-OST0001 00000001:00100000:3.0:1783444295.970939:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783444295.970954:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411433 is committed 00000020:00000080:3.0:1783444295.970958:0:75651:0:(genops.c:906:class_export_put()) final put ffff9368ef0c8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444295.970976:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0c8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783444295.971027:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ea5f4800 for lustre-MDT0001 00000001:00100000:0.0:1783444295.977751:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444295.977763:0:8415:0:(genops.c:906:class_export_put()) final put ffff9367c17b7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444295.978147:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17b7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783444295.978196:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c17b6000 for lustre-OST0000 00000100:00100000:2.0:1783444296.477144:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444296.477169:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e786b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575262592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444296.477244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444296.477335:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575262592 00000100:00100000:3.0:1783444296.477343:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575262592 00000100:00080000:2.0:1783444296.477463:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444296.478311:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:3.0:1783444296.478335:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575262592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444296.478368:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444296.478439:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575262592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444296.478446:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00100000:2.0:1783444296.479527:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e786b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575262592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444296.483248:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444296.483278:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575262720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444296.483365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444296.494166:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575262720 00000100:00100000:2.0:1783444296.494182:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575262720 00000100:00100000:2.0:1783444296.494282:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:2.0:1783444296.494296:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575262720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444296.494347:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783444296.494479:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444296.494509:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575262720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 218us (11143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444296.494517:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:1.0:1783444296.494573:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575262720:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783444296.669129:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444297.696633:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444298.525096:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1783444298.525119:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444298.525124:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444298.525128:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444298.525136:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3284 00000100:00080000:1.0:1783444298.525142:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444298.525149:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444298.525172:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c308fb80 x1870073575262976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444298.525227:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444298.525231:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444298.525232:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444298.525235:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3284 00000100:00080000:1.0:1783444298.525237:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444298.525240:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444298.525253:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3808e00 x1870073575263232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444298.525279:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444298.525292:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444298.525294:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444298.525297:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3284 00000100:00080000:1.0:1783444298.525299:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444298.525303:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444298.525314:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd170380 x1870073575263488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444298.525402:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575262976:0@lo:38:kworker.0 00000100:00100000:3.0:1783444298.525469:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444298.525506:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575263232:0@lo:38:kworker.0 00000100:00100000:3.0:1783444298.525536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444298.525554:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575263488:0@lo:38:kworker.0 00000100:00100000:3.0:1783444298.525579:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444298.525624:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575262976 00000100:00100000:3.0:1783444298.525631:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575262976 00000100:00100000:3.0:1783444298.525665:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575263232 00000100:00100000:3.0:1783444298.525668:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575263232 00000100:00100000:3.0:1783444298.525685:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1783444298.525692:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575262976:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444298.525713:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444298.525756:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575262976:12345-0@lo:38:kworker.0 Request processed in 62us (286us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444298.525763:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1783444298.525781:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1783444298.525786:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575263232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444298.525821:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444298.525856:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575263232:12345-0@lo:38:kworker.0 Request processed in 68us (318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444298.525862:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:3.0:1783444298.525896:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444298.525900:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444298.525903:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575262976:0@lo:38:kworker.0 00000100:00080000:3.0:1783444298.525912:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444298.525915:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444298.525917:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575263232:0@lo:38:kworker.0 00000100:00100000:3.0:1783444298.525963:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444298.525973:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575263616:0@lo:400:kworker.0 00000100:00100000:3.0:1783444298.526001:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444298.526028:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575263616 00000100:00100000:3.0:1783444298.526032:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575263616 00000100:00100000:3.0:1783444298.526072:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:3.0:1783444298.526079:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575263616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444298.526119:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575263616:12345-0@lo:400:kworker.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444298.526125:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:3.0:1783444298.526152:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575263616:0@lo:400:kworker.0 00000100:00100000:3.0:1783444298.526176:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575263360:0@lo:400:kworker.0 00000100:00100000:3.0:1783444298.526197:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444298.526212:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444298.526217:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575263104:0@lo:400:kworker.0 00000100:00100000:3.0:1783444298.526234:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444298.526649:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575263488 00000100:00100000:0.0:1783444298.526655:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575263488 00000100:00100000:0.0:1783444298.526692:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1783444298.526698:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575263488:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444298.526711:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444298.526752:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575263488:12345-0@lo:38:kworker.0 Request processed in 53us (1171us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444298.526758:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1783444298.526777:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575263360 00000100:00100000:0.0:1783444298.526780:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575263360 00000100:00100000:0.0:1783444298.526831:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575263104 00000100:00100000:0.0:1783444298.526835:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575263104 00000100:00100000:0.0:1783444298.526855:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1783444298.526862:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575263360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444298.526899:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575263360:12345-0@lo:400:kworker.0 Request processed in 38us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444298.526906:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1783444298.526917:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1783444298.526923:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575263104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444298.526951:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575263104:12345-0@lo:400:kworker.0 Request processed in 28us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444298.526957:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00080000:0.0:1783444298.526972:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444298.526976:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444298.527005:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444298.527009:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444298.527023:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575263488:0@lo:38:kworker.0 00000100:00100000:3.0:1783444298.527259:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575263104:0@lo:400:kworker.0 00000100:00100000:3.0:1783444298.527273:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575263360:0@lo:400:kworker.0 00000100:00100000:2.0:1783444298.527548:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575262848:0@lo:400:kworker.0 00000400:00000100:2.0:1783444298.527579:0:3635:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575262848 offset 0 length 224: 4 00000100:00100000:3.0:1783444298.527813:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575263744:0@lo:400:kworker.0 00000100:00100000:3.0:1783444298.527842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783444298.527908:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444298.527913:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444298.527916:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444298.527920:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3284 00000100:00080000:1.0:1783444298.527924:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444298.527929:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444298.527948:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd173b80 x1870073575263872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444298.527978:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575263872:0@lo:38:kworker.0 00000100:00100000:1.0:1783444298.528006:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444298.528045:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575263872 00000100:00100000:1.0:1783444298.528049:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575263872 00000100:00100000:2.0:1783444298.528162:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575263744 00000100:00100000:2.0:1783444298.528166:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575263744 00000100:00100000:2.0:1783444298.528207:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:2.0:1783444298.528214:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575263744:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783444298.528323:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444298.528502:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1783444298.528508:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575263872:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444298.528525:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444298.528567:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575263872:12345-0@lo:38:kworker.0 Request processed in 58us (560us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444298.528573:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:0.0:1783444298.528714:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444298.528719:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444298.528722:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575263872:0@lo:38:kworker.0 00000100:00100000:2.0:1783444298.528815:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575263744:12345-0@lo:400:kworker.0 Request processed in 601us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444298.528823:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:3.0:1783444298.528889:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575263744:0@lo:400:kworker.0 00010000:00010000:1.0:1783444298.717671:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444298.829053:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444298.829216:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:0.0:1783444298.829247:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557772544 offset 0 length 224: 4 00000100:00100000:0.0:1783444298.829272:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444298.829357:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557773056 00000100:00100000:3.0:1783444298.829369:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557773056 00000100:00100000:3.0:1783444298.829433:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557772928 00000100:00100000:3.0:1783444298.829453:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557772928 00000100:00100000:3.0:1783444298.829480:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2345 00000100:00100000:3.0:1783444298.829489:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557773056:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444298.829563:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557773056:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444298.829570:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2345 00000100:00100000:3.0:1783444298.829586:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2346 00000100:00100000:3.0:1783444298.829592:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557772928:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444298.829617:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2404:x1870073557772928:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444298.829623:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2346 00000100:00080000:0.0:1783444298.829911:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444298.829916:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444298.830522:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557772800 00000100:00100000:2.0:1783444298.830531:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557772800 00000100:00100000:2.0:1783444298.830652:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 907 00000100:00100000:2.0:1783444298.830672:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557772800:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444298.831160:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557772800:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 488us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444298.831168:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 907 00000100:00080000:0.0:1783444298.831256:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444298.841440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444298.841818:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557772672 00000100:00100000:3.0:1783444298.841830:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557772672 00000100:00100000:3.0:1783444298.842187:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1173 00000100:00100000:3.0:1783444298.842196:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557772672:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:3.0:1783444298.842235:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444298.842332:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557772672:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 135us (903us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444298.842340:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1173 00010000:00010000:2.0:1783444299.741385:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444300.768514:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444301.597047:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575264000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444301.597128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444301.598149:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575264000 00000100:00100000:3.0:1783444301.598162:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575264000 00000100:00100000:3.0:1783444301.598413:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:3.0:1783444301.598424:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575264000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444301.598662:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783444301.600360:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444301.600528:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575264128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444301.600596:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444301.600775:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575264128 00000100:00100000:2.0:1783444301.600783:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575264128 00000100:00100000:2.0:1783444301.600991:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1783444301.601002:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575264128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444301.601043:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444301.601092:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575264128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444301.601424:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00080000:2.0:1783444301.601454:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444301.601496:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575264128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444301.604785:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575264000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6352us (7646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444301.604834:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:0.0:1783444301.611046:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575264000:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783444301.789029:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444302.813613:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783444303.645817:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444303.645825:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444303.645828:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444303.645849:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3289 00000100:00080000:1.0:1783444303.645855:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783444303.645863:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444303.645886:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd172680 x1870073575264384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444303.645913:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444303.645916:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444303.645918:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444303.645921:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3289 00000100:00080000:1.0:1783444303.645923:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783444303.645926:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444303.645935:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd170a80 x1870073575264640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444303.645957:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444303.645960:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444303.645961:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444303.645964:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3289 00000100:00080000:1.0:1783444303.645966:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783444303.645969:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444303.645978:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd171880 x1870073575264896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444303.645995:0:54930:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444303.645998:0:54930:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444303.645999:0:54930:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444303.646007:0:54930:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3289 00000100:00080000:1.0:1783444303.646009:0:54930:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783444303.646013:0:54930:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444303.646025:0:54930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3444700 x1870073575265280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444303.646059:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575265024:0@lo:400:kworker.0 00000100:00100000:1.0:1783444303.646127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444303.646172:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444303.646178:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575264768:0@lo:400:kworker.0 00000100:00100000:1.0:1783444303.646217:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444303.646250:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575265024 00000100:00100000:1.0:1783444303.646258:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575265024 00000100:00100000:2.0:1783444303.646289:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575264384:0@lo:38:kworker.0 00000100:00100000:1.0:1783444303.646314:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347 00000100:00100000:2.0:1783444303.646317:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444303.646322:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575265024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444303.646334:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575264640:0@lo:38:kworker.0 00000100:00100000:2.0:1783444303.646352:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444303.646365:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575264896:0@lo:38:kworker.0 00000100:00100000:1.0:1783444303.646365:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575265024:12345-0@lo:400:kworker.0 Request processed in 44us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444303.646372:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347 00000100:00100000:2.0:1783444303.646385:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444303.646396:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575264768 00000100:00100000:2.0:1783444303.646398:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575265280:0@lo:38:kworker.0 00000100:00100000:1.0:1783444303.646400:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575264768 00000100:00100000:1.0:1783444303.646425:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575264384 00000100:00100000:2.0:1783444303.646429:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444303.646441:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575264384 00000100:00100000:1.0:1783444303.646458:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575264640 00000100:00100000:1.0:1783444303.646460:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575264640 00000100:00100000:1.0:1783444303.646467:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575265280 00000100:00100000:1.0:1783444303.646469:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575265280 00000100:00100000:2.0:1783444303.646476:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1783444303.646483:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575264768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444303.646520:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575264768:12345-0@lo:400:kworker.0 Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444303.646531:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575264512:0@lo:400:kworker.0 00000100:00100000:0.0:1783444303.646592:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575264256:0@lo:400:kworker.0 00000400:00000100:0.0:1783444303.646619:0:3635:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575264256 offset 0 length 224: 4 00000100:00100000:0.0:1783444303.646640:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575265152:0@lo:400:kworker.0 00000100:00100000:0.0:1783444303.646658:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444303.646771:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1783444303.646778:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575264384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444303.646814:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444303.646855:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575264384:12345-0@lo:38:kworker.0 Request processed in 76us (536us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444303.646861:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1783444303.646875:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1783444303.646879:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575264640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444303.646887:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444303.646907:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575264640:12345-0@lo:38:kworker.0 Request processed in 26us (554us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444303.646912:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1783444303.646922:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1783444303.646926:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575265280:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444303.646935:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444303.646956:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575265280:12345-0@lo:38:kworker.0 Request processed in 29us (526us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444303.646962:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00080000:1.0:1783444303.646992:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444303.646996:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444303.646999:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575264384:0@lo:38:kworker.0 00000100:00080000:1.0:1783444303.647007:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444303.647010:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444303.647013:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575264640:0@lo:38:kworker.0 00000100:00080000:1.0:1783444303.647018:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444303.647020:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444303.647022:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575265280:0@lo:38:kworker.0 00000100:00100000:1.0:1783444303.647066:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575264768:0@lo:400:kworker.0 00000100:00100000:1.0:1783444303.647076:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575265024:0@lo:400:kworker.0 00000100:00100000:1.0:1783444303.647116:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575264896 00000100:00100000:1.0:1783444303.647121:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575264896 00000100:00100000:1.0:1783444303.647144:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:1.0:1783444303.647148:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575264896:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444303.647158:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444303.647201:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575264896:12345-0@lo:38:kworker.0 Request processed in 51us (814us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444303.647207:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00080000:1.0:1783444303.647233:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444303.647237:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444303.647240:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575264896:0@lo:38:kworker.0 00000100:00080000:1.0:1783444303.647281:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444303.647286:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444303.647377:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444303.647414:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575265152 00000100:00100000:3.0:1783444303.647418:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575265152 00000100:00100000:3.0:1783444303.647464:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348 00000100:00100000:3.0:1783444303.647471:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575265152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444303.647507:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575265152:12345-0@lo:400:kworker.0 Request processed in 38us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444303.647514:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348 00000100:00080000:3.0:1783444303.647532:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444303.647548:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575265152:0@lo:400:kworker.0 00000100:00100000:1.0:1783444303.651563:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575264512 00000100:00100000:1.0:1783444303.651581:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575264512 00000100:00100000:1.0:1783444303.651682:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1783444303.651693:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575264512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444303.651828:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575264512:12345-0@lo:400:kworker.0 Request processed in 136us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444303.651835:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00080000:3.0:1783444303.654997:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444303.655065:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575264512:0@lo:400:kworker.0 00000100:00100000:2.0:1783444303.655449:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00010000:00010000:2.0:1783444303.837318:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1783444303.952725:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557773184 offset 0 length 224: 4 00000100:00100000:0.0:1783444303.952768:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444303.952878:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444303.953091:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444303.953135:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444303.953163:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557773568 00000100:00100000:0.0:1783444303.953173:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557773568 00000100:00100000:0.0:1783444303.953242:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557773696 00000100:00100000:0.0:1783444303.953246:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557773696 00000100:00100000:0.0:1783444303.953275:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5868 00000100:00100000:0.0:1783444303.953284:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2400:x1870073557773568:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1783444303.953317:0:26206:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831eee 00000100:00080000:0.0:1783444303.953326:0:26206:0:(import.c:65:import_set_state_nolock()) ffff9369006a2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783444303.953390:0:26206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:0.0:1783444303.953571:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+2:2400:x1870073557773568:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 287us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444303.953580:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5868 00000100:00100000:0.0:1783444303.953610:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5869 00000100:00100000:0.0:1783444303.953617:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2400:x1870073557773696:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1783444303.953630:0:26206:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3831ef5 00000100:00080000:0.0:1783444303.953636:0:26206:0:(import.c:65:import_set_state_nolock()) ffff9368dd20c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783444303.953659:0:26206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:0.0:1783444303.953730:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+2:2400:x1870073557773696:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 113us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444303.953737:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5869 00010000:00010000:0.0:1783444303.953759:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444303.953916:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444303.958347:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557773440 00000100:00100000:1.0:1783444303.958437:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557773440 00000100:00100000:1.0:1783444303.958515:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557773312 00000100:00100000:1.0:1783444303.958519:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557773312 00000100:00100000:1.0:1783444303.958563:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 910 00000100:00100000:1.0:1783444303.958573:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557773440:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444303.958682:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557773440:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 111us (5914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444303.958690:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 910 00000100:00100000:1.0:1783444303.958710:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1177 00000100:00100000:1.0:1783444303.958715:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557773312:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:1.0:1783444303.958736:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444303.958762:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557773312:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 46us (5885us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444303.958769:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1177 00000100:00080000:2.0:1783444303.961975:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444303.961985:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444303.961988:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783444304.864772:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444305.891897:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444306.717225:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444306.717247:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575265408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444306.717322:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444306.717514:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444306.717525:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575265536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444306.717557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444306.717594:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575265408 00000100:00100000:1.0:1783444306.717601:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575265408 00000100:00100000:1.0:1783444306.717655:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575265536 00000100:00100000:1.0:1783444306.717658:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575265536 00000100:00100000:1.0:1783444306.717677:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:1.0:1783444306.717685:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575265408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444306.717716:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444306.717760:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575265408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444306.717767:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:1.0:1783444306.717815:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:1.0:1783444306.717824:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575265536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444306.717869:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444306.717906:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575265536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444306.717912:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00080000:1.0:1783444306.717928:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444306.717932:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444306.717974:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575265536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444306.718006:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575265408:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783444306.909435:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444307.932999:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783444308.765281:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444308.765292:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444308.765296:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444308.765308:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3294 00000100:00080000:1.0:1783444308.765315:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783444308.765324:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444308.765352:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3447800 x1870073575265792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444308.765390:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444308.765395:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444308.765396:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444308.765400:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3294 00000100:00080000:1.0:1783444308.765403:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783444308.765407:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444308.765419:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3445c00 x1870073575266048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444308.765450:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444308.765453:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444308.765455:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444308.765459:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3294 00000100:00080000:1.0:1783444308.765462:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783444308.765465:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444308.765478:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3444380 x1870073575266304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444308.765481:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1783444308.765498:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444308.765502:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444308.765503:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783444308.765504:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575266432:0@lo:400:kworker.0 00000100:00080000:1.0:1783444308.765507:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3294 00000100:00080000:1.0:1783444308.765510:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783444308.765513:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444308.765522:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3447b80 x1870073575266688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444308.765560:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575265792:0@lo:38:kworker.0 00000100:00100000:3.0:1783444308.765596:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444308.765596:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444308.765722:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575266560:0@lo:400:kworker.0 00000100:00100000:0.0:1783444308.766338:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575266176:0@lo:400:kworker.0 00000100:00100000:3.0:1783444308.767200:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575265664:0@lo:400:kworker.0 00000400:00000100:3.0:1783444308.767239:0:3633:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575265664 offset 0 length 224: 4 00000100:00100000:1.0:1783444308.767467:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575266048:0@lo:38:kworker.0 00000100:00100000:1.0:1783444308.767505:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444308.767541:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575266304:0@lo:38:kworker.0 00000100:00100000:1.0:1783444308.767568:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444308.767587:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575265792 00000100:00100000:1.0:1783444308.767590:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575266688:0@lo:38:kworker.0 00000100:00100000:3.0:1783444308.767598:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575265792 00000100:00100000:1.0:1783444308.767629:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444308.767700:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444308.767712:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575265920:0@lo:400:kworker.0 00000100:00100000:0.0:1783444308.770625:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444308.770683:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575266048 00000100:00100000:3.0:1783444308.770697:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575266048 00000100:00100000:3.0:1783444308.770756:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575266688 00000100:00100000:3.0:1783444308.770760:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575266688 00000100:00100000:3.0:1783444308.770806:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1783444308.770826:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575265792:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444308.770858:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444308.770961:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575265792:12345-0@lo:38:kworker.0 Request processed in 137us (5364us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444308.770969:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:1.0:1783444308.771214:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1783444308.771221:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575266048:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444308.771234:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444308.771274:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575266048:12345-0@lo:38:kworker.0 Request processed in 52us (3768us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444308.771281:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1783444308.771297:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1783444308.771301:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575266688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444308.771311:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444308.771337:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575266688:12345-0@lo:38:kworker.0 Request processed in 34us (3707us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444308.771343:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00080000:1.0:1783444308.771533:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783444308.771539:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575266304 00000100:00080000:1.0:1783444308.771539:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444308.771544:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575265792:0@lo:38:kworker.0 00000100:00100000:3.0:1783444308.771545:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575266304 00000100:00080000:1.0:1783444308.771558:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444308.771562:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444308.771565:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575266048:0@lo:38:kworker.0 00000100:00100000:3.0:1783444308.771570:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:3.0:1783444308.771575:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575266304:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1783444308.771576:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444308.771579:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444308.771582:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575266688:0@lo:38:kworker.0 00010000:00020000:3.0:1783444308.771585:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444308.771615:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575266304:12345-0@lo:38:kworker.0 Request processed in 40us (4046us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783444308.771615:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444308.771619:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444308.771622:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:1.0:1783444308.771631:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575266304:0@lo:38:kworker.0 00000100:00100000:3.0:1783444308.771804:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575266432 00000100:00100000:3.0:1783444308.771810:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575266432 00000100:00100000:3.0:1783444308.771861:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575266560 00000100:00080000:1.0:1783444308.771862:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444308.771865:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575266560 00000100:00080000:1.0:1783444308.771883:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444308.771894:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349 00000100:00100000:3.0:1783444308.771901:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575266432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444308.771962:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575266432:12345-0@lo:400:kworker.0 Request processed in 62us (6367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444308.771969:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349 00000100:00100000:1.0:1783444308.772039:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575266432:0@lo:400:kworker.0 00000100:00100000:3.0:1783444308.772511:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:3.0:1783444308.772520:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575266560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444308.772567:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575266560:12345-0@lo:400:kworker.0 Request processed in 49us (4867us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444308.772583:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:3.0:1783444308.772637:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575266560:0@lo:400:kworker.0 00000100:00100000:0.0:1783444308.773644:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444308.774084:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575266176 00000100:00100000:3.0:1783444308.774103:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575266176 00000100:00100000:3.0:1783444308.774159:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575265920 00000100:00100000:3.0:1783444308.774162:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575265920 00000100:00100000:0.0:1783444308.774253:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1783444308.774267:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575266176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444308.774347:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575266176:12345-0@lo:400:kworker.0 Request processed in 84us (3729us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444308.774356:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1783444308.774375:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1783444308.774643:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575265920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444308.774689:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575265920:12345-0@lo:400:kworker.0 Request processed in 308us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444308.774696:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1783444308.774745:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575266176:0@lo:400:kworker.0 00000100:00100000:3.0:1783444308.774884:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575265920:0@lo:400:kworker.0 00000100:00080000:0.0:1783444308.774969:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783444308.959932:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444309.074965:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444309.075007:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:0.0:1783444309.075032:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557774208 offset 0 length 520: 4 00000100:00100000:3.0:1783444309.075203:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557774080 00000100:00100000:3.0:1783444309.075214:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557774080 00000100:00100000:3.0:1783444309.075274:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557773952 00000100:00100000:3.0:1783444309.075278:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557773952 00000100:00100000:3.0:1783444309.075298:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 913 00000100:00100000:3.0:1783444309.075308:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557774080:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444309.075401:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557774080:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 94us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444309.075410:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 913 00000100:00100000:3.0:1783444309.075432:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1181 00000100:00100000:3.0:1783444309.075436:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557773952:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:3.0:1783444309.075459:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444309.075485:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557773952:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 47us (478us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444309.075493:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1181 00000100:00080000:0.0:1783444309.075711:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000400:2.0:1783444309.790055:0:3634:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444293/real 1783444293] req@ffff9367c4aca300 x1870073575260928/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444309 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444309.790104:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9367c4aca300 x1870073575260928/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444309.790115:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783444309.790119:0:3634:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000001:00100000:3.0:1783444309.801320:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:3.0:1783444309.801329:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368dd20b800/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:3.0:1783444309.801356:0:46305:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd20b800/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-OST0001 00000020:00000080:3.0:1783444309.801417:0:46305:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd20c800 for lustre-OST0001 00000001:00100000:0.0:1783444309.801492:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444309.801497:0:8415:0:(genops.c:906:class_export_put()) final put ffff9369006a2000/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444309.801517:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9369006a2000/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-OST0000 00000020:00000080:0.0:1783444309.801543:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9369006a2800 for lustre-OST0000 00000100:00080000:2.0:1783444309.804413:0:3634:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783444309.804419:0:3634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783444309.804429:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c4aca300 x1870073575260928/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444309.804469:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c308dc00 x1870073575262848/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444314 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444309.804534:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368dd172d80 x1870073575264256/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444319 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444309.804542:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368e3444700 x1870073575265664/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444324 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783444309.804562:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783444309.804565:0:3634:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783444309.804566:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783444309.804568:0:3634:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00080000:2.0:1783444309.804611:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444309.804616:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783444309.804619:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444309.804625:0:80542:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3242 00000100:00080000:2.0:1783444309.804634:0:80542:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444309.804666:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e68f7b80 x1870073575266816/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444309.804689:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444309.804693:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444309.804695:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444309.804698:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3299 00000100:00080000:2.0:1783444309.804701:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444309.804705:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444309.804720:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e68f7480 x1870073575266944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444309.804747:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444309.804756:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444309.804758:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444309.804762:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3299 00000100:00080000:2.0:1783444309.804764:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444309.804768:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444309.804784:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c32ba300 x1870073575267200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444309.807910:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575265664:0@lo:400:kworker.0 00000100:00100000:3.0:1783444309.808177:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575260928:0@lo:400:kworker.0 00000100:00100000:1.0:1783444309.808267:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575266816:0@lo:250:kworker.0 00000400:00000100:1.0:1783444309.808323:0:3632:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575266816 offset 0 length 520: 4 00000100:00100000:1.0:1783444309.808362:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575266944:0@lo:38:kworker.0 00000100:00100000:1.0:1783444309.808398:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444309.808629:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575266944 00000100:00100000:3.0:1783444309.808638:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575266944 00000100:00100000:3.0:1783444309.808686:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1783444309.808694:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575266944:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444309.808716:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444309.808763:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575266944:12345-0@lo:38:kworker.0 Request processed in 68us (363us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444309.808770:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1783444309.808822:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444309.808831:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575267072:0@lo:400:kworker.0 00000100:00100000:3.0:1783444309.808858:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444309.808886:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575267072 00000100:00100000:3.0:1783444309.808890:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575267072 00000100:00100000:3.0:1783444309.808928:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1783444309.808934:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575267072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444309.808978:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575267072:12345-0@lo:400:kworker.0 Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444309.808985:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1783444309.809023:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575267072:0@lo:400:kworker.0 00000100:00080000:1.0:1783444309.809140:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444309.809145:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444309.809149:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575266944:0@lo:38:kworker.0 00000100:00100000:0.0:1783444309.810637:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575262848:0@lo:400:kworker.0 00000100:00100000:0.0:1783444309.810680:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575264256:0@lo:400:kworker.0 00000100:00080000:2.0:1783444309.811127:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444309.811131:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444309.811134:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444309.811139:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3299 00000100:00080000:2.0:1783444309.811142:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444309.811148:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444309.811161:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575267328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444309.811221:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444309.811278:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575267328 00000100:00100000:2.0:1783444309.811284:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575267328 00000100:00100000:2.0:1783444309.811327:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:2.0:1783444309.811336:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575267328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444309.811381:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575267328:12345-0@lo:400:kworker.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444309.811389:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:2.0:1783444309.811422:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575267328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444309.811451:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3910a80 x1870073575267456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444309.811500:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575267584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444309.811527:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444309.811558:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575267584 00000100:00100000:2.0:1783444309.811562:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575267584 00000100:00100000:2.0:1783444309.811587:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:2.0:1783444309.811593:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575267584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444309.811629:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575267584:12345-0@lo:400:kworker.0 Request processed in 36us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444309.811634:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:2.0:1783444309.811658:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575267584:0@lo:400:kworker.0 00000100:00080000:2.0:1783444309.811682:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444309.811685:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444309.811687:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444309.811691:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3299 00000100:00080000:2.0:1783444309.811694:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444309.811697:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444309.811702:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444309.811709:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575267712:0@lo:400:kworker.0 00000100:00100000:2.0:1783444309.811730:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444309.811754:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575267712 00000100:00100000:2.0:1783444309.811758:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575267712 00000100:00100000:2.0:1783444309.811781:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352 00000100:00100000:2.0:1783444309.811813:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575267712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444309.811848:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575267712:12345-0@lo:400:kworker.0 Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444309.811865:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352 00000100:00100000:2.0:1783444309.811901:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575267712:0@lo:400:kworker.0 00000100:00100000:2.0:1783444309.811923:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3913b80 x1870073575267840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444309.812246:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575267200:0@lo:38:kworker.0 00000100:00100000:0.0:1783444309.812280:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444309.812299:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575267456:0@lo:38:kworker.0 00000100:00100000:0.0:1783444309.812323:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444309.812349:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575267840:0@lo:38:kworker.0 00000100:00100000:0.0:1783444309.812373:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444309.812406:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575267200 00000100:00100000:0.0:1783444309.812410:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575267200 00000100:00100000:0.0:1783444309.812432:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575267840 00000100:00100000:0.0:1783444309.812435:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575267840 00000100:00100000:0.0:1783444309.812449:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1783444309.812454:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575267200:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444309.812474:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444309.812510:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575267200:12345-0@lo:38:kworker.0 Request processed in 54us (229us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444309.812516:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1783444309.812529:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1783444309.812533:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575267840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444309.812541:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444309.812564:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575267840:12345-0@lo:38:kworker.0 Request processed in 29us (190us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444309.812570:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00080000:0.0:1783444309.812598:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444309.812602:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444309.812614:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575267200:0@lo:38:kworker.0 00000100:00080000:0.0:1783444309.812625:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444309.812628:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444309.812630:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575267840:0@lo:38:kworker.0 00000100:00100000:1.0:1783444309.812694:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575267456 00000100:00100000:1.0:1783444309.812699:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575267456 00000100:00100000:1.0:1783444309.812730:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:1.0:1783444309.812735:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575267456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444309.812745:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444309.812784:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575267456:12345-0@lo:38:kworker.0 Request processed in 47us (460us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444309.812815:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00080000:0.0:1783444309.813007:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444309.813011:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444309.813015:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575267456:0@lo:38:kworker.0 00010000:00010000:1.0:1783444309.981176:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444311.007024:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444311.837141:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444311.837172:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575267968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444311.837254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444311.837305:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575268096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444311.837356:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444311.837447:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575267968 00000100:00100000:1.0:1783444311.837456:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575267968 00000100:00100000:1.0:1783444311.837518:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575268096 00000100:00100000:1.0:1783444311.837521:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575268096 00000100:00100000:1.0:1783444311.837567:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:1.0:1783444311.837576:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575267968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444311.837604:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444311.837648:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575267968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444311.837655:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:1.0:1783444311.837673:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:1.0:1783444311.837679:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575268096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444311.837694:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444311.837719:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575268096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444311.837725:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00080000:3.0:1783444311.837915:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444311.837920:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444311.837961:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575268096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444311.838095:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575267968:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444312.042648:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444313.062952:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783444313.984478:0:89001:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783444313.984485:0:89001:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783444313.984487:0:89001:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783444313.985031:0:89001:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9368ff57c000 00000020:01000004:3.0:1783444313.985050:0:89001:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783444313.985067:0:89001:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783444313.985082:0:89001:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9367c1e80000) 00000020:00000080:3.0:1783444313.985101:0:89001:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783444314.074712:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00010000:00010000:1.0:1783444314.076968:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1783444314.077609:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.079666:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.080102:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.080363:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.080660:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.081031:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.081307:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.081573:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.082106:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.082401:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.082748:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.083150:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.083473:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.083832:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.084150:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.084431:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.084862:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.085064:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.085324:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.085523:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.086008:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.086192:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.086497:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.086901:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783444314.087298:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783444314.087717:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783444314.088387:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783444314.088740:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783444314.089089:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783444314.089345:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1783444314.089641:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1783444314.090042:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783444314.090288:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783444314.095450:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.096106:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783444314.096579:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.097024:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.097284:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783444314.097524:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783444314.097933:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.098300:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783444314.098824:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.099171:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783444314.099454:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.099868:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783444314.100131:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.100817:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.101376:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.101609:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.102280:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.102538:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783444314.103035:0:89001:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1783444314.103929:0:89001:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783444314.104162:0:89001:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783444314.104174:0:89001:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783444314.104189:0:89001:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e383204c 00000020:01000004:2.0:1783444314.104197:0:89001:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783444314.104210:0:89001:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783444314.104216:0:89001:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9368ff57c000 from MGS 00000020:01000004:2.0:1783444314.104220:0:89001:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783444314.104231:0:89001:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9367c3330000) 00000020:00000080:2.0:1783444314.104243:0:89001:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1783444314.104304:0:89001:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368ff57c000 from MGS, refs=2 00080000:01000000:2.0:1783444314.104309:0:89001:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783444314.104314:0:89001:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e383205a 00010000:00010000:2.0:1783444314.104429:0:89001:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1783444314.111632:0:89001:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783444314.112776:0:89005:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783444314.112851:0:89001:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783444314.112884:0:89001:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444314.113435:0:89001:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783444314.113669:0:89001:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783444314.113851:0:89001:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783444314.113858:0:89001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783444314.120743:0:89001:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783444314.121134:0:89001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783444314.124676:0:89001:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783444314.124690:0:89001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783444314.125336:0:89001:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783444314.125359:0:89001:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1783444314.125361:0:89001:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1783444314.125364:0:89001:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1783444314.125370:0:89001:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 78, was 0): CONNECTING 00000100:00100000:3.0:1783444314.125377:0:89001:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1783444314.187465:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444314.187566:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444314.191123:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557774464 00000100:00100000:2.0:1783444314.191142:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557774464 00000100:00100000:2.0:1783444314.191236:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557774336 00000100:00100000:2.0:1783444314.191240:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557774336 00000100:00100000:2.0:1783444314.191265:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 916 00000100:00100000:2.0:1783444314.191279:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557774464:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444314.191384:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557774464:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 110us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444314.191393:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 916 00000100:00100000:2.0:1783444314.191412:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1185 00000100:00100000:2.0:1783444314.191417:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557774336:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444314.191438:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444314.191465:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557774336:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 47us (3899us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444314.191472:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1185 00000100:00080000:3.0:1783444314.193601:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444314.918185:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444314.918193:0:80542:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444314.918196:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444314.918199:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444314.918203:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444314.918213:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3300 00000100:00080000:2.0:1783444314.918218:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444314.918224:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444314.918261:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3912300 x1870073575268224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444314.918320:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444314.918324:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444314.918326:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444314.918330:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3300 00000100:00080000:2.0:1783444314.918332:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444314.918336:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444314.918348:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3911c00 x1870073575268480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444314.918364:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444314.918368:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444314.918369:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444314.918373:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3300 00000100:00080000:2.0:1783444314.918375:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444314.918379:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444314.918389:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3913b80 x1870073575268736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444314.918426:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444314.918429:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444314.918431:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444314.918434:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3300 00000100:00080000:2.0:1783444314.918436:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444314.918440:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444314.918450:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5972d80 x1870073575269120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444314.918518:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575268352:0@lo:400:kworker.0 00000100:00100000:2.0:1783444314.918588:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444314.918630:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444314.918636:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575268608:0@lo:400:kworker.0 00000100:00100000:2.0:1783444314.918658:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444314.918686:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575268864:0@lo:400:kworker.0 00000100:00100000:2.0:1783444314.918712:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444314.918742:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444314.918748:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575268992:0@lo:400:kworker.0 00000100:00100000:2.0:1783444314.918768:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444314.918828:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575268352 00000100:00100000:2.0:1783444314.918835:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575268352 00000100:00100000:2.0:1783444314.918887:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575268608 00000100:00100000:2.0:1783444314.918890:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575268608 00000100:00100000:2.0:1783444314.918917:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1783444314.918926:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575268352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444314.919054:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575268352:12345-0@lo:400:kworker.0 Request processed in 129us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444314.919062:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1783444314.919081:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1783444314.919089:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575268608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444314.919117:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575268608:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444314.919122:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1783444314.919162:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575268608:0@lo:400:kworker.0 00000100:00100000:2.0:1783444314.919184:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575268352:0@lo:400:kworker.0 00000100:00080000:3.0:1783444314.919452:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444314.920037:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575268224:0@lo:38:kworker.0 00000100:00100000:1.0:1783444314.920079:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444314.920117:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575268480:0@lo:38:kworker.0 00000100:00100000:1.0:1783444314.920137:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444314.920166:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575268736:0@lo:38:kworker.0 00000100:00100000:1.0:1783444314.920191:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444314.920215:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575269120:0@lo:38:kworker.0 00000100:00100000:1.0:1783444314.920237:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444314.920273:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575268864 00000100:00100000:1.0:1783444314.920278:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575268864 00000100:00100000:1.0:1783444314.920327:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575268992 00000100:00100000:1.0:1783444314.920330:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575268992 00000100:00100000:1.0:1783444314.920354:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:1.0:1783444314.920361:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575268864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444314.920410:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575268864:12345-0@lo:400:kworker.0 Request processed in 50us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444314.920417:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00000100:00100000:1.0:1783444314.920434:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354 00000100:00100000:1.0:1783444314.920439:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575268992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444314.920464:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575268992:12345-0@lo:400:kworker.0 Request processed in 26us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444314.920470:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354 00000100:00100000:1.0:1783444314.920525:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575268992:0@lo:400:kworker.0 00000100:00100000:1.0:1783444314.920538:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575268864:0@lo:400:kworker.0 00000100:00100000:1.0:1783444314.920563:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575268224 00000100:00100000:1.0:1783444314.920566:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575268224 00000100:00100000:1.0:1783444314.920585:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575268480 00000100:00100000:1.0:1783444314.920588:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575268480 00000100:00100000:1.0:1783444314.920601:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575269120 00000100:00100000:1.0:1783444314.920604:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575269120 00000100:00100000:1.0:1783444314.920617:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1783444314.920621:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575268224:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444314.920641:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444314.920674:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575268224:12345-0@lo:38:kworker.0 Request processed in 51us (594us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444314.920681:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1783444314.920692:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1783444314.920703:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575268480:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444314.920714:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444314.921061:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1783444314.921066:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575269120:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444314.921077:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444314.921110:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575269120:12345-0@lo:38:kworker.0 Request processed in 43us (871us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444314.921116:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00080000:0.0:1783444314.921188:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444314.921195:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444314.921198:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575268224:0@lo:38:kworker.0 00000100:00080000:0.0:1783444314.921209:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444314.921212:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444314.921214:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575269120:0@lo:38:kworker.0 00000100:00100000:3.0:1783444314.921308:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575268736 00000100:00100000:3.0:1783444314.921314:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575268736 00000100:00100000:3.0:1783444314.921351:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:3.0:1783444314.921356:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575268736:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444314.921366:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444314.921407:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575268736:12345-0@lo:38:kworker.0 Request processed in 50us (1214us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444314.921412:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00080000:3.0:1783444314.921441:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444314.921446:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444314.921466:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444314.921471:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444314.921474:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575268736:0@lo:38:kworker.0 00000100:00100000:1.0:1783444314.921651:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575268480:12345-0@lo:38:kworker.0 Request processed in 946us (1512us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444314.921658:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:3.0:1783444314.921829:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444314.921834:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444314.921837:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575268480:0@lo:38:kworker.0 00010000:00010000:2.0:1783444315.103196:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444316.125038:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444316.957278:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444316.957300:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575269248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444316.957376:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444316.957483:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575269248 00000100:00100000:1.0:1783444316.957491:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575269248 00000100:00100000:1.0:1783444316.957562:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:1.0:1783444316.957573:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fa019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575269248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444316.957604:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444316.957654:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fa019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575269248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444316.957661:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00080000:3.0:1783444316.957996:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444316.958037:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575269248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444316.958524:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575269376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444316.958561:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444316.958625:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575269376 00000100:00100000:0.0:1783444316.958631:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575269376 00000100:00100000:0.0:1783444316.958698:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:0.0:1783444316.958706:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575269376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444316.958726:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783444316.958831:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444316.958949:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575269376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 244us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444316.958956:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:3.0:1783444316.959167:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575269376:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783444317.149100:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444318.173056:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444319.005541:0:3632:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444309/real 1783444309] req@ffff9368e68f7b80 x1870073575266816/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444319 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444319.005577:0:3632:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9368e68f7b80 x1870073575266816/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444319 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444319.005597:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444319.005614:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783444319.005634:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575266816:0@lo:250:kworker.0 00000100:00080000:3.0:1783444319.005667:0:46305:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444319.005687:0:46305:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783444319.005689:0:46305:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444319.005695:0:46305:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3300 00000100:00080000:3.0:1783444319.005701:0:46305:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783444319.005709:0:46305:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444319.005741:0:46305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a90e00 x1870073575269504/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444319.005760:0:46305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444319.005763:0:46305:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444319.005765:0:46305:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444319.005768:0:46305:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3305 00000100:00080000:3.0:1783444319.005770:0:46305:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444319.005774:0:46305:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444319.005823:0:46305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a91f80 x1870073575269632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1783444319.006032:0:89001:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1783444319.006064:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831ca9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006076:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831ca9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006082:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1783444319.006101:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006112:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e3831ca2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831ca9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006129:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c0f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006135:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c0f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006140:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006143:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006146:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71600/0x42cb6883e3831c08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c0f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006154:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c2b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006159:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c2b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006170:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006173:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006178:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a400/0x42cb6883e3831c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c2b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006186:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c55 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006191:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c55 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006195:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006198:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006201:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3831c4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c55 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006208:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c63 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006212:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c63 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006217:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006220:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006223:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a800/0x42cb6883e3831c5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c63 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006231:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c7f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006247:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c7f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006252:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006256:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006259:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71800/0x42cb6883e3831c78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c7f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006267:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c8d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006272:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c8d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006276:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006279:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006281:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70400/0x42cb6883e3831c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c8d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006290:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831cb7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006295:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831cb7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006300:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006303:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006305:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1a200/0x42cb6883e3831cb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831cb7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006329:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c1d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006335:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c1d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006339:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006342:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006346:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3831c16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c1d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006357:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c39 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006363:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c39 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006367:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.006370:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006373:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70200/0x42cb6883e3831c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c39 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006383:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c47 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006389:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c47 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006393:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783444319.006402:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006407:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3831c40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c47 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006415:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c71 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006420:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c71 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006425:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783444319.006427:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006444:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3831c6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c71 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.006453:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3831c9b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.006459:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3831c9b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.006464:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783444319.006467:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.006470:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e3831c94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3831c9b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783444319.006484:0:89001:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 79, was 0): CONNECTING 00000100:00080000:2.0:1783444319.006488:0:89001:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1783444319.006528:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575269504:0@lo:250:kworker.0 00000100:00100000:2.0:1783444319.006593:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444319.006639:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575269632:0@lo:38:kworker.0 00000100:00100000:2.0:1783444319.006665:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444319.008199:0:46305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444319.008210:0:46305:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444319.008214:0:46305:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444319.008222:0:46305:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3305 00000100:00080000:3.0:1783444319.008226:0:46305:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444319.008232:0:46305:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444319.008270:0:46305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a92a00 x1870073575269888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444319.008304:0:46305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444319.008307:0:46305:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444319.008322:0:46305:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444319.008326:0:46305:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3305 00000100:00080000:3.0:1783444319.008329:0:46305:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444319.008333:0:46305:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444319.008346:0:46305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a93480 x1870073575270144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444319.008378:0:46305:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444319.008381:0:46305:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444319.008383:0:46305:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444319.008387:0:46305:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3305 00000100:00080000:3.0:1783444319.008389:0:46305:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444319.008393:0:46305:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444319.008404:0:46305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a93100 x1870073575270528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444319.008435:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575270272:0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.008493:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.008527:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444319.008533:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575270400:0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.008555:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.008591:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575270272 00000100:00100000:3.0:1783444319.008599:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575270272 00000100:00100000:3.0:1783444319.008653:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575270400 00000100:00100000:3.0:1783444319.008657:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575270400 00000100:00100000:3.0:1783444319.008681:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355 00000100:00100000:3.0:1783444319.008690:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575270272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.008743:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575270272:12345-0@lo:400:kworker.0 Request processed in 54us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.008756:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355 00000100:00100000:3.0:1783444319.008772:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1783444319.008778:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575270400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.008837:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575270400:12345-0@lo:400:kworker.0 Request processed in 58us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.008854:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00080000:3.0:1783444319.008878:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444319.008881:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444319.008922:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575270400:0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.008933:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575270272:0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.008960:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575269888:0@lo:38:kworker.0 00000100:00100000:3.0:1783444319.008988:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.009006:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575270144:0@lo:38:kworker.0 00000100:00100000:3.0:1783444319.009027:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.009044:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575270528:0@lo:38:kworker.0 00000100:00100000:3.0:1783444319.009063:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.009108:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575269760:0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.009131:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.009148:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444319.009153:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575270016:0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.009174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.009208:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575270144 00000100:00100000:3.0:1783444319.009213:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575270144 00000100:00100000:3.0:1783444319.009233:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:3.0:1783444319.009245:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575270144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444319.009264:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444319.009297:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575270144:12345-0@lo:38:kworker.0 Request processed in 51us (268us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444319.009303:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00080000:3.0:1783444319.009328:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444319.009333:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444319.009336:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575270144:0@lo:38:kworker.0 00000100:00100000:3.0:1783444319.009362:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575269632 00000100:00100000:3.0:1783444319.009365:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575269632 00000100:00100000:3.0:1783444319.009383:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575269888 00000100:00100000:3.0:1783444319.009386:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575269888 00000100:00100000:3.0:1783444319.009392:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575270528 00000100:00100000:3.0:1783444319.009395:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575270528 00000100:00100000:3.0:1783444319.009402:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575269760 00000100:00100000:3.0:1783444319.009404:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575269760 00000100:00100000:3.0:1783444319.009425:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1783444319.009430:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575269760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.009465:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575269760:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.009470:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1783444319.009479:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575270016 00000100:00100000:3.0:1783444319.009482:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575270016 00000100:00100000:3.0:1783444319.009496:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:3.0:1783444319.009500:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575270016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.009524:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575270016:12345-0@lo:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.009538:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:3.0:1783444319.009550:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1783444319.009554:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575269632:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444319.009564:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444319.009594:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575269632:12345-0@lo:38:kworker.0 Request processed in 38us (2927us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444319.009600:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1783444319.009610:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1783444319.009613:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575269888:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444319.009623:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444319.009643:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575269888:12345-0@lo:38:kworker.0 Request processed in 28us (655us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444319.009649:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1783444319.009659:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1783444319.009662:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575270528:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444319.009671:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444319.009692:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575270528:12345-0@lo:38:kworker.0 Request processed in 28us (628us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444319.009698:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00080000:3.0:1783444319.009710:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444319.009728:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575270016:0@lo:400:kworker.0 00000100:00100000:3.0:1783444319.009739:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575269760:0@lo:400:kworker.0 00000100:00080000:3.0:1783444319.009758:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444319.009767:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444319.009770:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575269888:0@lo:38:kworker.0 00000100:00080000:3.0:1783444319.009782:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444319.009784:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444319.009814:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575270528:0@lo:38:kworker.0 00000100:00080000:3.0:1783444319.009826:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444319.009829:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444319.009832:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575269632:0@lo:38:kworker.0 00000100:00100000:0.0:1783444319.010339:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575269504 00000100:00100000:0.0:1783444319.010346:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575269504 00000100:00100000:0.0:1783444319.010378:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783444319.010383:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3632:x1870073575269504:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1783444319.010403:0:89006:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo t0 exp 0000000000000000 cur 3310 last 0 00000020:00000080:0.0:1783444319.010442:0:89006:0:(genops.c:1406:class_connect()) connect: client c89ab73b-dbb2-4305-b221-37cc64d61227, cookie 0x42cb6883e3832061 00000100:00080000:0.0:1783444319.010571:0:89006:0:(import.c:65:import_set_state_nolock()) ffff9368c518e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444319.010628:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+5:3632:x1870073575269504:12345-0@lo:250:kworker.0 Request processed in 243us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444319.010634:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783444319.010695:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 10000000:01000000:0.0:1783444319.010705:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1783444319.010709:0:3632:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x42cb6883e3832061 00000100:00080000:0.0:1783444319.026474:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1783444319.026497:0:3632:0:(import.c:1673:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:0.0:1783444319.027637:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575269504:0@lo:250:kworker.0 00000100:00080000:2.0:1783444319.028034:0:89001:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:2.0:1783444319.028063:0:89001:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783444319.028109:0:89001:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783444319.028116:0:89001:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783444319.028232:0:89001:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783444319.028280:0:89001:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783444319.028285:0:89001:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783444319.028286:0:89001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444319.028288:0:89001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444319.028289:0:89001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444319.028290:0:89001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444319.028292:0:89001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444319.028293:0:89001:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444319.028295:0:89001:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444319.028297:0:89001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444319.028299:0:89001:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783444319.028301:0:89001:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783444319.028304:0:89001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783444319.028305:0:89001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444319.028306:0:89001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444319.028307:0:89001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444319.028308:0:89001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444319.028310:0:89001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444319.028311:0:89001:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444319.028313:0:89001:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444319.028314:0:89001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444319.028315:0:89001:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783444319.028344:0:89001:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783444319.028363:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff936900600cc0 going to sleep for 0 seconds 00000100:00100000:2.0:1783444319.028374:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575270656:0@lo:253:mount.lustre.0 00000020:00080000:2.0:1783444319.028395:0:89001:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:2.0:1783444319.028407:0:89001:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9368ff57c000 from lustre-MDT0000 10000000:01000000:2.0:1783444319.028427:0:89001:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783444319.028496:0:89001:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783444319.028505:0:89001:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9368ff57c000 10000000:01000000:2.0:1783444319.028510:0:89001:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783444319.028750:0:89001:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9368ff57c000 10000000:01000000:2.0:1783444319.028756:0:89001:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783444319.028760:0:89001:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ff57c000 from 1 10000000:01000000:2.0:1783444319.028763:0:89001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783444319.028869:0:89001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.028880:0:89001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.028889:0:89001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444319.028909:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff936900600780 going to sleep for 0 seconds 00000100:00100000:2.0:1783444319.028914:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575270784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444319.028923:0:89001:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.028930:0:89001:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.028937:0:89001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.028943:0:89001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.028950:0:89001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.028964:0:89001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444319.028968:0:89001:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.028975:0:89001:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444319.028981:0:89001:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.028986:0:89001:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444319.028990:0:89001:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1783444319.028995:0:89001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.029003:0:89001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c10600/0x42cb6883e3832068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444319.029019:0:89001:0:(mgc_request.c:1816:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:2.0:1783444319.029022:0:89001:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:2.0:1783444319.029062:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444319.029067:0:80542:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1783444319.029348:0:89011:0:(import.c:1597:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.204.120@tcp to MGS@0@lo 00000100:00100000:3.0:1783444319.029352:0:89011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783444319.029355:0:89011:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:3.0:1783444319.029374:0:89011:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1783444319.029379:0:89011:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from RECOVER to FULL 10000000:01000000:3.0:1783444319.029382:0:89011:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783444319.029408:0:89011:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:3.0:1783444319.029411:0:89011:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) MGC192.168.204.120@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:3.0:1783444319.030132:0:46305:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.120@tcp 10000000:01000000:3.0:1783444319.030153:0:46305:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1783444319.030156:0:46305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783444319.030158:0:46305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783444319.030159:0:46305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444319.030161:0:46305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444319.030162:0:46305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444319.030163:0:46305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444319.030164:0:46305:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783444319.030166:0:46305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444319.030168:0:46305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783444319.030219:0:46305:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1783444319.030228:0:46305:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1783444319.030230:0:46305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783444319.030240:0:46305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783444319.030243:0:46305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444319.030244:0:46305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444319.030245:0:46305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444319.030247:0:46305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444319.030248:0:46305:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783444319.030250:0:46305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444319.030251:0:46305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783444319.030272:0:46305:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1783444319.030278:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575270912:0@lo:253:kworker.0 10000000:01000000:3.0:1783444319.030280:0:46305:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1783444319.030289:0:46305:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1783444319.030293:0:46305:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783444319.030295:0:46305:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444319.030296:0:46305:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444319.030297:0:46305:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444319.030298:0:46305:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444319.030299:0:46305:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444319.030301:0:46305:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444319.030302:0:46305:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1783444319.030328:0:46305:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1783444319.030365:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575271168:0@lo:253:kworker.0 10000000:01000000:2.0:1783444319.030669:0:89001:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ff57c000 from 1 10000000:01000000:2.0:1783444319.030673:0:89001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783444319.030701:0:89001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.030711:0:89001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.030730:0:89001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444319.030743:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575271296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444319.031149:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575271040:0@lo:253:kworker.0 00000100:00100000:3.0:1783444319.031205:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444319.032400:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444319.032540:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575271168 00000100:00100000:0.0:1783444319.032551:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575271168 00000100:00100000:0.0:1783444319.033181:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575270912 00000100:00100000:0.0:1783444319.033186:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575270912 00000100:00100000:0.0:1783444319.033207:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783444319.033216:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+6:3633:x1870073575271168:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783444319.033274:0:89006:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1783444319.033330:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783444319.033338:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:3635:x1870073575270912:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783444319.033359:0:89008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:0.0:1783444319.033750:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783444319.034233:0:89006:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 111 00000100:00100000:2.0:1783444319.036579:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444319.036637:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff936900600780 going to sleep for 11 seconds 00000100:00100000:0.0:1783444319.036664:0:89009:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 20000000:01000000:0.0:1783444319.036955:0:89013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783444319.036959:0:89013:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783444319.036963:0:89013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783444319.036967:0:89013:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000100:00100000:0.0:1783444319.037039:0:89009:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1783444319.037193:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575271296 00000100:00100000:0.0:1783444319.037204:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575271296 00000100:00100000:0.0:1783444319.037329:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783444319.037341:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+7:89001:x1870073575271296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444319.037362:0:89014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444319.037404:0:89014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef263800/0x42cb6883e3832076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383206f expref: -99 pid: 89014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.037494:0:89014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef263800/0x42cb6883e3832076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383206f expref: 8 pid: 89014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.037514:0:89014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef263800/0x42cb6883e3832076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383206f expref: 8 pid: 89014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.037524:0:89014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef263800, rc 0) 00000100:00100000:2.0:1783444319.037587:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:89001:x1870073575271296:12345-0@lo:101:mount.lustre.0 Request processed in 247us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444319.037597:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783444319.038185:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575271296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444319.038215:0:89001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.038227:0:89001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444319.038265:0:89001:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000040:00080000:2.0:1783444319.038341:0:89013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00010000:00010000:0.0:1783444319.038457:0:89001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444319.038474:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444319.038483:0:89001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444319.038497:0:89001:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783444319.038506:0:89001:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783444319.038515:0:89001:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9368ff57c000 10000000:01000000:0.0:1783444319.038518:0:89001:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783444319.038523:0:89001:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 00000100:00100000:1.0:1783444319.038526:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575271040 10000000:01000000:0.0:1783444319.038526:0:89001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00000100:00100000:1.0:1783444319.038539:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575271040 00000100:00100000:1.0:1783444319.038585:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783444319.038594:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3636:x1870073575271040:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783444319.038629:0:89009:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00010000:0.0:1783444319.038632:0:89001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.038643:0:89001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.038655:0:89001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444319.039037:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575271424:0@lo:101:mount.lustre.0 20000000:01000000:0.0:1783444319.039517:0:89006:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783444319.039553:0:89006:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783444319.040055:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.040106:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c4d473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.040132:0:89014:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:1.0:1783444319.040350:0:89014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:2.0:1783444319.043334:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575271424 00000100:00100000:2.0:1783444319.043353:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575271424 00000100:00100000:1.0:1783444319.044011:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783444319.044033:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fbab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+9:89001:x1870073575271424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444319.044055:0:89015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444319.044087:0:89015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26600/0x42cb6883e3832084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383207d expref: -99 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.044123:0:89015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26600/0x42cb6883e3832084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383207d expref: 10 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.044205:0:89015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26600/0x42cb6883e3832084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383207d expref: 10 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.044218:0:89015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26600, rc 0) 00000100:00100000:1.0:1783444319.044332:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fbab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89001:x1870073575271424:12345-0@lo:101:mount.lustre.0 Request processed in 302us (4279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.044341:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783444319.045255:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575271424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444319.045286:0:89001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.045300:0:89001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444319.045726:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575271552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444319.045862:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444319.046032:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff936900600240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.046115:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575271552 00000100:00100000:1.0:1783444319.046123:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575271552 00000100:00100000:1.0:1783444319.046190:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783444319.046199:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fbab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89001:x1870073575271552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444319.046397:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fbab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575271552:12345-0@lo:501:mount.lustre.0 Request processed in 187us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.046406:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783444319.047447:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575271552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444319.047520:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575271680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444319.047602:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444319.047641:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff936900600240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.048195:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575271680 00000100:00100000:1.0:1783444319.048203:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575271680 00000100:00100000:1.0:1783444319.048265:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783444319.048276:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fbab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575271680:12345-0@lo:503:mount.lustre.0 20000000:01000000:3.0:1783444319.050875:0:89008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783444319.051446:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fbab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575271680:12345-0@lo:503:mount.lustre.0 Request processed in 3165us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.051480:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 20000000:01000000:2.0:1783444319.051873:0:89006:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444319.051889:0:89006:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783444319.052039:0:89012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444319.052046:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444319.052082:0:89012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052115:0:89012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444319.052128:0:89012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000084444s 00010000:00010000:0.0:1783444319.052146:0:89012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052155:0:89012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052162:0:89012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052170:0:89012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052176:0:89012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444319.052182:0:89012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052191:0:89012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052211:0:89012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052220:0:89012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.052228:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262000/0x42cb6883e383208b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444319.052636:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575271680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444319.054262:0:89016:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3447480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89016:1870073575271808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.055116:0:89016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.055245:0:89016:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444319.055421:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575271808 00000100:00100000:2.0:1783444319.055431:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575271808 00000100:00100000:2.0:1783444319.055496:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783444319.055507:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fbab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89016:x1870073575271808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444319.057513:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fbab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89016:x1870073575271808:12345-0@lo:502:llog_process_th.0 Request processed in 1996us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444319.057543:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783444319.057879:0:89016:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3447480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89016:1870073575271808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444319.058058:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444319.058073:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.058076:0:89016:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783444319.058083:0:89016:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783444319.058086:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783444319.058108:0:89016:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9368dd0e99c0) 00000020:00000080:1.0:1783444319.058216:0:89016:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1783444319.058224:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783444319.058352:0:89016:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783444319.058361:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832099 00000020:00000080:1.0:1783444319.063869:0:89016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783444319.063970:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444319.063981:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.063984:0:89016:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783444319.063988:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444319.063996:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.063998:0:89016:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783444319.064003:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783444319.064023:0:89016:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9368dd0e8000) 00000020:00000080:1.0:1783444319.064059:0:89016:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1783444319.064064:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783444319.064066:0:89016:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783444319.064070:0:89016:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783444319.064077:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783444319.064206:0:89016:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368ff57c000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783444319.064221:0:89016:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9368dd0eb380) 00000020:00000080:1.0:1783444319.064232:0:89016:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1783444319.064305:0:89016:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783444319.064311:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38320ae 00000020:00000080:1.0:1783444319.064473:0:89016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783444319.064480:0:89016:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783444319.064485:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42cb6883e38320b5 00080000:01000000:1.0:1783444319.064492:0:89016:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783444319.064496:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38320bc 20000000:01000000:3.0:1783444319.066431:0:89008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444319.066512:0:89009:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783444319.066848:0:89008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783444319.067130:0:89012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444319.067201:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444319.067232:0:89012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067256:0:89012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444319.067267:0:89012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000084444s 00010000:00010000:0.0:1783444319.067273:0:89012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067282:0:89012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067289:0:89012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067296:0:89012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067303:0:89012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444319.067308:0:89012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067317:0:89012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067334:0:89012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067365:0:89012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.067372:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262a00/0x42cb6883e38320c3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783444319.068082:0:3633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783444319.068086:0:3633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783444319.068088:0:3633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444319.068089:0:3633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444319.068091:0:3633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444319.068093:0:3633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444319.068095:0:3633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444319.068097:0:3633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444319.068099:0:3633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783444319.068107:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575271168:0@lo:253:kworker.0 00000100:00100000:1.0:1783444319.068250:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:3633:x1870073575271168:12345-0@lo:253:kworker.0 Request processed in 35031us (37040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.068263:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783444319.099047:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:3635:x1870073575270912:12345-0@lo:253:kworker.0 Request processed in 65691us (66646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444319.099066:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:1.0:1783444319.099321:0:89009:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783444319.099339:0:89009:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783444319.099692:0:89012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444319.099698:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444319.099728:0:89012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099749:0:89012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444319.099761:0:89012:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000084444s 00010000:00010000:0.0:1783444319.099766:0:89012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099773:0:89012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099780:0:89012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099873:0:89012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099901:0:89012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444319.099907:0:89012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099915:0:89012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099933:0:89012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099942:0:89012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.099950:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262000/0x42cb6883e38320ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783444319.100287:0:3635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783444319.100292:0:3635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783444319.100293:0:3635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444319.100295:0:3635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444319.100296:0:3635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444319.100298:0:3635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444319.100299:0:3635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444319.100302:0:3635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444319.100304:0:3635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783444319.100310:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575270912:0@lo:253:kworker.0 00000100:00100000:0.0:1783444319.101377:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3636:x1870073575271040:12345-0@lo:253:kworker.0 Request processed in 62765us (62896us total) trans 0 rc 0/0 00000020:01000004:1.0:1783444319.101834:0:3636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783444319.101839:0:3636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783444319.101841:0:3636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444319.101842:0:3636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444319.101844:0:3636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444319.101846:0:3636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444319.101847:0:3636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783444319.101848:0:3636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444319.101860:0:3636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783444319.101866:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575271040:0@lo:253:kworker.0 00000100:00100000:0.0:1783444319.102230:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1783444319.197055:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444319.199376:0:89016:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1783444319.199938:0:89016:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 778015c5-4969-44f5-82a5-0f6eadd152d5 idx: 0 lr: 103079215113 srv lr: 107374182400 lx: 0 gen 23 00000001:00080000:2.0:1783444319.200067:0:89016:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 22 00000001:00000004:2.0:1783444319.200122:0:89016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:2.0:1783444319.200274:0:89016:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1783444319.200357:0:89016:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368ca127e40: xid 1870073557767424, transno 107374182405, client gen 23, slot idx 0 00000001:00080000:2.0:1783444319.200368:0:89016:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368ca127300: xid 1870073557767680, transno 107374182406, client gen 23, slot idx 1 00000020:00000080:2.0:1783444319.202293:0:89016:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9367c3333380) 00000020:00000080:2.0:1783444319.202330:0:89016:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1783444319.202454:0:89016:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783444319.202465:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38320e6 00000020:00000080:3.0:1783444319.204776:0:89016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783444319.217720:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42cb6883e38320ed 00000020:00000080:3.0:1783444319.218270:0:89016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783444319.218286:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444319.218295:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444319.218297:0:89016:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783444319.218301:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783444319.218305:0:89016:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783444319.218307:0:89016:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783444319.218309:0:89016:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783444319.218310:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783444319.218313:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444319.218315:0:89016:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783444319.218318:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444319.218324:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444319.218326:0:89016:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783444319.218330:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783444319.218383:0:89016:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783444319.218406:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444319.218410:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444319.218411:0:89016:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783444319.218415:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444319.218418:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444319.218420:0:89016:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783444319.218424:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783444319.218433:0:89016:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:3.0:1783444319.218471:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783444319.218497:0:89016:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9367c1e83380) 00000020:00000080:3.0:1783444319.218519:0:89016:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1783444319.218525:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783444319.218597:0:89016:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783444319.218604:0:89016:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783444319.218612:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38320fb 00010000:00080000:3.0:1783444319.218655:0:89016:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368dd20d000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1783444319.222613:0:89016:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1783444319.227657:0:89016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444319.227679:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783444319.227745:0:89016:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783444319.227778:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832102 00000100:00080000:2.0:1783444319.228508:0:89016:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444319.228520:0:89016:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9368dd20d000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444319.228580:0:89016:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5971180 x1870073575271936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444319.228620:0:89016:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783444319.228732:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575271936:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1783444319.228848:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444319.228854:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444319.228856:0:89016:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783444319.228859:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783444319.228862:0:89016:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1783444319.228864:0:89016:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444319.228866:0:89016:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444319.228867:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783444319.228870:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444319.228871:0:89016:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783444319.228873:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783444319.228901:0:89016:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783444319.228906:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444319.228907:0:89016:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783444319.228911:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783444319.228915:0:89016:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1783444319.228953:0:89016:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783444319.228955:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444319.228973:0:89016:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9367c33319c0) 00000020:00000080:2.0:1783444319.228997:0:89016:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783444319.229000:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1783444319.229065:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575272064:0@lo:400:kworker.0 00000004:00080000:2.0:1783444319.229098:0:89016:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783444319.229106:0:89016:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783444319.229113:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832110 00010000:00080000:2.0:1783444319.229157:0:89016:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ea608000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00000100:00100000:1.0:1783444319.229374:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783444319.229422:0:89016:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1783444319.229559:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.229678:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575271936 00000100:00100000:1.0:1783444319.229691:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575271936 00000100:00100000:2.0:1783444319.229816:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575272064 00000100:00100000:2.0:1783444319.229820:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575272064 00000100:00100000:2.0:1783444319.229865:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783444319.229876:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3634:x1870073575272064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444319.230014:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3634:x1870073575272064:12345-0@lo:400:kworker.0 Request processed in 138us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444319.230024:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783444319.230505:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1783444319.230513:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575271936:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783444319.230544:0:8430:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3310 last 0 00000020:00000080:1.0:1783444319.230595:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832117 00000004:00100000:1.0:1783444319.230614:0:8430:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783444319.230993:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9367c5626800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444319.231080:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575271936:12345-0@lo:38:llog_process_th.0 Request processed in 565us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.231088:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1783444319.231312:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575272064:0@lo:400:kworker.0 00000040:01000000:2.0:1783444319.231333:0:89016:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783444319.231359:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000040:01000000:2.0:1783444319.231367:0:89016:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1783444319.231368:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1783444319.231379:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783444319.231385:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783444319.231399:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd20d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783444319.232265:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575271936:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783444319.232496:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575272192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444319.232564:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.232746:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575272192 00000100:00100000:1.0:1783444319.232755:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575272192 00000040:00080000:2.0:1783444319.233025:0:89016:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:1.0:1783444319.233171:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:1.0:1783444319.233182:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575272192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444319.233225:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444319.233334:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575272192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.233341:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:3.0:1783444319.233474:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575272192:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783444319.241476:0:89016:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783444319.241521:0:89016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:2.0:1783444319.241734:0:89016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:3.0:1783444319.242721:0:89022:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1783444319.242729:0:89022:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783444319.242993:0:89022:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1783444319.243018:0:89022:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783444319.243176:0:89022:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1783444319.243180:0:89022:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783444319.244267:0:89016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444319.244285:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783444319.244339:0:89016:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783444319.244374:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e383211e 00000100:00080000:1.0:1783444319.244389:0:89016:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783444319.244397:0:89016:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368ea608000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444319.244449:0:89016:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3447480 x1870073575272320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444319.244486:0:89016:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783444319.244595:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444319.244600:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.244602:0:89016:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783444319.244604:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783444319.244614:0:89016:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1783444319.244617:0:89016:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783444319.244619:0:89016:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783444319.244620:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783444319.244623:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.244624:0:89016:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783444319.244627:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783444319.244632:0:89016:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783444319.244636:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.244637:0:89016:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783444319.244641:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783444319.244645:0:89016:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:1.0:1783444319.244676:0:89016:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783444319.244679:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783444319.244692:0:89016:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9368dd0ecd40) 00000020:00000080:1.0:1783444319.244711:0:89016:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783444319.244717:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783444319.244840:0:89016:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783444319.244849:0:89016:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783444319.244856:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e383212c 00010000:00080000:1.0:1783444319.244908:0:89016:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ef0b1000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1783444319.245142:0:89016:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1783444319.245227:0:89016:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783444319.245245:0:89016:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1783444319.245543:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575272320:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783444319.245641:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.245984:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575272320 00000100:00100000:1.0:1783444319.245995:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575272320 00000100:00100000:1.0:1783444319.246042:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5870 00000100:00100000:1.0:1783444319.246050:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3632:x1870073575272320:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783444319.246084:0:26199:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3310 last 0 00000020:00000080:1.0:1783444319.246112:0:26199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832133 00002000:00100000:1.0:1783444319.246128:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9368c3fa5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783444319.246140:0:26199:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783444319.246144:0:26199:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783444319.246259:0:26199:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783444319.246289:0:26199:0:(import.c:65:import_set_state_nolock()) ffff9368c3fa7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444319.246535:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575272320:12345-0@lo:8:llog_process_th.0 Request processed in 483us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.246544:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5870 00000040:00080000:1.0:1783444319.246711:0:89016:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:0.0:1783444319.247598:0:89016:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783444319.247633:0:89016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:0.0:1783444319.247978:0:89016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:0.0:1783444319.248502:0:89024:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:0.0:1783444319.248508:0:89024:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783444319.248663:0:89024:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:0.0:1783444319.248680:0:89024:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783444319.249197:0:89024:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:0.0:1783444319.249202:0:89024:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1783444319.249429:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783444319.249445:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783444319.249466:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783444319.249474:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783444319.249479:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ea608000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783444319.249503:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783444319.249515:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575272320:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783444319.249676:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575272448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444319.249768:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.249852:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575272448 00000100:00100000:3.0:1783444319.249860:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575272448 00000100:00100000:3.0:1783444319.249949:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:3.0:1783444319.249960:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575272448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444319.249999:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444319.250051:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575272448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.250058:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00080000:3.0:1783444319.250083:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444319.250114:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575272448:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1783444319.250134:0:89022:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783444319.250198:0:89022:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3310292408904ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783444319.250205:0:89022:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:00000080:1.0:1783444319.251545:0:89016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444319.251566:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783444319.251636:0:89016:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783444319.251668:0:89016:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e383213a 00000100:00080000:1.0:1783444319.251679:0:89016:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783444319.251686:0:89016:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9368ef0b1000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444319.251731:0:89016:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3446680 x1870073575272576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444319.252245:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575272576:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783444319.252488:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444319.252601:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575272576 00000100:00100000:0.0:1783444319.252611:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575272576 00000100:00100000:0.0:1783444319.252675:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5871 00000100:00100000:0.0:1783444319.252686:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3632:x1870073575272576:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783444319.252725:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3310 last 0 00000020:00000080:0.0:1783444319.252764:0:26209:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832141 00002000:00100000:0.0:1783444319.252783:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9368c9a10800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783444319.252817:0:26209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783444319.252820:0:26209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783444319.252943:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783444319.252977:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9368c9a17800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783444319.253375:0:89016:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783444319.253548:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444319.253554:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.253557:0:89016:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783444319.253561:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444319.253567:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.253569:0:89016:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783444319.253572:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783444319.253574:0:89016:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783444319.253577:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444319.253580:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.253581:0:89016:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783444319.253583:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444319.253586:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.253595:0:89016:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783444319.253600:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783444319.253648:0:89016:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89016:1870073575272704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.253716:0:89016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.253759:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575272704 00000100:00100000:1.0:1783444319.253766:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575272704 00000100:00100000:1.0:1783444319.253825:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783444319.253833:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:89016:x1870073575272704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.253970:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:89016:x1870073575272704:12345-0@lo:502:llog_process_th.0 Request processed in 136us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.253979:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783444319.254042:0:89016:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eb63e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.254067:0:89016:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89016:1870073575272704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444319.254098:0:89016:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444319.254102:0:89016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.254104:0:89016:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783444319.254108:0:89016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1783444319.254200:0:89001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783444319.254239:0:89001:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783444319.254259:0:89001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.254273:0:89001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444319.254283:0:89001:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ff57c000 from 1 10000000:01000000:1.0:1783444319.254286:0:89001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783444319.254320:0:89001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.254341:0:89001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.254352:0:89001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444319.254366:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575272832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444319.254400:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.254421:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eb63e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.259921:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575272832 00000100:00100000:1.0:1783444319.259947:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575272832 00000100:00100000:1.0:1783444319.260025:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783444319.260038:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:89001:x1870073575272832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444319.260062:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444319.260088:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832148 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.260122:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832148 expref: 9 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.260134:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832148 expref: 9 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.260144:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27400, rc 0) 00000100:00100000:1.0:1783444319.260250:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:89001:x1870073575272832:12345-0@lo:101:mount.lustre.0 Request processed in 214us (5849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.260257:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783444319.260358:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575272832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444319.260381:0:89001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.260392:0:89001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444319.261047:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575272960:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783444319.261110:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.261166:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eb63e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444319.261394:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575272960 00000100:00100000:3.0:1783444319.261401:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575272960 00000100:00100000:3.0:1783444319.261457:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783444319.261467:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:89001:x1870073575272960:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783444319.261500:0:89014:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783444319.261523:0:89014:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783444319.261527:0:89014:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783444319.261531:0:89014:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783444319.261534:0:89014:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 114 00000100:00100000:3.0:1783444319.261637:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:89001:x1870073575272960:12345-0@lo:256:mount.lustre.0 Request processed in 171us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.261646:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783444319.261849:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575272960:0@lo:256:mount.lustre.0 00000004:00080000:3.0:1783444319.262212:0:89002:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783444319.264068:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575272576:12345-0@lo:8:llog_process_th.0 Request processed in 11370us (11569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444319.264085:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5871 00000100:00100000:2.0:1783444319.264252:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783444319.264268:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783444319.264279:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783444319.264288:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783444319.264293:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef0b1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783444319.264316:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783444319.264326:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575272576:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1783444319.264431:0:89024:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783444319.264568:0:89024:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3310306778815ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783444319.264576:0:89024:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783444319.264998:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575273088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444319.265082:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1783444319.265473:0:89001:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783444319.265495:0:89001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.265509:0:89001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444319.265520:0:89001:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ff57c000 from 1 10000000:01000000:1.0:1783444319.265524:0:89001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783444319.265563:0:89001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.265573:0:89001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.265584:0:89001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444319.265623:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444319.265667:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.265703:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eb63e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.265733:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575273216 00000100:00100000:1.0:1783444319.265742:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575273216 00000100:00100000:1.0:1783444319.265830:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783444319.265844:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:89001:x1870073575273216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444319.265862:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444319.265882:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26400/0x42cb6883e383215d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832156 expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444319.266218:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575273088 00000100:00100000:3.0:1783444319.266224:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575273088 00000100:00100000:3.0:1783444319.266295:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:3.0:1783444319.266303:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575273088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444319.266337:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444319.266400:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575273088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.266407:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00080000:2.0:1783444319.266780:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444319.266859:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575273088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783444319.268003:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26400/0x42cb6883e383215d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832156 expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.268020:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26400/0x42cb6883e383215d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832156 expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.268031:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26400, rc 0) 00000100:00100000:1.0:1783444319.268109:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89001:x1870073575273216:12345-0@lo:101:mount.lustre.0 Request processed in 2268us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.268118:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783444319.268502:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444319.268526:0:89001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.268538:0:89001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444319.268645:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444319.268704:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444319.268874:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c4848e40 going to sleep for 11 seconds 00000004:00080000:2.0:1783444319.269440:0:89002:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783444319.270947:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575273344 00000100:00100000:3.0:1783444319.270967:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575273344 00000100:00100000:3.0:1783444319.271078:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783444319.271090:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89001:x1870073575273344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444319.271341:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89001:x1870073575273344:12345-0@lo:501:mount.lustre.0 Request processed in 253us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.271350:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783444319.271450:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444319.271526:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444319.271590:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444319.276087:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c4848e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.277303:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575273472 00000100:00100000:1.0:1783444319.277323:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575273472 00000100:00100000:1.0:1783444319.277415:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783444319.277428:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89001:x1870073575273472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444319.277676:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89001:x1870073575273472:12345-0@lo:503:mount.lustre.0 Request processed in 250us (6084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.277691:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783444319.278057:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444319.281588:0:89026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89026:1870073575273600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.281716:0:89026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.281776:0:89026:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eb63e840 going to sleep for 11 seconds 00000100:00100000:2.0:1783444319.281912:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575273600 00000100:00100000:2.0:1783444319.281922:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575273600 00000100:00100000:2.0:1783444319.281982:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783444319.281993:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89026:x1870073575273600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444319.283633:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89026:x1870073575273600:12345-0@lo:502:llog_process_th.0 Request processed in 1632us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444319.283650:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783444319.283901:0:89026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89026:1870073575273600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444319.283955:0:89026:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444319.283971:0:89026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.283974:0:89026:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783444319.283987:0:89026:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9368ff57c000 00000020:00000080:1.0:1783444319.283990:0:89026:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783444319.284001:0:89026:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444319.284004:0:89026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.284006:0:89026:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783444319.284009:0:89026:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444319.284012:0:89026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.284013:0:89026:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783444319.284017:0:89026:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9368ff57c000 00000020:00000080:1.0:1783444319.284019:0:89026:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783444319.284142:0:89026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89026:1870073575273728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.284204:0:89026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.284265:0:89026:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eb63e840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444319.284372:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575273728 00000100:00100000:3.0:1783444319.284382:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575273728 00000100:00100000:3.0:1783444319.284445:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783444319.284455:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89026:x1870073575273728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444319.284598:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89026:x1870073575273728:12345-0@lo:502:llog_process_th.0 Request processed in 144us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.284606:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783444319.284696:0:89026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89026:1870073575273728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444319.284719:0:89026:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444319.284723:0:89026:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444319.284724:0:89026:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783444319.284729:0:89026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783444319.287998:0:89001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1783444319.288063:0:89001:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783444319.288101:0:89001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.288118:0:89001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444319.288205:0:89001:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783444319.288209:0:89001:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9368ff57c000 10000000:01000000:3.0:1783444319.288213:0:89001:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9368ff57c000 10000000:01000000:3.0:1783444319.288218:0:89001:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783444319.288226:0:89001:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ff57c000 from 1 10000000:01000000:3.0:1783444319.288230:0:89001:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444319.288283:0:89001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.288292:0:89001:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.288305:0:89001:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444319.288335:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783444319.288430:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.288592:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444319.301527:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575273856 00000100:00100000:0.0:1783444319.301551:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575273856 00000100:00100000:0.0:1783444319.302069:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783444319.302084:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:89001:x1870073575273856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444319.302111:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444319.302136:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef262000/0x42cb6883e383216b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832164 expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.302190:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262000/0x42cb6883e383216b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832164 expref: 11 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.302205:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef262000/0x42cb6883e383216b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832164 expref: 11 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444319.302216:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef262000, rc 0) 00000100:00100000:0.0:1783444319.302333:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575273856:12345-0@lo:101:mount.lustre.0 Request processed in 253us (13903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444319.302341:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783444319.304488:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444319.304530:0:89001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.304546:0:89001:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444319.307126:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444319.307337:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.307400:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def480 going to sleep for 11 seconds 00000100:00100000:3.0:1783444319.307441:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575273984 00000100:00100000:3.0:1783444319.307451:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575273984 00000100:00100000:3.0:1783444319.307522:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783444319.307532:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575273984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444319.307545:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444319.307578:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557774720 00000100:00100000:2.0:1783444319.307581:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557774720 00000100:00100000:2.0:1783444319.307647:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 921 00000100:00100000:2.0:1783444319.307655:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557774720:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444319.307731:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557774720:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444319.307740:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 921 00000100:00080000:2.0:1783444319.307767:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444319.309820:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575273984:12345-0@lo:501:mount.lustre.0 Request processed in 2256us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.309844:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783444319.309976:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575273984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444319.310055:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575274112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444319.310127:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.310350:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444319.311450:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575274112 00000100:00100000:0.0:1783444319.311467:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575274112 00000100:00100000:0.0:1783444319.311576:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783444319.311588:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575274112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783444319.311784:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575274112:12345-0@lo:503:mount.lustre.0 Request processed in 196us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444319.311831:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783444319.313384:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575274112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444319.313503:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444319.313571:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444319.313729:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557774592 00000100:00100000:3.0:1783444319.313738:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557774592 00000100:00100000:3.0:1783444319.313780:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1192 00000100:00100000:3.0:1783444319.313806:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557774592:12345-192.168.204.20@tcp:38:kworker.0 00000100:00100000:3.0:1783444319.314328:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557774592:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 536us (826us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783444319.314339:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1192 00000100:00100000:2.0:1783444319.314503:0:89029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89029:1870073575274240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444319.314573:0:89029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444319.314622:0:89029:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3240e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.314776:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557774848 00000100:00100000:1.0:1783444319.314783:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557774848 00000100:00100000:1.0:1783444319.314835:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575274240 00000100:00100000:1.0:1783444319.314838:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575274240 00000100:00100000:1.0:1783444319.314882:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1783444319.315156:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783444319.315230:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89029:x1870073575274240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444319.315397:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89029:x1870073575274240:12345-0@lo:502:llog_process_th.0 Request processed in 170us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.315404:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783444319.315488:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2400:x1870073557774848:12345-192.168.204.20@tcp:250:kworker.0 00010000:00080000:1.0:1783444319.315513:0:89014:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fea1b1de-aca2-4501-86bf-fe28138c0593@192.168.204.20@tcp t0 exp 0000000000000000 cur 3310 last 0 00000020:00000080:1.0:1783444319.315553:0:89014:0:(genops.c:1406:class_connect()) connect: client fea1b1de-aca2-4501-86bf-fe28138c0593, cookie 0x42cb6883e3832172 00000100:00080000:1.0:1783444319.315727:0:89014:0:(import.c:65:import_set_state_nolock()) ffff9368ef0cf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444319.315930:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+5:2400:x1870073557774848:12345-192.168.204.20@tcp:250:kworker.0 Request processed in 1040us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.315939:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1783444319.317931:0:89029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89029:1870073575274240:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783444319.318024:0:89029:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783444319.318044:0:89029:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9367c3334d40) 00000020:00000080:2.0:1783444319.318076:0:89029:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783444319.318305:0:89029:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368ff57c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783444319.318311:0:89029:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ff57c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783444319.318314:0:89029:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ff57c000 4 00010000:00080000:2.0:1783444319.318349:0:89029:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ea5f7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1783444319.320258:0:89029:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1783444319.320411:0:89029:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783444319.320472:0:89029:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783444319.320491:0:89029:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42cb6883e3832180 00000100:00080000:2.0:1783444319.320505:0:89029:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444319.320513:0:89029:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9368ea5f7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444319.320564:0:89029:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5970380 x1870073575274368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444319.320605:0:89029:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783444319.321038:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575274368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783444319.321232:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.321406:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575274368 00000100:00100000:1.0:1783444319.321417:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575274368 00000100:00100000:1.0:1783444319.321460:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1783444319.321469:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575274368:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783444319.321556:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575274368:12345-0@lo:38:llog_process_th.0 Request processed in 86us (325us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783444319.321564:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1783444319.321681:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783444319.321690:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444319.321695:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783444319.321700:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575274368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783444319.323537:0:89029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89029:1870073575274496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444319.323634:0:89029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444319.323691:0:89029:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.323748:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575274496 00000100:00100000:1.0:1783444319.323758:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575274496 00000100:00100000:1.0:1783444319.323850:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783444319.323861:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89029:x1870073575274496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.324226:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89029:x1870073575274496:12345-0@lo:502:llog_process_th.0 Request processed in 302us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.324236:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783444319.324310:0:89029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89029:1870073575274496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.324365:0:89029:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89029:1870073575274624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.324407:0:89029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444319.324437:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575274624 00000100:00100000:1.0:1783444319.324441:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575274624 00000100:00100000:1.0:1783444319.324468:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783444319.324474:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89029:x1870073575274624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444319.324534:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89029:x1870073575274624:12345-0@lo:502:llog_process_th.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.324541:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783444319.324581:0:89029:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eb63ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444319.324592:0:89029:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:89029:1870073575274624:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444319.324609:0:89029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783444319.324765:0:89001:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783444319.324990:0:89001:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444319.325021:0:89001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.325035:0:89001:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783444319.325098:0:89001:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783444319.325101:0:89001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444319.325103:0:89001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444319.325104:0:89001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444319.325106:0:89001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444319.325107:0:89001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444319.325109:0:89001:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444319.325111:0:89001:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444319.325113:0:89001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444319.325506:0:89001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783444319.325512:0:89001:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783444319.325515:0:89001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783444319.325517:0:89001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444319.325518:0:89001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444319.325519:0:89001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444319.325528:0:89001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444319.325529:0:89001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444319.325531:0:89001:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444319.325532:0:89001:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444319.325533:0:89001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444319.325534:0:89001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783444319.325614:0:89001:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783444319.325687:0:89001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575274752:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783444319.325747:0:89001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.326196:0:89001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c328fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444319.326346:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575274752 00000100:00100000:0.0:1783444319.326354:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575274752 00000100:00100000:0.0:1783444319.326414:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783444319.326425:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575274752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783444319.326462:0:89008:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783444319.326483:0:89008:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783444319.337418:0:89008:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783444319.337449:0:89008:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783444319.338195:0:89012:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783444319.338203:0:89012:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783444319.338239:0:89012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.338267:0:89012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832148 expref: 11 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.338303:0:89012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.338358:0:89012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832148 expref: 11 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.338375:0:89012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832148 expref: 11 pid: 89009 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444319.338393:0:89012:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89012:1870073575274880:0@lo:104: 00000100:00100000:2.0:1783444319.339769:0:89012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.340066:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783444319.340067:0:89012:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3240cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444319.340098:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575274880 00000100:00100000:3.0:1783444319.340109:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575274880 00000100:00100000:3.0:1783444319.340195:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1783444319.340205:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c725d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:89012:x1870073575274880:12345-0@lo:104: 00010000:00010000:3.0:1783444319.340223:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.340305:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783444319.340312:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c725d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:89012:x1870073575274880:12345-0@lo:104: Request processed in 109us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.340319:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:3.0:1783444319.340397:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444319.340404:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.340411:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444319.340417:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.340427:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444319.340472:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444319.340479:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783444319.340528:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.340535:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444319.340572:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.340582:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e3832148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383214f expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444319.340602:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444319.340604:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444319.340606:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444319.340641:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575275008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444319.340679:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444319.341208:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:89001:x1870073575274752:12345-0@lo:253:mount.lustre.0 Request processed in 14782us (15456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444319.341221:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783444319.341682:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575275008 00000100:00100000:1.0:1783444319.341691:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575275008 00010000:00010000:1.0:1783444319.341725:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832148 expref: 11 pid: 89009 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444319.341830:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1783444319.341840:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:3634:x1870073575275008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444319.341857:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444319.341864:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832148 expref: 11 pid: 89009 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.341880:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832148 expref: 11 pid: 89009 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.341919:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.341945:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783444319.341965:0:6492:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003762824s 00010000:00010000:1.0:1783444319.341971:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.341973:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27400/0x42cb6883e383214f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832148 expref: 11 pid: 89009 timeout: 3410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.341988:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444319.341997:0:89012:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89012:1870073575274880:0@lo:104: 00010000:00010000:1.0:1783444319.341999:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.342010:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.342017:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444319.342022:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.342027:0:89012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.342032:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.342043:0:89012:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40219400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.342046:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.342054:0:89012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444319.342063:0:89012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c10800/0x42cb6883e3832187 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444319.342079:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444319.342142:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:3634:x1870073575275008:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444319.342150:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:3.0:1783444319.342204:0:89001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:89001:1870073575274752:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783444319.342219:0:89001:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783444319.342223:0:89001:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783444319.342225:0:89001:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444319.342227:0:89001:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444319.342228:0:89001:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444319.342229:0:89001:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444319.342230:0:89001:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444319.342233:0:89001:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444319.342234:0:89001:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444319.342237:0:89001:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444319.342245:0:89001:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783444319.342263:0:89001:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1783444319.344301:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575275008:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1783444319.364766:0:89001:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:1.0:1783444319.368707:0:89001:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783444319.368965:0:89034:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:3.0:1783444319.368970:0:89034:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:2.0:1783444319.369766:0:89035:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783444319.369987:0:89001:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1783444319.370484:0:89035:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783444319.371659:0:89036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89036:1870073575275136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444319.371762:0:89036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.371832:0:89036:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c44249c0 going to sleep for 11 seconds 00000040:00080000:0.0:1783444319.372249:0:89035:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783444319.372355:0:89035:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1783444319.373088:0:89001:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783444319.373581:0:89001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783444319.374510:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575275136 00000100:00100000:2.0:1783444319.374528:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575275136 00000100:00100000:2.0:1783444319.374616:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:2.0:1783444319.374629:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89036:x1870073575275136:12345-0@lo:1000:lod0000_rec0001.0 00000004:00000080:1.0:1783444319.374803:0:89001:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783444319.374817:0:89001:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:2.0:1783444319.374997:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89036:x1870073575275136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 368us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444319.375007:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:3.0:1783444319.375054:0:89036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89036:1870073575275136:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783444319.375233:0:89036:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783444319.375299:0:89036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89036:1870073575275264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444319.375357:0:89036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.375401:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575275264 00000100:00100000:3.0:1783444319.375406:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575275264 00000100:00100000:3.0:1783444319.375524:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:3.0:1783444319.375533:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89036:x1870073575275264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444319.375652:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89036:x1870073575275264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.375658:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:3.0:1783444319.375682:0:89036:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c4424840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444319.375696:0:89036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89036:1870073575275264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444319.375761:0:89036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89036:1870073575275392:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444319.375816:0:89036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444319.375839:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575275392 00000100:00100000:3.0:1783444319.375843:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575275392 00000040:00080000:1.0:1783444319.376599:0:89001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783444319.377584:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1783444319.377606:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89036:x1870073575275392:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444319.377751:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89036:x1870073575275392:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 155us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444319.377760:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1783444319.377810:0:89036:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c4424840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444319.377843:0:89036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89036:1870073575275392:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783444319.382462:0:89001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783444319.382868:0:89036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783444319.384478:0:89001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783444319.384564:0:89001:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783444319.384958:0:89001:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783444319.386321:0:89001:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:1.0:1783444319.389339:0:89001:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182406 00000040:00080000:3.0:1783444319.391177:0:89036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783444319.391310:0:89036:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783444319.391316:0:89036:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1783444319.392203:0:89037:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 89037 00010000:02000000:1.0:1783444319.392529:0:89037:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783444319.392533:0:89037:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783444319.392537:0:89037:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783444319.393163:0:89001:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783444319.393190:0:89001:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783444319.393218:0:89001:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783444319.393263:0:89001:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783444319.394638:0:89001:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783444319.395001:0:89001:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783444320.222493:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783444320.925002:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783444320.925015:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ff57c000 from 115 10000000:01000000:3.0:1783444320.925023:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783444320.925100:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.925115:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.925131:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444320.925175:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575275520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.925301:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444320.925950:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575275520 00000100:00100000:0.0:1783444320.925962:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575275520 00000100:00100000:0.0:1783444320.926055:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783444320.926066:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:6503:x1870073575275520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444320.926089:0:89006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444320.926110:0:89006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef262600/0x42cb6883e3832195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383218e expref: -99 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.926143:0:89006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262600/0x42cb6883e3832195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383218e expref: 11 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.926313:0:89006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef262600/0x42cb6883e3832195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383218e expref: 11 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.926327:0:89006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef262600, rc 0) 00000100:00100000:0.0:1783444320.926464:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575275520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 399us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444320.926472:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783444320.926967:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c44249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.927001:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575275520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444320.927022:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.927048:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444320.927618:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575275648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.927676:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444320.927704:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c44249c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444320.927923:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575275648 00000100:00100000:0.0:1783444320.927931:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575275648 00000100:00100000:0.0:1783444320.927987:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783444320.927998:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575275648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783444320.928021:0:89015:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783444320.928043:0:89015:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783444320.928047:0:89015:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 115 00000100:00100000:0.0:1783444320.928156:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575275648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444320.928166:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783444320.928472:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575275648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783444320.928551:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783444320.928561:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444320.928572:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444320.928584:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783444320.928587:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 52 10000000:01000000:2.0:1783444320.928590:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783444320.928624:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444320.928633:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444320.928650:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444320.928667:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575275776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.928701:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444320.928737:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e3834b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.928924:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575275776 00000100:00100000:3.0:1783444320.928930:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575275776 00000100:00100000:3.0:1783444320.928974:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783444320.928982:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575275776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444320.928994:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444320.929012:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04000/0x42cb6883e38321a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383219c expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.929037:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04000/0x42cb6883e38321a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383219c expref: 12 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.929048:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04000/0x42cb6883e38321a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383219c expref: 12 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.929058:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04000, rc 0) 00000100:00100000:3.0:1783444320.929091:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575275776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.929098:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783444320.929519:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575275776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444320.929536:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444320.929546:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38321a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444320.929626:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575275904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.929656:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444320.929690:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e3834b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.929921:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575275904 00000100:00100000:3.0:1783444320.929926:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575275904 00000100:00100000:3.0:1783444320.930003:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783444320.930022:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575275904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.930182:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575275904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.930190:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783444320.930260:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575275904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.930299:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.930341:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444320.935310:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e3834b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444320.936519:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575276032 00000100:00100000:0.0:1783444320.936536:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575276032 00000100:00100000:0.0:1783444320.936621:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783444320.936642:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575276032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.937992:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575276032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1344us (7641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444320.938006:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783444320.938154:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444320.942146:0:89098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783444320.942293:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783444320.942334:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444320.943710:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.943733:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444320.943749:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783444320.943753:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cd800 from 112 10000000:01000000:0.0:1783444320.943757:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783444320.944206:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.944217:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.944233:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444320.944268:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.945054:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444320.945206:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d240 going to sleep for 11 seconds 00000100:00100000:2.0:1783444320.955720:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575276160 00000100:00100000:2.0:1783444320.955744:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575276160 00000100:00100000:3.0:1783444320.956347:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783444320.956373:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575276160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444320.956399:0:89006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444320.956425:0:89006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05600/0x42cb6883e38321b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38321aa expref: -99 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.956460:0:89006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05600/0x42cb6883e38321b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38321aa expref: 13 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.956474:0:89006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05600/0x42cb6883e38321b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38321aa expref: 13 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.956485:0:89006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05600, rc 0) 00000100:00100000:3.0:1783444320.956597:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575276160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (11545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.956605:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783444320.958594:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444320.958627:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.958642:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38321b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444320.958739:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783444320.958889:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444320.958944:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2154180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444320.958985:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575276288 00000100:00100000:1.0:1783444320.958993:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575276288 00000100:00100000:1.0:1783444320.959051:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783444320.959061:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575276288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783444320.959089:0:89008:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783444320.959115:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783444320.959119:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783444320.959122:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783444320.959125:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783444320.959127:0:89008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:1.0:1783444320.959229:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575276288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444320.959239:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783444320.959288:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783444320.959370:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783444320.959379:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.959389:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444320.959398:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783444320.959401:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1783444320.959405:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783444320.959434:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.959443:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.959465:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444320.959481:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444320.959508:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444320.959524:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2154180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444320.960774:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575276416 00000100:00100000:2.0:1783444320.960801:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575276416 00000100:00100000:2.0:1783444320.960888:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783444320.960900:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575276416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444320.960926:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444320.960947:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4c11800/0x42cb6883e38321bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38321b8 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444320.960982:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c11800/0x42cb6883e38321bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38321b8 expref: 14 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444320.960995:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4c11800/0x42cb6883e38321bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38321b8 expref: 14 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444320.961006:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11800, rc 0) 00000100:00100000:2.0:1783444320.961075:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575276416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444320.961088:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783444320.962301:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444320.962333:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.962347:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38321bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444320.962520:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444320.962578:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444320.962670:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2154180 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.965483:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575276544 00000100:00100000:3.0:1783444320.965503:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575276544 00000100:00100000:3.0:1783444320.965637:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783444320.965651:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575276544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.965970:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575276544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.965978:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783444320.966106:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.966176:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.966236:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444320.971066:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575276672 00000100:00100000:1.0:1783444320.971088:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575276672 00000100:00100000:1.0:1783444320.971191:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783444320.971203:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575276672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444320.971667:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e3834540 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.975364:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575276672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4139us (9103us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.975382:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783444320.975927:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444320.976875:0:89101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1783444320.977454:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1783444320.977494:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783444320.977509:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.977522:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444320.977534:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1783444320.977537:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ef0cd800 from 1 10000000:01000000:3.0:1783444320.977540:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783444320.977595:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.977605:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.977617:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444320.977647:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.977726:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444320.977779:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c44243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444320.977883:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575276800 00000100:00100000:0.0:1783444320.977893:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575276800 00000100:00100000:0.0:1783444320.977964:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783444320.977976:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575276800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444320.977993:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444320.978009:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef262e00/0x42cb6883e38321cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38321c6 expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.978042:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262e00/0x42cb6883e38321cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38321c6 expref: 15 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.978056:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef262e00/0x42cb6883e38321cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38321c6 expref: 15 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.978067:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef262e00, rc 0) 00000100:00100000:0.0:1783444320.978109:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575276800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444320.978116:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783444320.978276:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444320.978293:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.978322:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38321cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444320.978343:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783444320.978347:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.978566:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444320.978575:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783444320.978578:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef0cd800 from 7 10000000:01000000:3.0:1783444320.978581:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783444320.978604:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.978612:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.978620:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444320.978635:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.978667:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444320.978701:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c44243c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444320.978881:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575276928 00000100:00100000:1.0:1783444320.978888:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575276928 00000100:00100000:1.0:1783444320.978920:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783444320.978928:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575276928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444320.978937:0:89015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444320.978958:0:89015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27800/0x42cb6883e38321db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38321d4 expref: -99 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.978975:0:89015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27800/0x42cb6883e38321db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38321d4 expref: 16 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.978985:0:89015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27800/0x42cb6883e38321db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38321d4 expref: 16 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.978993:0:89015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27800, rc 0) 00000100:00100000:1.0:1783444320.979039:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575276928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444320.979046:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783444320.979150:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575276928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444320.979164:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444320.979172:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38321db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444320.979253:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.979283:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444320.979313:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e38340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.979376:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575277056 00000100:00100000:3.0:1783444320.979381:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575277056 00000100:00100000:3.0:1783444320.979418:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783444320.979426:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575277056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.979561:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575277056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.979569:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783444320.979712:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.979748:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.979820:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444320.979842:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e38340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.979903:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575277184 00000100:00100000:3.0:1783444320.979908:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575277184 00000100:00100000:3.0:1783444320.979940:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783444320.979947:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575277184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.980036:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575277184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.980043:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783444320.980126:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444320.986062:0:89102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444320.986283:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444320.986313:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444320.986329:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.986342:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444320.986421:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444320.986426:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 52 10000000:01000000:0.0:1783444320.986429:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444320.986494:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.986503:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.986517:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444320.986550:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff662a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.986647:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444320.986737:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d240 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.986781:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575277312 00000100:00100000:3.0:1783444320.986928:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575277312 00000100:00100000:3.0:1783444320.986999:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783444320.987011:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575277312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444320.987030:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444320.987046:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05e00/0x42cb6883e38321e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38321e2 expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.987073:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05e00/0x42cb6883e38321e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38321e2 expref: 17 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.987084:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05e00/0x42cb6883e38321e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38321e2 expref: 17 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.987094:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05e00, rc 0) 00000100:00100000:3.0:1783444320.987139:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575277312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.987153:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783444320.987206:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff662a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444320.987219:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444320.987228:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38321e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444320.987292:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.987317:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444320.987336:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c44243c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.987459:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575277440 00000100:00100000:3.0:1783444320.987465:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575277440 00000100:00100000:3.0:1783444320.987495:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783444320.987501:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575277440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.987678:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575277440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.987686:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783444320.988158:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.988198:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.988247:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444320.988311:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444320.989278:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575277568 00000100:00100000:1.0:1783444320.989289:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575277568 00000100:00100000:1.0:1783444320.989343:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783444320.989353:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575277568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.989543:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444320.989580:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575277568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444320.989589:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:1.0:1783444320.990660:0:89105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783444320.991073:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783444320.991105:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444320.991118:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.991132:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444320.991144:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783444320.991147:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1783444320.991150:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783444320.991204:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.991212:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.991223:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444320.991249:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.991312:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444320.991449:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575277696 00000100:00100000:1.0:1783444320.991459:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575277696 00000100:00100000:0.0:1783444320.991549:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444320.991616:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783444320.991627:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575277696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444320.991644:0:89006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444320.991661:0:89006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27200/0x42cb6883e38321f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38321f0 expref: -99 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.991702:0:89006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27200/0x42cb6883e38321f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38321f0 expref: 18 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.991714:0:89006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27200/0x42cb6883e38321f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38321f0 expref: 18 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.991725:0:89006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27200, rc 0) 00000100:00100000:1.0:1783444320.991782:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575277696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444320.991812:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783444320.991908:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444320.991923:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.991934:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38321f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444320.991995:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.992020:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444320.992106:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.992143:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575277824 00000100:00100000:3.0:1783444320.992148:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575277824 00000100:00100000:3.0:1783444320.992215:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783444320.992223:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575277824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444320.992464:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575277824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444320.992471:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783444320.992535:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.992564:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.992604:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444320.992618:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444320.992647:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575277952 00000100:00100000:0.0:1783444320.992660:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575277952 00000100:00100000:0.0:1783444320.992690:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783444320.992697:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575277952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444320.994765:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575277952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2055us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444320.994802:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783444320.995074:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575277952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444320.996548:0:89106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1783444320.996728:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1783444320.996755:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783444320.996771:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.997075:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38321f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444320.997091:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783444320.997095:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368f9acf800 from 7 10000000:01000000:1.0:1783444320.997099:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783444320.997150:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.997159:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.997179:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444320.997209:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444320.997287:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444320.997335:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2154cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444320.997455:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575278080 00000100:00100000:0.0:1783444320.997463:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575278080 00000100:00100000:0.0:1783444320.997520:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783444320.997530:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575278080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444320.997548:0:89009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444320.997563:0:89009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef263600/0x42cb6883e3832205 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38321fe expref: -99 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.997591:0:89009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef263600/0x42cb6883e3832205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38321fe expref: 19 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.997603:0:89009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef263600/0x42cb6883e3832205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38321fe expref: 19 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444320.997613:0:89009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef263600, rc 0) 00000100:00100000:0.0:1783444320.997928:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575278080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 398us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444320.997936:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783444320.998095:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444320.998111:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832205 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444320.998122:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832205 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444320.998196:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444320.998226:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444320.998336:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2154cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444320.999510:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575278208 00000100:00100000:3.0:1783444320.999524:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575278208 00000100:00100000:2.0:1783444320.999636:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783444320.999648:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f95bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575278208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444320.999875:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f95bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575278208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444320.999884:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783444320.999942:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444320.999999:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.000052:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.000099:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444321.000894:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575278336 00000100:00100000:2.0:1783444321.000903:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575278336 00000100:00100000:2.0:1783444321.000943:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783444321.000952:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f95be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575278336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444321.001108:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f95be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575278336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444321.001115:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783444321.002566:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444321.004311:0:89107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444321.004448:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444321.004479:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444321.004495:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832205 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.004510:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832205 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444321.004521:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444321.004524:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 52 10000000:01000000:0.0:1783444321.004527:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444321.004580:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.004590:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.004602:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.004633:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.004719:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.004779:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444321.008652:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575278464 00000100:00100000:3.0:1783444321.008676:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575278464 00000100:00100000:3.0:1783444321.008765:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783444321.008779:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d3783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575278464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444321.008821:0:89006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444321.008847:0:89006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04800/0x42cb6883e3832213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383220c expref: -99 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.008896:0:89006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04800/0x42cb6883e3832213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383220c expref: 20 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.008911:0:89006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04800/0x42cb6883e3832213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383220c expref: 20 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.008923:0:89006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04800, rc 0) 00000100:00100000:3.0:1783444321.009035:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d3783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575278464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (4316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.009044:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783444321.009984:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444321.010012:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832213 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.010026:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832213 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.010159:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.010219:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.010273:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444321.011190:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575278592 00000100:00100000:3.0:1783444321.011205:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575278592 00000100:00100000:3.0:1783444321.011278:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783444321.011289:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575278592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444321.011565:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575278592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.011586:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783444321.011713:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.011770:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.011866:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.011898:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444321.012608:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575278720 00000100:00100000:3.0:1783444321.012617:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575278720 00000100:00100000:3.0:1783444321.012669:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783444321.012678:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575278720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444321.013735:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575278720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1051us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.013747:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783444321.014065:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444321.015255:0:89109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783444321.020323:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783444321.020380:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444321.020398:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832213 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.020415:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832213 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444321.020443:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783444321.020448:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783444321.020452:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444321.021341:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.021355:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.021372:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.021421:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.021527:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.021579:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444321.021607:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575278848 00000100:00100000:3.0:1783444321.021617:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575278848 00000100:00100000:3.0:1783444321.021686:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783444321.021697:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575278848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444321.021717:0:89006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444321.021737:0:89006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383221a expref: -99 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.021771:0:89006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383221a expref: 21 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.021785:0:89006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383221a expref: 21 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.021829:0:89006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04e00, rc 0) 00000100:00100000:3.0:1783444321.021894:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575278848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.021901:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783444321.022236:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444321.022253:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832221 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.022262:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832221 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.022349:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.022380:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.022416:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444321.022465:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575278976 00000100:00100000:2.0:1783444321.022471:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575278976 00000100:00100000:2.0:1783444321.022511:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783444321.022532:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575278976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444321.022730:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575278976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444321.022739:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783444321.022865:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575278976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444321.022908:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444321.022962:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444321.022994:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2154180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444321.023133:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575279104 00000100:00100000:2.0:1783444321.023139:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575279104 00000100:00100000:2.0:1783444321.023177:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783444321.023184:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575279104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444321.024147:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575279104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 955us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444321.024159:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783444321.024255:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3445500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444321.032774:0:89110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783444321.033170:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783444321.033205:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783444321.033223:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832221 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.033238:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832221 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444321.033250:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783444321.033254:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef29c800 from 7 10000000:01000000:0.0:1783444321.033257:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783444321.033314:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.033342:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.033368:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.033401:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.033509:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.033570:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444321.033896:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575279232 00000100:00100000:3.0:1783444321.033918:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575279232 00000100:00100000:3.0:1783444321.033978:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783444321.033989:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575279232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444321.034008:0:89006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444321.034025:0:89006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05a00/0x42cb6883e383222f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832228 expref: -99 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.034056:0:89006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05a00/0x42cb6883e383222f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832228 expref: 22 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.034068:0:89006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05a00/0x42cb6883e383222f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832228 expref: 22 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.034079:0:89006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05a00, rc 0) 00000100:00100000:3.0:1783444321.034130:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575279232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.034138:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783444321.034301:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444321.034318:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383222f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.034328:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383222f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.034418:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.034447:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.034479:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444321.034585:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575279360 00000100:00100000:3.0:1783444321.034590:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575279360 00000100:00100000:3.0:1783444321.034626:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783444321.034634:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575279360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444321.034767:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575279360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.034775:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783444321.034927:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.034962:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.035014:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.039519:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444321.039662:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575279488 00000100:00100000:3.0:1783444321.039676:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575279488 00000100:00100000:3.0:1783444321.039765:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783444321.039777:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575279488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444321.040032:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575279488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (5016us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.040040:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783444321.040290:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444321.044157:0:89112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444321.045585:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444321.045662:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444321.045678:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383222f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.045695:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383222f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444321.045708:0:6503:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783444321.045712:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9368c507b380 from 1 10000000:01000000:0.0:1783444321.045716:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783444321.045773:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.045783:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.045839:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.045883:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.045972:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.046027:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d600 going to sleep for 11 seconds 00000100:00100000:1.0:1783444321.046979:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575279616 00000100:00100000:1.0:1783444321.046991:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575279616 00000100:00100000:1.0:1783444321.047056:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783444321.047066:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575279616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444321.047086:0:89008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444321.047110:0:89008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26000/0x42cb6883e383223d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832236 expref: -99 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444321.047143:0:89008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26000/0x42cb6883e383223d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832236 expref: 23 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444321.047157:0:89008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26000/0x42cb6883e383223d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832236 expref: 23 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444321.047168:0:89008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26000, rc 0) 00000100:00100000:1.0:1783444321.047234:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575279616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444321.047240:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783444321.048042:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444321.048068:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383223d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.048081:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383223d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444321.048110:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783444321.048134:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383223d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.048142:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383223d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444321.048153:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783444321.048156:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:0.0:1783444321.048158:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783444321.048190:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.048198:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.048207:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.048229:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.048284:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.048327:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444321.048366:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575279744 00000100:00100000:0.0:1783444321.048372:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575279744 00000100:00100000:0.0:1783444321.048413:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783444321.048422:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575279744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444321.048436:0:89015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444321.048448:0:89015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368ef262a00/0x42cb6883e383224b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832244 expref: -99 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.048469:0:89015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368ef262a00/0x42cb6883e383224b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832244 expref: 24 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.048487:0:89015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368ef262a00/0x42cb6883e383224b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832244 expref: 24 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.048495:0:89015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef262a00, rc 0) 00000100:00100000:0.0:1783444321.048528:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575279744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444321.048535:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783444321.048570:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444321.048580:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383224b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.048588:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383224b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.048651:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.048676:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444321.048693:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444321.048707:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575279872 00000100:00100000:0.0:1783444321.048710:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575279872 00000100:00100000:0.0:1783444321.048737:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783444321.048743:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575279872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.048995:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575279872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (317us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444321.049003:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783444321.049031:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575279872:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783444321.049071:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783444321.049077:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383224b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444321.049086:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383224b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444321.228123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444321.232261:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557774976 00000100:00100000:3.0:1783444321.232284:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557774976 00000100:00100000:3.0:1783444321.232395:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1783444321.232409:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+5:42401:x1870073557774976:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444321.232433:0:89015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444321.232459:0:89015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b0c expref: -99 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.232495:0:89015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b0c expref: 6 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.232507:0:89015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b0c expref: 6 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.232517:0:89015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04400, rc 0) 00000100:00100000:3.0:1783444321.232619:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557774976:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 212us (4511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.232627:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1783444321.245243:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444321.245350:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557775104 00000100:00100000:0.0:1783444321.245364:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557775104 00000100:00100000:0.0:1783444321.245440:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:0.0:1783444321.245451:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557775104:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783444321.245487:0:89008:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1783444321.245511:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783444321.245515:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783444321.245519:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783444321.245522:0:89008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783444321.245525:0:89008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00010000:00010000:1.0:1783444321.252661:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444321.260057:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557775104:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 Request processed in 14590us (14810us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.260078:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1783444321.267019:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444321.267136:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557775232 00000100:00100000:2.0:1783444321.267150:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557775232 00000100:00100000:2.0:1783444321.267234:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1194 00000100:00100000:2.0:1783444321.268694:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557775232:12345-192.168.204.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1783444321.268758:0:66223:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '778015c5-4969-44f5-82a5-0f6eadd152d5' at ffff9368eaf3e000, cookie 0x42cb6883e38320d1 00010000:00080000:2.0:1783444321.268765:0:66223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp recovering/t107374182407 exp ffff9368eaf3e000 cur 3312 last 1783444319 00010000:02000400:2.0:1783444321.268775:0:66223:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1783444321.268782:0:66223:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1783444321.268822:0:66223:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783444321.268982:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9368eab72000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444321.269067:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557775232:12345-192.168.204.20@tcp:38:ll_cfg_requeue.0 Request processed in 1820us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444321.269076:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1194 00000100:00100000:1.0:1783444321.273661:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444321.273777:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444321.274035:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557775360 00000100:00100000:2.0:1783444321.274068:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557775360 00000100:00100000:2.0:1783444321.274135:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:2.0:1783444321.274147:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557775360:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444321.274164:0:89006:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444321.274183:0:89006:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4c10a00/0x42cb6883e3832259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b13 expref: -99 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444321.274218:0:89006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c10a00/0x42cb6883e3832259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b13 expref: 7 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444321.274231:0:89006:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4c10a00/0x42cb6883e3832259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b13 expref: 7 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444321.274241:0:89006:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10a00, rc 0) 00000100:00100000:2.0:1783444321.274308:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+7:42401:x1870073557775360:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 163us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444321.274318:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1783444321.275001:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557768576 00000100:00100000:3.0:1783444321.275013:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557768576 00000100:00100000:3.0:1783444321.275086:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1195 00000100:00100000:3.0:1783444321.275097:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557768576:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00080000:3.0:1783444321.275121:0:66225:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182407, current: 107374182407, replaying 00000100:00100000:3.0:1783444321.275143:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557768576:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 49us (1365us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444321.275150:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1195 00010000:00080000:2.0:1783444321.278442:0:89037:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1783444321.279897:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444321.285221:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557775488 00000100:00100000:0.0:1783444321.285243:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557775488 00000100:00100000:0.0:1783444321.285359:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1783444321.285372:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+7:42401:x1870073557775488:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.285615:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff59f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557775488:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 244us (5724us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444321.285625:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:2.0:1783444321.293634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444321.293848:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557775616 00000100:00100000:3.0:1783444321.293868:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557775616 00000100:00100000:3.0:1783444321.293927:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1783444321.293939:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557775616:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444321.294105:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557775616:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 167us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.294113:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1783444321.310717:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444321.310886:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557775744 00000100:00100000:3.0:1783444321.310900:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557775744 00000100:00100000:3.0:1783444321.310978:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:3.0:1783444321.310990:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fbab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557775744:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444321.311014:0:89015:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444321.311039:0:89015:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05400/0x42cb6883e3832260 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b1a expref: -99 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.311078:0:89015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05400/0x42cb6883e3832260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b1a expref: 9 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.311093:0:89015:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05400/0x42cb6883e3832260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b1a expref: 9 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.311117:0:89015:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05400, rc 0) 00000100:00100000:3.0:1783444321.311215:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fbab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557775744:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 227us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.311223:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:2.0:1783444321.318704:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444321.318818:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557775872 00000100:00100000:3.0:1783444321.318828:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557775872 00000100:00100000:3.0:1783444321.318942:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:3.0:1783444321.318956:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fbab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557775872:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444321.319123:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fbab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557775872:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 170us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.319132:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1783444321.327972:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444321.328182:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557776000 00000100:00100000:0.0:1783444321.328194:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557776000 00000100:00100000:0.0:1783444321.328256:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1783444321.328267:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fbab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557776000:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444321.328421:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fbab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557776000:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 156us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444321.328429:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:1.0:1783444321.338319:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444321.338558:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557776128 00000100:00100000:3.0:1783444321.338569:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557776128 00000100:00100000:3.0:1783444321.338628:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:3.0:1783444321.338637:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fbab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557776128:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444321.338655:0:89014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444321.338672:0:89014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b21 expref: -99 pid: 89014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.338700:0:89014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b21 expref: 10 pid: 89014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.338712:0:89014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b21 expref: 10 pid: 89014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444321.338722:0:89014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05c00, rc 0) 00000100:00100000:3.0:1783444321.338823:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fbab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557776128:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 186us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444321.338830:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1783444321.341463:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444321.341536:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557776256 00000100:00100000:3.0:1783444321.341547:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557776256 00000100:00100000:3.0:1783444321.341604:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:3.0:1783444321.341614:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557776256:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444321.341735:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557776256:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 121us (278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444321.341744:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:0.0:1783444322.079149:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444322.079176:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575280000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444322.079260:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444322.079324:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575280000 00000100:00100000:0.0:1783444322.079332:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575280000 00000100:00100000:0.0:1783444322.079388:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:0.0:1783444322.079398:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575280000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444322.079429:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444322.079471:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575280000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444322.079478:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00080000:0.0:1783444322.079499:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444322.079538:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575280000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444322.081207:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575280128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444322.081260:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444322.081390:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575280128 00000100:00100000:1.0:1783444322.081396:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575280128 00000100:00100000:1.0:1783444322.081448:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:1.0:1783444322.081457:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575280128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444322.081489:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444322.081534:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575280128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444322.081541:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00100000:1.0:1783444322.081578:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575280128:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783444322.081668:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783444322.271045:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444323.293222:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.317026:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444324.428148:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444324.428194:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444324.428228:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557776512 00000100:00100000:3.0:1783444324.428239:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557776512 00000100:00100000:3.0:1783444324.428306:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 922 00000100:00100000:3.0:1783444324.428318:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557776512:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444324.428407:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557776512:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444324.428415:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 922 00000100:00100000:3.0:1783444324.428440:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557776384 00000100:00100000:3.0:1783444324.428443:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557776384 00000100:00100000:3.0:1783444324.428467:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1783444324.428473:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557776384:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444324.428497:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff59fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557776384:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444324.428515:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00080000:3.0:1783444324.428557:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444324.636993:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444324.637001:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444324.637004:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444324.637013:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1783444324.637019:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444324.637025:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444324.637056:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5971500 x1870073575280384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444324.637085:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444324.637089:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444324.637090:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444324.637094:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1783444324.637097:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444324.637101:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444324.637111:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5972680 x1870073575280640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444324.637134:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444324.637138:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444324.637139:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444324.637143:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1783444324.637145:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444324.637149:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444324.637160:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5971c00 x1870073575280896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444324.637179:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444324.637182:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444324.637184:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444324.637187:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1783444324.637190:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444324.637193:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444324.637208:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3911c00 x1870073575281280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444324.637330:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575280768:0@lo:400:kworker.0 00000100:00100000:3.0:1783444324.637399:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444324.637436:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444324.637443:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575281024:0@lo:400:kworker.0 00000100:00100000:3.0:1783444324.637471:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444324.637508:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575281024 00000100:00100000:3.0:1783444324.637515:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575281024 00000100:00100000:3.0:1783444324.637565:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:3.0:1783444324.637575:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575281024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444324.637622:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575281024:12345-0@lo:400:kworker.0 Request processed in 48us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444324.637629:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00080000:3.0:1783444324.637648:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444324.637677:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575281024:0@lo:400:kworker.0 00000100:00100000:0.0:1783444324.638357:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575280384:0@lo:38:kworker.0 00000100:00100000:0.0:1783444324.638393:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444324.638416:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575280640:0@lo:38:kworker.0 00000100:00100000:0.0:1783444324.638438:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444324.638469:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575280896:0@lo:38:kworker.0 00000100:00100000:0.0:1783444324.638493:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444324.638508:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575281280:0@lo:38:kworker.0 00000100:00100000:0.0:1783444324.638530:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444324.638583:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575280768 00000100:00100000:0.0:1783444324.638588:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575280768 00000100:00100000:0.0:1783444324.638622:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575280384 00000100:00100000:0.0:1783444324.638625:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575280384 00000100:00100000:0.0:1783444324.638639:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575280640 00000100:00100000:0.0:1783444324.638642:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575280640 00000100:00100000:0.0:1783444324.638650:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575281280 00000100:00100000:0.0:1783444324.638651:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575281280 00000100:00100000:0.0:1783444324.638661:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:0.0:1783444324.638667:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575280768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444324.638710:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575280768:12345-0@lo:400:kworker.0 Request processed in 42us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444324.638716:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:0.0:1783444324.638729:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1783444324.638733:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575280384:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444324.638757:0:66223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3315 last 0 00000020:00000080:0.0:1783444324.638820:0:66223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42cb6883e383226e 00000004:00100000:0.0:1783444324.638835:0:66223:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444324.638967:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9368c88cb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444324.639010:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1870073575280384:12345-0@lo:38:kworker.0 Request processed in 274us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444324.639017:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1783444324.639030:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1783444324.639041:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575280640:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444324.639054:0:66223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3315 last 0 00000020:00000080:0.0:1783444324.639075:0:66223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42cb6883e3832275 00000004:00100000:0.0:1783444324.639081:0:66223:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444324.639099:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444324.639124:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1870073575280640:12345-0@lo:38:kworker.0 Request processed in 82us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444324.639130:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1783444324.639142:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1783444324.639146:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575281280:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444324.639157:0:66223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3315 last 0 00000020:00000080:0.0:1783444324.639177:0:66223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x42cb6883e383227c 00000004:00100000:0.0:1783444324.639183:0:66223:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444324.639194:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444324.639335:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575280896 00000100:00100000:3.0:1783444324.639340:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575280896 00000100:00100000:3.0:1783444324.639365:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1783444324.639369:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575280896:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783444324.639383:0:8431:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9368c518e800, cookie 0x42cb6883e38320d8 00010000:00080000:3.0:1783444324.639388:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9368c518e800 cur 3315 last 1783444319 00000004:00100000:3.0:1783444324.639397:0:8431:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783444324.639411:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444324.639447:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575280896:12345-0@lo:38:kworker.0 Request processed in 76us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444324.639460:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00080000:3.0:1783444324.639478:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444324.639509:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575280768:0@lo:400:kworker.0 00010000:00080000:3.0:1783444324.639539:0:89037:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1783444324.639545:0:89037:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 107374182407 00000020:00080000:3.0:1783444324.639550:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.639554:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182407, next_transno: 107374182407 00010000:00080000:3.0:1783444324.639558:0:89037:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182407) 00000020:00080000:3.0:1783444324.639561:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.639571:0:89037:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557768576 t107374182407 from 192.168.204.20@tcp req@ffff9368e3446680 x1870073557768576/t0(107374182407) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:697/0 lens 528/0 e 0 to 0 dl 1783444332 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444324.639819:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1870073575281280:12345-0@lo:38:kworker.0 Request processed in 72us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444324.639827:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00010000:00080000:0.0:1783444324.639857:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c5971500 x1870073575280384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444324.639868:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00080000:2.0:1783444324.640464:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783444324.640468:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444324.640471:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444324.640478:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9368ea5f7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444324.640494:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3910a80 x1870073575281792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444324.640525:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575280256:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.640570:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444324.640607:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c308fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575281152:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.640630:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444324.640651:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783444324.640657:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575280512:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.640678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444324.640695:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575281408:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.640720:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444324.640750:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575280256 00000100:00100000:2.0:1783444324.640754:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575280256 00000100:00100000:2.0:1783444324.640811:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783444324.640819:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575280256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.640860:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575280256:12345-0@lo:400:kworker.0 Request processed in 42us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444324.640867:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783444324.640903:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575280256:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.640949:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575280512 00000100:00100000:2.0:1783444324.640954:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575280512 00000100:00100000:2.0:1783444324.640982:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1783444324.640988:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575280512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.641022:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575280512:12345-0@lo:400:kworker.0 Request processed in 34us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444324.641028:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1783444324.641046:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575281152 00000100:00100000:2.0:1783444324.641049:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575281152 00000100:00100000:2.0:1783444324.641075:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:2.0:1783444324.641080:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575281152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.641106:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575281152:12345-0@lo:400:kworker.0 Request processed in 26us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444324.641112:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:2.0:1783444324.641127:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575281536:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.641149:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444324.641167:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444324.641172:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575281664:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.641190:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444324.641212:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575281536 00000100:00100000:2.0:1783444324.641216:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575281536 00000100:00100000:2.0:1783444324.641854:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575281664 00000100:00100000:2.0:1783444324.641858:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575281664 00000100:00100000:2.0:1783444324.641880:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:2.0:1783444324.641887:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575281536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.641928:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575281536:12345-0@lo:400:kworker.0 Request processed in 41us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444324.641946:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00100000:2.0:1783444324.641960:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1783444324.641966:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575281664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.641993:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575281664:12345-0@lo:400:kworker.0 Request processed in 28us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444324.641999:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1783444324.642038:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575281664:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.642050:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575281536:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.642073:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575280512:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.642083:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c308fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575281152:0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.642118:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575281408 00000100:00100000:2.0:1783444324.642122:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575281408 00000100:00100000:2.0:1783444324.642148:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1783444324.642154:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575281408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444324.642188:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575281408:12345-0@lo:400:kworker.0 Request processed in 35us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444324.642194:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1783444324.642217:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575281408:0@lo:400:kworker.0 00000100:00080000:2.0:1783444324.642323:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444324.642327:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444324.642330:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1783444324.643340:0:89037:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3720us 00000100:00080000:0.0:1783444324.644326:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9367c5971500 x1870073575280384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444349 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444324.644340:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444324.644347:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444324.644353:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444324.644378:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575280384:0@lo:38:kworker.0 00010000:00080000:0.0:1783444324.644412:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c5972680 x1870073575280640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444324.644427:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00100000:1.0:1783444324.646992:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575281920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444324.647068:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444324.647138:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575281920 00000100:00100000:1.0:1783444324.647146:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575281920 00000100:00100000:1.0:1783444324.647197:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:1.0:1783444324.647207:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575281920:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1783444324.647338:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9367c5972680 x1870073575280640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444349 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444324.647350:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444324.647356:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444324.647360:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444324.647365:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575280640:0@lo:38:kworker.0 00000100:00080000:0.0:1783444324.647399:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1783444324.647409:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783444324.647413:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783444324.647415:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:0.0:1783444324.647419:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368f8ca7800 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:0.0:1783444324.647422:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00000024:1.0:1783444324.648359:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444324.648419:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575281920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1211us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444324.648427:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:1.0:1783444324.648492:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575281920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444324.658054:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575280896:0@lo:38:kworker.0 00010000:00080000:3.0:1783444324.658102:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c3911c00 x1870073575281280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444324.658123:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00080000:3.0:1783444324.664441:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9367c3911c00 x1870073575281280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444349 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444324.664455:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783444324.664461:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444324.664466:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783444324.664473:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575281280:0@lo:38:kworker.0 00000100:00100000:3.0:1783444324.664525:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575281792:0@lo:38:kworker.0 00000100:00100000:3.0:1783444324.664625:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444324.664700:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575281792 00000100:00100000:3.0:1783444324.664708:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575281792 00000100:00100000:3.0:1783444324.664747:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1783444324.664755:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575281792:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444324.665875:0:89286:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1783444324.665881:0:89286:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1783444324.665888:0:89286:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1783444324.667155:0:89286:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1783444324.669152:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575282048:0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1783444324.672388:0:71469:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3315 last 0 00000020:00000080:3.0:1783444324.673014:0:71469:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42cb6883e3832283 00000004:00100000:3.0:1783444324.673036:0:71469:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783444324.673082:0:71469:0:(import.c:65:import_set_state_nolock()) ffff9369006a1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444324.677914:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575281792:12345-0@lo:38:kworker.0 Request processed in 13148us (13278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444324.677932:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00010000:00010000:3.0:1783444324.681396:0:89037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681415:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681430:0:89037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681443:0:89037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681449:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681456:0:89037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681917:0:89037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681926:0:89037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681933:0:89037:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681939:0:89037:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444324.681944:0:89037:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681951:0:89037:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681964:0:89037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c460bb00) 00010000:00010000:3.0:1783444324.681967:0:89037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444324.681972:0:89037:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.681978:0:89037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04200/0x42cb6883e383228a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444324.681995:0:89037:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004822da66 reply state 000000005e5c1afd transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.682006:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.682013:0:89037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c460b500) 00010000:00010000:3.0:1783444324.682021:0:89037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444324.682025:0:89037:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783444324.682148:0:89037:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1783444324.682169:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.682173:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000020:00080000:3.0:1783444324.682177:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.682179:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000100:00100000:2.0:1783444324.685953:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783444324.686072:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c3910a80 x1870073575281792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444324.686093:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:2.0:1783444324.686103:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783444324.686109:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783444324.686112:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783444324.686119:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575281792:0@lo:38:kworker.0 00000100:00100000:0.0:1783444324.687950:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575282048 00000100:00100000:0.0:1783444324.687964:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575282048 00000100:00100000:0.0:1783444324.688014:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:0.0:1783444324.688022:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575282048:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1783444324.688054:0:8430:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9367c3afc380 x1870073575282048/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:700/0 lens 224/0 e 0 to 0 dl 1783444335 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444324.688074:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575282048:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 52us (2130us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444324.688081:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000001:00080000:1.0:1783444324.689526:0:89002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00000020:00080000:3.0:1783444324.690407:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.690414:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00010000:00010000:3.0:1783444324.693515:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.693536:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.693544:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.693551:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444324.693555:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.693563:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.693583:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c460b500) 00010000:00010000:3.0:1783444324.693587:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444324.693592:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.693600:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832291 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444324.696064:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444324.701619:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557769088 00000100:00100000:3.0:1783444324.701637:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557769088 00000100:00100000:2.0:1783444324.706294:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1200 00000100:00100000:2.0:1783444324.706309:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557769088:12345-192.168.204.20@tcp:36:rm.0 00010000:00080000:2.0:1783444324.706706:0:67017:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:2.0:1783444324.706728:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557769088:12345-192.168.204.20@tcp:36:rm.0 Request processed in 422us (10672us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444324.706736:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1200 00000020:00080000:3.0:1783444324.706737:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.706741:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:3.0:1783444324.706745:0:89037:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:3.0:1783444324.706748:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.706758:0:89037:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557769088 t107374182408 from 192.168.204.20@tcp req@ffff9367c4368380 x1870073557769088/t0(107374182408) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 512/0 e 0 to 0 dl 1783444335 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783444324.706879:0:89037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.706895:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.706907:0:89037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.706920:0:89037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.706926:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.706933:0:89037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707025:0:89037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707034:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707048:0:89037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707283:0:89037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707292:0:89037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707299:0:89037:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707306:0:89037:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1a800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444324.707310:0:89037:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707317:0:89037:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707329:0:89037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff9367c460bc00) 00010000:00010000:3.0:1783444324.707332:0:89037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783444324.707337:0:89037:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707343:0:89037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38322a6 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707362:0:89037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707369:0:89037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707382:0:89037:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707387:0:89037:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1ae00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444324.707391:0:89037:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707396:0:89037:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707403:0:89037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c460b500) 00010000:00010000:3.0:1783444324.707406:0:89037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444324.707408:0:89037:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707414:0:89037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832298 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444324.707425:0:89037:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009afc51e4 reply state 00000000fc0f029a transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707435:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.707441:0:89037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c460bb00) 00010000:00010000:3.0:1783444324.707443:0:89037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444324.707446:0:89037:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783444324.707521:0:89037:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444324.707537:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.707540:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:3.0:1783444324.707548:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.707550:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:3.0:1783444324.709687:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444324.710694:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557770496 00000100:00100000:0.0:1783444324.710707:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557770496 00000100:00100000:0.0:1783444324.710771:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1201 00000100:00100000:0.0:1783444324.710781:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557770496:12345-192.168.204.20@tcp:36:dd.0 00010000:00080000:0.0:1783444324.710823:0:66226:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182410, replaying 00000100:00100000:0.0:1783444324.710835:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557770496:12345-192.168.204.20@tcp:36:dd.0 Request processed in 56us (1160us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444324.710842:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1201 00000020:00080000:3.0:1783444324.710900:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.710904:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182410, next_transno: 107374182409 00010000:00080000:3.0:1783444324.710910:0:89037:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182409, ql: 1, comp: 1, conn: 2, next: 107374182410, next_update 0 last_committed: 107374182407) 00000020:00080000:3.0:1783444324.710914:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.710923:0:89037:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557770496 t107374182410 from 192.168.204.20@tcp req@ffff9367c5972680 x1870073557770496/t0(107374182410) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 488/0 e 0 to 0 dl 1783444335 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783444324.711133:0:89037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.711148:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.711158:0:89037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444324.711350:0:89037:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003eb83f94 reply state 000000000a814625 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.711465:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.711475:0:89037:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367c460be00) 00010000:00010000:3.0:1783444324.711478:0:89037:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444324.711483:0:89037:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783444324.711611:0:89037:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444324.711629:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.711636:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000020:00080000:3.0:1783444324.711640:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.711643:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000100:00100000:3.0:1783444324.716680:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444324.716764:0:66247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557770752 00000100:00100000:1.0:1783444324.716774:0:66247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557770752 00000100:00100000:1.0:1783444324.716882:0:66247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1783444324.716892:0:66247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557770752:12345-192.168.204.20@tcp:10:dd.0 00010000:00080000:1.0:1783444324.716911:0:66247:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 107374182411, current: 107374182411, replaying 00000100:00100000:1.0:1783444324.716925:0:66247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557770752:12345-192.168.204.20@tcp:10:dd.0 Request processed in 36us (258us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444324.716944:0:66247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000020:00080000:3.0:1783444324.717024:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.717029:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182411, next_transno: 107374182411 00010000:00080000:3.0:1783444324.717033:0:89037:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (107374182411) 00000020:00080000:3.0:1783444324.717036:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.717045:0:89037:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557770752 t107374182411 from 192.168.204.20@tcp req@ffff9367c5971500 x1870073557770752/t0(107374182411) o10->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 440/0 e 0 to 0 dl 1783444335 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444324.717302:0:89037:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444324.717327:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.717331:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000020:00080000:3.0:1783444324.717334:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444324.717336:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000001:02000400:3.0:1783444324.727526:0:89290:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783444324.742309:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444324.742760:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557776640 00000100:00100000:1.0:1783444324.742771:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557776640 00000100:00100000:1.0:1783444324.742854:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1202 00000100:00100000:1.0:1783444324.742865:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2400:x1870073557776640:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783444324.742889:0:66223:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9367c436ad80 x1870073557776640/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 328/0 e 0 to 0 dl 1783444335 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444324.742910:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2400:x1870073557776640:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 48us (612us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444324.742917:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1202 00000020:00080000:0.0:1783444324.743474:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444324.743479:0:89037:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00080000:0.0:1783444324.743482:0:89037:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1783444324.743486:0:89037:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444324.743494:0:89037:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1783444324.743496:0:89037:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1783444324.743504:0:89037:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9367c436ad80 x1870073557776640/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 328/0 e 0 to 0 dl 1783444335 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783444324.743523:0:89037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444324.743554:0:89037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 2/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939afe expref: -99 pid: 89037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.743592:0:89037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 12 pid: 89037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.743606:0:89037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 12 pid: 89037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.743616:0:89037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368ef263a00, rc 0) 00010000:00080000:0.0:1783444324.743679:0:89037:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1783444324.743692:0:89037:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1783444324.747087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444324.747302:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557776768 00000100:00100000:0.0:1783444324.747314:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557776768 00000100:00100000:0.0:1783444324.747398:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 925 00000100:00100000:0.0:1783444324.747411:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2400:x1870073557776768:12345-192.168.204.20@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1783444324.747438:0:67017:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9368e3447480 x1870073557776768/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 224/0 e 0 to 0 dl 1783444335 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444324.747461:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2400:x1870073557776768:12345-192.168.204.20@tcp:400:ptlrpcd_rcv.0 Request processed in 54us (389us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444324.747469:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 925 00010000:00080000:3.0:1783444324.747490:0:89037:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1783444324.747640:0:89037:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:1.0:1783444324.749140:0:89002:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00100000:1.0:1783444324.749149:0:89002:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1783444324.749161:0:89002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182411 is committed 00000001:00080000:3.0:1783444324.749240:0:89037:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783444324.749281:0:89037:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783444324.749295:0:89037:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9367c3afc380 x1870073575282048/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:700/0 lens 224/0 e 0 to 0 dl 1783444335 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783444324.749418:0:89037:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.20@tcp: req@ffff9368e3447480 x1870073557776768/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 224/0 e 0 to 0 dl 1783444335 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444324.749471:0:89037:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:0.0:1783444324.749591:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749603:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749611:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749627:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1a200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444324.749632:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749641:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749660:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367c460bb00) 00010000:00010000:0.0:1783444324.749663:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444324.749667:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749674:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a200/0x42cb6883e383229f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749700:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749706:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749712:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749717:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1a400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444324.749719:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749725:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749742:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367c460be00) 00010000:00010000:0.0:1783444324.749744:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444324.749747:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.749753:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a400/0x42cb6883e38322ad lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89037 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783444324.755588:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783444324.755610:0:3632:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9367c4368700 x1870073575282048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444340 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444324.755622:0:3632:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9367c4368700 x1870073575282048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444340 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444324.755629:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783444324.755661:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1783444324.755668:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575282048:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1783444324.755868:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575282176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444324.755945:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444324.756035:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575282176 00000100:00100000:2.0:1783444324.756043:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575282176 00000100:00100000:2.0:1783444324.756097:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:2.0:1783444324.756105:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575282176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444324.756138:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444839424 avail 1298599936 00000100:00100000:2.0:1783444324.756183:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575282176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444324.756190:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:0.0:1783444324.756254:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575282176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444324.766967:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444324.767017:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444324.767047:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771776 00000100:00100000:2.0:1783444324.767056:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771776 00000100:00100000:2.0:1783444324.767115:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1203 00000100:00100000:2.0:1783444324.767132:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557771776:12345-192.168.204.20@tcp:16:kworker.0 00000100:00100000:1.0:1783444324.767304:0:66245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557771648 00000100:00100000:1.0:1783444324.767309:0:66245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557771648 00002000:00100000:1.0:1783444324.767341:0:66245:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff9367c3afed80 x1870073557771648/t0(0) o4->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 496/0 e 0 to 0 dl 1783444335 ref 1 fl New:/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444324.767352:0:66245:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9367c3afed80 with x1870073557771648 00002000:00010000:1.0:1783444324.767460:0:66245:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 8 pid: 89037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444324.767487:0:66245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:1.0:1783444324.767495:0:66245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2404:x1870073557771648:12345-192.168.204.20@tcp:4:dd.0 00000100:00100000:2.0:1783444324.768119:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2404:x1870073557771776:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 985us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444324.768131:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1203 00000100:00100000:1.0:1783444324.771012:0:66245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2404:x1870073557771648:12345-192.168.204.20@tcp:4:dd.0 Request processed in 3504us (4041us total) trans 111669149697 rc 0/0 00000100:00100000:1.0:1783444324.771027:0:66245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00002000:00100000:1.0:1783444324.771041:0:66245:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff9367c3afed80 x1870073557771648/t111669149697(0) o4->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:700/0 lens 496/448 e 0 to 0 dl 1783444335 ref 1 fl Complete:/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444324.771052:0:66245:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9367c3afed80 with x1870073557771648 00002000:00010000:1.0:1783444324.771063:0:66245:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 9 pid: 89037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1783444324.798196:0:89037:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac1c47ab3e10 00100000:10000000:1.0:1783444324.798218:0:89037:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1783444324.803001:0:89025:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1783444324.803060:0:89025:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89025:1870073575282304:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783444324.803139:0:89025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444324.803172:0:89025:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783444324.803197:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575282304 00000100:00100000:1.0:1783444324.803204:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575282304 00000100:00100000:1.0:1783444324.803607:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:1.0:1783444324.803626:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:89025:x1870073575282304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783444324.803657:0:26208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -127 00002000:02000040:1.0:1783444324.803662:0:26208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:801) 00000004:00080000:0.0:1783444324.809690:0:89023:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1783444324.809753:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89023:1870073575282432:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783444324.809843:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444324.809884:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444324.810551:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575282432 00000100:00100000:3.0:1783444324.810561:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575282432 00000100:00100000:3.0:1783444324.810627:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5873 00000100:00100000:3.0:1783444324.810638:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:89023:x1870073575282432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783444324.810670:0:26211:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -625 00002000:02000040:3.0:1783444324.810676:0:26211:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:801) 00002000:00010000:1.0:1783444324.814160:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.814176:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814194:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x321:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.814199:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x321:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.814205:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814220:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814230:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814237:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814261:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444324.814377:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.814383:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814390:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x320:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.814409:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x320:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.814414:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814424:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814432:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814439:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814452:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444324.814491:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.814496:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814503:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31f:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.814507:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.814510:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814518:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814526:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814539:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814554:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783444324.814568:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444324.814573:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814581:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.814586:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814595:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814612:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814619:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4abcfb5/0x42cb6883e38322bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814637:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444324.814640:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814657:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.814660:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814666:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814676:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814682:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061d636e9/0x42cb6883e38322c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814693:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.814696:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814702:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.814705:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814712:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814720:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814733:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c633c80/0x42cb6883e38322c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.814744:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.814745:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.814747:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.815245:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.817164:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.817177:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817193:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31e:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.817196:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.817202:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817216:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817225:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817233:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817251:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444324.817898:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.817906:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817916:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31d:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.817919:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.817922:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817932:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817939:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817946:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817961:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444324.817972:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444324.817977:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.817984:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.817988:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818009:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818025:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818033:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e38322d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818052:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.818055:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818061:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.818064:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818071:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818080:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818087:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea92185f/0x42cb6883e38322d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818114:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.818116:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.818118:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.818171:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.818176:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818184:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31c:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.818187:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.818191:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818200:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818208:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818215:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818230:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444324.818268:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.818273:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818291:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31b:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.818294:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.818302:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818324:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818332:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818478:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818491:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444324.818499:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444324.818502:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818509:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.818512:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818519:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818541:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818548:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e14e1789/0x42cb6883e38322de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818562:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.818566:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818572:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.818575:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818582:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818591:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818597:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000959f2509/0x42cb6883e38322e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818607:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.818608:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.818616:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.818660:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.818665:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818672:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31a:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.818676:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.818679:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818687:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818694:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818700:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818712:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444324.818717:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.818720:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818726:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.818729:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818747:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818758:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818766:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dc87b39/0x42cb6883e38322ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818780:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.818781:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.818814:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.818856:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.818862:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818869:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x319:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.818872:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x319:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.818876:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818884:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818892:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818906:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818919:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444324.818926:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.818929:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818936:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.818939:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818947:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818959:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818967:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e38322f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.818980:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.818981:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.818983:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.819023:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.819033:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819041:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x318:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.819044:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.819048:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819056:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819065:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819072:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819084:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444324.819090:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.819094:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819101:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.819105:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819112:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819128:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819136:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38322fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819149:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.819151:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.819153:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.819192:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.819197:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819205:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x317:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.819208:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x317:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.819212:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819220:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819227:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819234:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819257:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444324.819264:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.819267:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819274:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.819277:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819285:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819296:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819303:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3832301 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.819315:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.819317:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.819319:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.820761:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.820773:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820811:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x316:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.820823:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x316:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.820828:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820842:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820852:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820860:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820881:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444324.820894:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.820899:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820908:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.820913:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820922:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820938:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820957:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e3832308 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.820977:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.820979:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.820981:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.821052:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.821057:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821065:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x315:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.821069:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.821073:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821082:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821089:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821097:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821110:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444324.821122:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.821126:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821133:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.821136:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821143:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821154:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821160:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383230f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821172:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.821174:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.821175:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.821215:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.821220:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821228:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x314:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.821230:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x314:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.821234:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821256:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821264:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821271:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821282:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444324.821289:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.821293:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821299:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.821302:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821321:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821333:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.821350:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3832316 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.822212:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.822511:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.822513:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.822515:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444324.822608:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.822615:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822627:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x313:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.822631:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x313:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.822636:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822647:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822656:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822664:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822725:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444324.822767:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.822772:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822822:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x312:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.822826:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x312:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.822830:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822839:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822846:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.822857:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823303:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.823321:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823331:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.823342:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823353:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823481:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823489:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e383231d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823507:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.823510:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823516:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.823519:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823526:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823535:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.823543:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.823545:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.823547:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.823877:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444324.823883:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3832324 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444324.823965:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.823971:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.823980:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x311:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.823984:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.823988:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824006:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824015:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824023:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824037:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444324.824077:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.824083:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824091:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x310:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.824093:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x310:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.824097:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824106:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824114:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824133:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824141:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444324.824181:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.824186:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824194:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30f:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.824197:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.824200:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824208:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824215:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824221:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824230:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783444324.824262:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.824267:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824280:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30e:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.824283:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.824287:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824296:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824305:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824567:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824577:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783444324.824619:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.824624:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824632:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30d:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.824635:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.824639:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824648:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824667:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824676:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824685:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1783444324.824724:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.824729:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824737:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30c:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.824740:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.824743:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824752:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824761:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824768:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824822:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1783444324.824861:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.824866:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824874:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30b:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.824877:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.824881:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824890:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824898:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824906:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824914:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1783444324.824947:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.824951:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824959:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30a:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.824967:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.824972:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824981:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824989:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.824997:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825005:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1783444324.825042:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.825047:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825054:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x309:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.825057:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.825061:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825070:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825078:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825091:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825100:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1783444324.825136:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.825141:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825149:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x308:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.825152:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x308:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.825156:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825164:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825172:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825179:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825187:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1783444324.825219:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.825224:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825237:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x307:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.825240:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x307:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.825244:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825252:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825260:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825267:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.825276:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1783444324.825330:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.825335:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825490:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1783444324.825497:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825512:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825517:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825526:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825544:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825552:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e383232b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825575:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1783444324.825579:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825585:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825589:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825597:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825607:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825620:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e3832332 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825632:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1783444324.825636:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825643:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825647:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825654:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825663:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825670:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3832339 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825682:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1783444324.825685:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825691:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825699:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825707:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825716:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825722:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3832340 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825738:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783444324.825741:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825747:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825750:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825757:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825767:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825773:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3832347 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825819:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783444324.825823:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825829:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825832:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825839:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825849:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825857:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e383234e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825868:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783444324.825871:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825877:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825881:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825898:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825909:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825916:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3832355 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825929:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783444324.825933:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825939:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825942:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825949:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825959:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825966:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383235c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825988:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444324.825991:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.825996:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.825999:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826006:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826015:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826021:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db722ed/0x42cb6883e3832363 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826031:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.826034:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826041:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.826044:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826061:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826071:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826079:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abdcbc9/0x42cb6883e383236a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826091:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.826095:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826102:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.826105:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826112:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826121:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826128:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f088b43a/0x42cb6883e3832371 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.826149:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.826151:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.826153:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.826163:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.826464:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x306:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.826468:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x306:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.826473:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.826485:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.826506:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.826514:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.826576:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444324.826647:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.826654:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.826661:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x305:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.826664:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.826668:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.826677:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.826685:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.826693:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.827128:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.827134:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.827143:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.827147:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.827156:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.827169:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.827177:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fb6d0d8/0x42cb6883e3832378 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.827193:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.827197:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.827202:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.827212:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.828950:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444324.828983:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444324.828993:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829008:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x321:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:2.0:1783444324.829013:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x321:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444324.829018:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829033:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829044:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829052:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829069:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444324.829077:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444324.829082:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829103:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444324.829108:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829116:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829132:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829140:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3832386 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.829161:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444324.829163:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444324.829164:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.829676:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.829699:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.829708:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.829710:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.829711:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.829730:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.829829:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.829865:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444324.829873:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092038f22/0x42cb6883e383237f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444324.829987:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.829994:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830003:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x304:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.830006:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x304:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.830011:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830022:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830030:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830037:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830099:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444324.830139:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.830144:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830161:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x303:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.830164:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.830168:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830176:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830183:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830190:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830216:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.830221:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830228:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.830233:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830241:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830251:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830269:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2400fb/0x42cb6883e383238d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830283:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.830286:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830293:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.830296:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830303:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830313:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830320:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.830321:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.830323:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.830543:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444324.830549:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5bcede/0x42cb6883e3832394 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444324.830603:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444324.830609:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830617:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:1.0:1783444324.830620:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444324.830624:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830639:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830648:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.830655:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830680:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.830685:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830691:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.830700:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830708:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830718:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.830736:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.830737:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.830739:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444324.830896:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444324.830903:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.830911:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x320:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:2.0:1783444324.830914:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x320:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444324.830918:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.830926:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.830940:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.830947:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444324.830959:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444324.835574:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.835595:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835611:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.835642:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835655:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835679:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835686:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38323a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835718:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.835720:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.835722:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.835923:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.835930:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835943:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31f:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.835947:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.835966:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835979:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835989:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.835997:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836037:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444324.836045:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.836049:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836066:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.836070:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836077:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836087:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836094:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e38323a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836104:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.836106:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.836108:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.836161:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.836166:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836173:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31e:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.836177:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.836181:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836189:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836201:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836208:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836221:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444324.836228:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.836232:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836239:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.836242:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836248:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836259:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836266:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6b375dd/0x42cb6883e38323b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836277:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.836284:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.836286:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.836329:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.836335:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836437:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31d:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.836440:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.836444:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836453:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836460:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836467:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1783444324.836506:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783444324.836524:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444324.836561:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.836566:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836573:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31c:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.836576:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.836585:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836594:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836601:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836607:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836621:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444324.836661:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.836666:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836673:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31b:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.836676:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.836679:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836686:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836693:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836710:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836723:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783444324.836731:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444324.836734:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836740:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.836744:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836752:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836763:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836770:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da147109/0x42cb6883e38323b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836808:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.836812:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836829:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.836833:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836840:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836850:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836857:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91050ff/0x42cb6883e38323be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836869:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.836873:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836879:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.836883:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836890:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836900:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836913:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa4fb018/0x42cb6883e38323c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836925:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.836927:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.836929:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.836935:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.836940:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.836981:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.836986:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.836994:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31a:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.836997:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.837000:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837008:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837015:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837021:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837042:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444324.837049:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.837052:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837058:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.837061:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837067:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837077:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837084:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537d4012/0x42cb6883e38323cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837096:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.837097:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.837099:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.837134:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.837139:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837146:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x319:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.837153:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x319:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.837157:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837166:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837172:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837179:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783444324.837181:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783444324.837189:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444324.837195:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.837198:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837204:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.837207:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837214:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837225:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837243:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f83f2615/0x42cb6883e38323d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837255:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.837256:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.837258:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.837297:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.837303:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837310:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x318:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.837313:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.837317:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837325:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.837331:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.837820:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444324.837828:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45daecc/0x42cb6883e383239b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.837850:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783444324.838411:0:26208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:1.0:1783444324.838520:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:89025:x1870073575282304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 34891us (35377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444324.838530:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00010000:00010000:0.0:1783444324.839048:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839089:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444324.839164:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.839170:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839179:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x317:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.839183:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x317:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.839188:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839199:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839206:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839212:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839225:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444324.839233:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.839237:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839243:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.839247:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839265:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839279:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839286:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e97c4876/0x42cb6883e38323da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839299:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.839302:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839307:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.839309:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839315:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839322:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.839327:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000241d1b40/0x42cb6883e38323e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840057:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.840059:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.840061:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.840123:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.840129:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840136:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x316:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.840139:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x316:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.840143:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840151:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840158:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840165:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840177:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444324.840183:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.840187:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840202:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.840206:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840213:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840223:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840230:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000043ec5cb/0x42cb6883e38323e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840241:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.840242:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.840244:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.840282:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.840286:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840293:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x315:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.840295:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.840299:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840307:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840319:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840325:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.840334:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444324.840464:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444324.840469:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.840476:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444324.840479:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.840494:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.840504:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444324.840511:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.840512:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444324.840514:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444324.841301:0:89025:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89025:1870073575282304:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783444324.841336:0:89025:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x321:0x0] from OST, last_created [0x2c0000401:0x321:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:3.0:1783444324.841427:0:89025:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89025:1870073575282688:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783444324.841481:0:89025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444324.841510:0:89025:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c328fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444324.841510:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575282560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444324.841535:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575282688 00000100:00100000:3.0:1783444324.841541:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575282688 00000100:00100000:1.0:1783444324.841541:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444324.841583:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5874 00000100:00100000:3.0:1783444324.841592:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:89025:x1870073575282688:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783444324.841635:0:8824:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 802 00000100:00100000:1.0:1783444324.841833:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575282560 00000100:00100000:1.0:1783444324.841837:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575282560 00000100:00100000:1.0:1783444324.841864:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:1.0:1783444324.841870:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575282560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444324.841883:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444324.841926:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575282560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444324.841933:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:1.0:1783444324.841971:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575282560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444324.843290:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:89025:x1870073575282688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1694us (1804us total) trans 4294969453 rc 0/0 00000100:00100000:3.0:1783444324.843300:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5874 00010000:00010000:3.0:1783444324.843336:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444324.845253:0:89025:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89025:1870073575282688:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783444324.845274:0:89025:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x321:0x0]-[0x2c0000401:0x341:0x0] 00010000:00010000:0.0:1783444324.845382:0:26211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38323ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444324.845534:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.845541:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845553:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x314:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.845557:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x314:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.845563:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845576:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845584:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845605:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845633:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444324.845670:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.845675:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845682:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x313:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.845685:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x313:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.845688:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845696:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845702:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845708:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845722:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783444324.845731:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.845736:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845749:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.845755:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845763:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845781:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845813:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38323f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845828:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.845831:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845838:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.845841:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845849:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.845852:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.845859:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845872:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eea3615/0x42cb6883e38323fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845884:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.845886:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.845887:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.845926:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.845931:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845938:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x312:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.845941:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x312:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.845945:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845952:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845958:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845964:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.845984:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444324.846022:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.846026:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846033:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x311:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.846035:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.846039:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846046:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846053:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846059:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846067:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444324.846094:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.846098:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846104:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x310:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.846106:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x310:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.846110:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846127:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846134:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846140:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846148:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783444324.846180:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.846184:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846191:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30f:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.846193:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.846197:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846205:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846211:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846228:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846241:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783444324.846248:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783444324.846252:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846258:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.846261:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846269:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846280:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846287:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e3829f5/0x42cb6883e3832404 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846299:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783444324.846301:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.846303:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846306:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846320:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444324.846323:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.846323:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846326:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846332:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846334:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846341:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846344:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846349:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea29408/0x42cb6883e383240b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846352:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c5170c5/0x42cb6883e3832412 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846360:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.846363:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846364:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.846366:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.846368:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.846369:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.846372:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846373:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.846378:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.846379:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846387:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846400:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfea002e/0x42cb6883e3832419 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846411:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.846413:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.846415:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.846452:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.846456:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846463:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30e:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.846466:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.846469:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846477:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846483:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846489:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846508:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444324.846547:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.846551:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846559:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30d:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.846561:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.846565:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846573:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846579:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846585:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846594:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444324.846623:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.846627:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846633:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30c:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.846635:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.846639:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846655:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846662:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846669:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846680:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783444324.846686:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444324.846689:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846695:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.846698:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846705:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846713:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846718:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3832420 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846735:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.846738:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846743:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.846746:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846754:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846764:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846770:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a91f43f/0x42cb6883e3832427 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846780:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.846818:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846825:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.846828:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846843:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.846846:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.846847:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.846858:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846866:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c6817e2/0x42cb6883e383242e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846878:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.846879:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.846881:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.846920:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.846924:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846931:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30b:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.846933:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.846937:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846945:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846951:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846962:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.846982:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444324.847015:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.847019:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847026:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30a:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.847028:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.847032:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847039:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847046:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847052:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847060:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444324.847086:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.847089:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847100:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x309:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.847102:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.847106:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847114:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847120:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847126:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847134:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783444324.847167:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.847171:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847177:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x308:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.847180:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x308:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.847183:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847190:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847206:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847212:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847224:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783444324.847231:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783444324.847234:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847240:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.847243:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847251:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847261:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847268:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b715454e/0x42cb6883e3832435 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847282:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444324.847290:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847297:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444324.847299:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444324.847300:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847304:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847308:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847311:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444324.847314:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847319:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847327:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e383243c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847328:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847338:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847339:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.847342:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847345:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ec7dea/0x42cb6883e3832443 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847348:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.847351:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847357:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.847359:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.847359:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847361:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.847366:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.847370:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.847378:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847386:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043086d7a/0x42cb6883e383244a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847398:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.847400:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.847402:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.847439:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.847443:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847449:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x307:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.847452:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x307:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.847455:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847463:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847470:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847475:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847502:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444324.847537:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.847541:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847548:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x306:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.847550:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x306:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.847553:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847561:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847567:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847574:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847582:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783444324.847607:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.847611:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847616:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x305:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.847623:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.847626:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847634:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847641:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847648:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847657:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1783444324.847688:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.847692:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847698:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x304:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.847701:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x304:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.847705:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847712:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847719:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847731:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847743:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1783444324.847749:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783444324.847753:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847760:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.847763:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847770:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847810:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847819:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cffa4928/0x42cb6883e3832451 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847833:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444324.847836:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847847:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444324.847851:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847853:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.847857:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847858:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444324.847861:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847865:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847869:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847875:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847878:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847882:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e3832458 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847890:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1e55d1b/0x42cb6883e383245f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847894:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444324.847897:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847901:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.847903:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.847904:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.847904:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444324.847907:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.847909:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.847912:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.847914:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847923:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847936:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7cd07cf/0x42cb6883e3832466 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.847949:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.847950:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444324.847952:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783444324.847990:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.847995:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848001:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x303:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.848004:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.848007:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848015:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848021:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848027:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848047:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783444324.848086:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444324.848091:0:26211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848098:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=3315s v=(0 0) 00010000:00010000:0.0:1783444324.848100:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444324.848104:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848111:0:26211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848117:0:26211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848123:0:26211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444324.848132:0:26211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444324.849263:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444324.849272:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849282:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444324.849287:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849296:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849312:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849319:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e383246d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849334:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444324.849441:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849447:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444324.849450:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849457:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849468:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849474:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bff58a05/0x42cb6883e3832474 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444324.849488:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.849489:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.849491:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444324.849498:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783444324.857092:0:26211:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:0.0:1783444324.857205:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:89023:x1870073575282432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 46565us (47357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444324.857216:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5873 00000100:00100000:3.0:1783444324.857328:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89023:1870073575282432:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783444324.857355:0:89023:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x321:0x0] from OST, last_created [0x280000401:0x321:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:3.0:1783444324.857445:0:89023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89023:1870073575282944:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783444324.857486:0:89023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444324.857497:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444324.857509:0:89023:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c328fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444324.857509:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575282816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444324.857551:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444324.857663:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575282816 00000100:00100000:3.0:1783444324.857676:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575282816 00000100:00100000:3.0:1783444324.857725:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:3.0:1783444324.857734:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575282816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444324.857761:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444324.857829:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575282816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444324.857836:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:1.0:1783444324.857902:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575282816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444324.857989:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575282944 00000100:00100000:0.0:1783444324.857994:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575282944 00000100:00100000:0.0:1783444324.858061:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5875 00000100:00100000:0.0:1783444324.858069:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:89023:x1870073575282944:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783444324.858104:0:26206:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 802 00000100:00100000:0.0:1783444324.859671:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:89023:x1870073575282944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1600us (2181us total) trans 4294969449 rc 0/0 00000100:00100000:0.0:1783444324.859682:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5875 00000100:00100000:3.0:1783444324.859775:0:89023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89023:1870073575282944:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783444324.859813:0:89023:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x321:0x0]-[0x280000401:0x341:0x0] 00000001:00100000:3.0:1783444325.151971:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783444325.341079:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783444325.915232:0:89343:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444325.917108:0:89343:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783444326.365305:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444326.476722:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444326.476815:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557777280 00000100:00100000:3.0:1783444326.476827:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557777280 00000100:00100000:3.0:1783444326.476906:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 926 00000100:00100000:3.0:1783444326.476917:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2402:x1870073557777280:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444326.476999:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2402:x1870073557777280:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444326.477006:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 926 00000100:00080000:1.0:1783444326.477123:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444326.483663:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444326.483711:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444326.483741:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557777408 00000100:00100000:3.0:1783444326.483750:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557777408 00000100:00100000:3.0:1783444326.483839:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 927 00000100:00100000:3.0:1783444326.483850:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557777408:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444326.483938:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557777408:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444326.483953:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 927 00000100:00100000:1.0:1783444326.485026:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557777152 00000100:00100000:1.0:1783444326.485039:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557777152 00000100:00100000:1.0:1783444326.485102:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:1.0:1783444326.485111:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557777152:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444326.485179:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557777152:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 69us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444326.485187:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00080000:1.0:1783444326.485230:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:1.0:1783444326.916910:0:89393:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444326.917235:0:89393:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783444327.197169:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575283072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444327.197251:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444327.197506:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444327.197547:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575283072 00000100:00100000:1.0:1783444327.197556:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575283072 00000100:00100000:1.0:1783444327.197612:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:1.0:1783444327.197623:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575283072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444327.197656:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783444327.198948:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444327.201081:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575283200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444327.201166:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444327.201253:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575283200 00000100:00100000:3.0:1783444327.201262:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575283200 00000100:00100000:3.0:1783444327.201320:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:3.0:1783444327.201329:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575283200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444327.201357:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444327.201394:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575283200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444327.201401:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00080000:0.0:1783444327.201470:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444327.202853:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575283072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5226us (5594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444327.202865:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:2.0:1783444327.203042:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd10b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575283072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444327.203072:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575283200:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783444327.389100:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444328.413228:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444328.808185:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444328.810334:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557777536 00000100:00100000:2.0:1783444328.810352:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557777536 00000100:00100000:2.0:1783444328.810544:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1204 00000100:00100000:2.0:1783444328.810556:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:68226:x1870073557777536:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444328.810577:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444328.810605:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e383247b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b28 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444328.810679:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3832482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444328.810720:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3832482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444328.810733:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3832482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444328.810812:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444328.810816:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444328.810855:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3832482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444328.810883:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e383247b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b28 expref: 11 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444328.810904:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3832482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b28 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444328.810914:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c709e700) 00010000:00010000:2.0:1783444328.810918:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444328.810922:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11000, rc 0) 00000100:00100000:2.0:1783444328.811008:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:68226:x1870073557777536:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 452us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444328.811015:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1204 00000100:00080000:0.0:1783444328.812307:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444328.816409:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444328.816520:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557777664 00000100:00100000:3.0:1783444328.816530:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557777664 00000100:00100000:3.0:1783444328.818828:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1205 00000100:00100000:3.0:1783444328.818853:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:68226:x1870073557777664:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444328.818900:0:66223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 28672 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444328.819060:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:68226:x1870073557777664:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 219us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444328.819068:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1205 00000100:00100000:1.0:1783444328.829831:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444328.831887:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557777792 00000100:00100000:3.0:1783444328.831905:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557777792 00000100:00100000:3.0:1783444328.832017:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1206 00000100:00100000:3.0:1783444328.832031:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:68226:x1870073557777792:12345-192.168.204.20@tcp:41:lfs.0 00000100:00080000:0.0:1783444328.832156:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1783444328.832221:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444328.832311:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:68226:x1870073557777792:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 283us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444328.832333:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1206 00000100:00100000:1.0:1783444328.837633:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444328.837886:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557777920 00000100:00100000:0.0:1783444328.837897:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557777920 00000100:00100000:0.0:1783444328.837981:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5876 00000100:00100000:0.0:1783444328.837990:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1870073557777920:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:0.0:1783444328.838025:0:8421:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp t0 exp 0000000000000000 cur 3319 last 0 00000020:00000080:0.0:1783444328.838071:0:8421:0:(genops.c:1406:class_connect()) connect: client 778015c5-4969-44f5-82a5-0f6eadd152d5, cookie 0x42cb6883e3832489 00002000:00100000:0.0:1783444328.838084:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 778015c5-4969-44f5-82a5-0f6eadd152d5/ffff9368ea5f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783444328.838095:0:8421:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783444328.838167:0:8421:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783444328.838213:0:8421:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444328.838292:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557777920:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 301us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444328.838300:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5876 00000100:00100000:3.0:1783444328.843376:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444328.843481:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557778048 00000100:00100000:2.0:1783444328.843491:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557778048 00000100:00100000:2.0:1783444328.843556:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1872 00000100:00100000:2.0:1783444328.843565:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:68226:x1870073557778048:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444328.843590:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444328.843689:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:68226:x1870073557778048:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 124us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444328.843696:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1872 00000100:00080000:3.0:1783444328.844293:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444328.849078:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444328.850826:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557778176 00000100:00100000:0.0:1783444328.850839:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557778176 00000100:00100000:0.0:1783444328.850902:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5877 00000100:00100000:0.0:1783444328.850913:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2400:x1870073557778176:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:0.0:1783444328.850953:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp t0 exp 0000000000000000 cur 3319 last 0 00000020:00000080:0.0:1783444328.851004:0:26209:0:(genops.c:1406:class_connect()) connect: client 778015c5-4969-44f5-82a5-0f6eadd152d5, cookie 0x42cb6883e3832490 00002000:00100000:0.0:1783444328.851015:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 778015c5-4969-44f5-82a5-0f6eadd152d5/ffff9369006a2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783444328.851026:0:26209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783444328.851113:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783444328.851146:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9367c4489000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444328.851526:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557778176:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 612us (2469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444328.851535:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5877 00000100:00100000:2.0:1783444328.861533:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444328.861630:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557778304 00000100:00100000:1.0:1783444328.861641:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557778304 00000100:00100000:1.0:1783444328.861730:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1873 00000100:00100000:1.0:1783444328.861740:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:68226:x1870073557778304:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:1.0:1783444328.861768:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444328.861886:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:68226:x1870073557778304:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 147us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444328.861893:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1873 00000100:00080000:3.0:1783444328.862396:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783444329.437324:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444329.757698:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575283328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444329.757830:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575283456:0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.757854:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.760614:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.760733:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575283968:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.760835:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.760873:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575284480:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.760901:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.760925:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575284992:0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.760935:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575283456 00000100:00100000:1.0:1783444329.760947:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575283456 00000100:00100000:2.0:1783444329.760959:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.760991:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783444329.761019:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783444329.761030:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575283456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.761100:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575283456:12345-0@lo:400:kworker.0 Request processed in 72us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444329.761108:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783444329.761452:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575283840:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.761487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.761514:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575284352:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.761542:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.761566:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575284864:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.761590:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.761625:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575283456:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.761666:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575283584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.761706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.761730:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575284096:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.761759:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.761888:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e729a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575284608:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.761916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444329.761931:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575283968 00000100:00100000:2.0:1783444329.761938:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c2c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575285120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444329.761938:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575283968 00000100:00100000:2.0:1783444329.761964:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.761990:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783444329.761996:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575284480 00000100:00100000:1.0:1783444329.762000:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575284480 00000100:00100000:1.0:1783444329.762015:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575284992 00000100:00100000:1.0:1783444329.762018:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575284992 00000100:00100000:1.0:1783444329.762031:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575283840 00000100:00100000:1.0:1783444329.762033:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575283840 00000100:00100000:1.0:1783444329.762047:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575283584 00000100:00100000:1.0:1783444329.762049:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575283584 00000100:00100000:1.0:1783444329.762064:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1783444329.762071:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575283968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.762082:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575283712:0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.762132:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575283968:12345-0@lo:400:kworker.0 Request processed in 60us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444329.762146:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1783444329.762161:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1783444329.762167:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e729bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575284480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.762194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444329.762203:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e729bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575284480:12345-0@lo:400:kworker.0 Request processed in 35us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444329.762209:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1783444329.762223:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575283712 00000100:00100000:1.0:1783444329.762225:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575283712 00000100:00100000:1.0:1783444329.762242:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1783444329.762247:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575284992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.762276:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575284992:12345-0@lo:400:kworker.0 Request processed in 29us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444329.762281:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1783444329.762292:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1783444329.762297:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575283840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.762312:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575284224:0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.765909:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575283328 00000100:00100000:3.0:1783444329.765931:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575283328 00000100:00100000:3.0:1783444329.765980:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575284096 00000100:00100000:3.0:1783444329.765983:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575284096 00000100:00100000:3.0:1783444329.765992:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575284608 00000100:00100000:3.0:1783444329.765995:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575284608 00000100:00100000:3.0:1783444329.766006:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575285120 00000100:00100000:3.0:1783444329.766009:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575285120 00000100:00100000:3.0:1783444329.766033:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:3.0:1783444329.766044:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575283328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444329.766095:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 28672 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444329.766196:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575283328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (8344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.766204:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:3.0:1783444329.766222:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1783444329.766229:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575284096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.766263:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575284096:12345-0@lo:400:kworker.0 Request processed in 34us (4503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.766270:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1783444329.766294:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:3.0:1783444329.766299:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575284608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.766332:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575284608:12345-0@lo:400:kworker.0 Request processed in 33us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.766338:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:3.0:1783444329.766348:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1783444329.766354:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575285120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444329.766375:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444329.766404:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575285120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (4439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.766410:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1783444329.766488:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575283328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444329.767952:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575284352 00000100:00100000:3.0:1783444329.767967:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575284352 00000100:00100000:3.0:1783444329.768035:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575284864 00000100:00100000:3.0:1783444329.768038:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575284864 00000100:00100000:3.0:1783444329.768068:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:3.0:1783444329.768078:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575284352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.768176:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575284352:12345-0@lo:400:kworker.0 Request processed in 99us (6632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.768184:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:3.0:1783444329.768200:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:3.0:1783444329.768206:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575284864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.768238:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575284864:12345-0@lo:400:kworker.0 Request processed in 32us (6647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.768244:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:3.0:1783444329.768282:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1783444329.768291:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.768332:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575283584:12345-0@lo:400:kworker.0 Request processed in 43us (6626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.768339:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1783444329.768358:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1783444329.768366:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575283712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.768397:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575283712:12345-0@lo:400:kworker.0 Request processed in 32us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.768403:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1783444329.770981:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575283840:12345-0@lo:400:kworker.0 Request processed in 8667us (9477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444329.771002:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00080000:1.0:1783444329.771064:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444329.771072:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783444329.771076:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444329.771139:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575283840:0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.771159:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575284352:0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.771176:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575284864:0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.771209:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575283968:0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.771224:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575284480:0@lo:400:kworker.0 00000100:00100000:1.0:1783444329.771246:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575284992:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.771805:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.771855:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575284736:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.771899:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444329.771931:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575283584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.771946:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575284096:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.771959:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e729a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575284608:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.771979:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c2c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575285120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444329.771981:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575284224 00000100:00100000:3.0:1783444329.771989:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575284224 00000100:00100000:2.0:1783444329.772012:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575283712:0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.772049:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575284736 00000100:00100000:3.0:1783444329.772053:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575284736 00000100:00100000:3.0:1783444329.772076:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:3.0:1783444329.772086:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575284224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.772155:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575284224:12345-0@lo:400:kworker.0 Request processed in 69us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.772163:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:3.0:1783444329.772176:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:3.0:1783444329.772182:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575284736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444329.772204:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575284736:12345-0@lo:400:kworker.0 Request processed in 23us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444329.772210:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00080000:1.0:1783444329.772300:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444329.773956:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575284224:0@lo:400:kworker.0 00000100:00100000:2.0:1783444329.773978:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575284736:0@lo:400:kworker.0 00000100:00100000:1.0:1783444330.268999:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444330.269023:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c2c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575285248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444330.269098:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444330.269146:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575285248 00000100:00100000:1.0:1783444330.269154:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575285248 00000100:00100000:1.0:1783444330.269204:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1783444330.269214:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575285248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444330.269245:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444330.269292:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575285248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444330.269299:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1783444330.269351:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c2c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575285248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444330.269515:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575285376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444330.269545:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444330.269586:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575285376 00000100:00100000:3.0:1783444330.269590:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575285376 00000100:00100000:3.0:1783444330.269612:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:3.0:1783444330.269619:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575285376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444330.269636:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444330.269669:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575285376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444330.269676:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00100000:3.0:1783444330.269717:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575285376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783444330.461912:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783444330.790987:0:89002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149697 is committed 00000001:00100000:0.0:1783444330.794901:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:0.0:1783444330.794917:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969449 is committed 00000001:00100000:3.0:1783444330.796399:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:3.0:1783444330.796415:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969453 is committed 00010000:00010000:3.0:1783444331.484985:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444331.595532:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444331.595649:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444331.595698:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444331.595742:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557778944 00000100:00100000:1.0:1783444331.595752:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557778944 00000100:00100000:1.0:1783444331.595850:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2365 00000100:00100000:1.0:1783444331.595862:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557778944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444331.595939:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557778944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444331.595962:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2365 00000100:00080000:1.0:1783444331.595987:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444331.600155:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557778432 00000100:00100000:2.0:1783444331.600174:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557778432 00000100:00100000:2.0:1783444331.600306:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:2.0:1783444331.600326:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557778432:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444331.600409:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557778432:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 87us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444331.600417:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1783444331.602008:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557778688 00000100:00100000:3.0:1783444331.602023:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557778688 00000100:00100000:3.0:1783444331.602112:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 934 00000100:00100000:3.0:1783444331.602123:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557778688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:2.0:1783444331.602137:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444331.602346:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557778688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 224us (6696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444331.602353:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 934 00000100:00100000:3.0:1783444331.605023:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444331.605120:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557778560 00000100:00100000:3.0:1783444331.605124:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444331.605134:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557778560 00000100:00100000:2.0:1783444331.605234:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 935 00000100:00100000:3.0:1783444331.605242:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557778816 00000100:00100000:3.0:1783444331.605249:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557778816 00000100:00100000:2.0:1783444331.605249:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2402:x1870073557778560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444331.605287:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2366 00000100:00100000:3.0:1783444331.605296:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557778816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444331.605344:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2402:x1870073557778560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444331.605352:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 935 00000100:00080000:2.0:1783444331.605374:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444331.605379:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444331.607049:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557778816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 1742us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444331.607063:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2366 00000100:00100000:0.0:1783444332.318126:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444332.318188:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575285632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444332.318314:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444332.318371:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575285632 00000100:00100000:0.0:1783444332.318381:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575285632 00000100:00100000:0.0:1783444332.318443:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:0.0:1783444332.318453:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575285632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444332.318504:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444332.318555:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575285632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444332.318563:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00080000:0.0:1783444332.318587:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444332.318629:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575285632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444332.318777:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575285504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444332.318837:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444332.319598:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575285504 00000100:00100000:0.0:1783444332.319607:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575285504 00000100:00100000:0.0:1783444332.319675:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1783444332.319692:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575285504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444332.319739:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444332.319819:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575285504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444332.319826:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1783444332.319867:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575285504:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783444332.319954:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783444332.511107:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444333.533155:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444334.558414:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783444334.579785:0:89586:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:0.0:1783444334.877279:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575285760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444334.877357:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575285888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444334.877399:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444334.877440:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575285760 00000100:00100000:1.0:1783444334.877451:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575285760 00000100:00100000:1.0:1783444334.877517:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:1.0:1783444334.877525:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575285760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444334.877582:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444334.878350:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575286016:0@lo:400:kworker.0 00000100:00100000:1.0:1783444334.882064:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444334.882418:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575285888 00000100:00100000:3.0:1783444334.882431:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575285888 00000100:00100000:3.0:1783444334.882490:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1783444334.882502:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575285888:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444334.882520:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575285760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4990us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444334.882532:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000004:00000024:3.0:1783444334.882548:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444835328 avail 1298595840 00000100:00100000:0.0:1783444334.882589:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575285760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444334.886010:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575285888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3501us (3944us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444334.886028:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:3.0:1783444334.886139:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444334.886410:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575286272:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.886459:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444334.886571:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575286400:0@lo:400:kworker.0 00000100:00100000:0.0:1783444334.886689:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575286144:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.886843:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575286784:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.886934:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444334.886954:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575287296:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.886974:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444334.887025:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444334.887043:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575286656:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.887065:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444334.887082:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575287168:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.887101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444334.887138:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575286272 00000100:00100000:2.0:1783444334.887147:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575286272 00000100:00100000:2.0:1783444334.888386:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575287296 00000100:00100000:2.0:1783444334.888395:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575287296 00000100:00100000:2.0:1783444334.888416:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575286144 00000100:00100000:2.0:1783444334.888419:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575286144 00000100:00100000:2.0:1783444334.888442:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1783444334.888452:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575286272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.888544:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575286272:12345-0@lo:400:kworker.0 Request processed in 93us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444334.888551:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1783444334.888569:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1783444334.888575:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575287296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.888616:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575287296:12345-0@lo:400:kworker.0 Request processed in 41us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444334.888621:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1783444334.888632:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:2.0:1783444334.888638:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575286144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.888678:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575286144:12345-0@lo:400:kworker.0 Request processed in 30us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444334.888683:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00080000:2.0:1783444334.888707:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444334.888724:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444334.888769:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575286144:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.888840:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575286272:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.888856:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575287296:0@lo:400:kworker.0 00000100:00100000:3.0:1783444334.888867:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575286528:0@lo:400:kworker.0 00000100:00100000:3.0:1783444334.888905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444334.888932:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575286528 00000100:00100000:3.0:1783444334.888936:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575286528 00000100:00100000:3.0:1783444334.888970:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:3.0:1783444334.888977:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575286528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444334.889010:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575286528:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444334.889017:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:3.0:1783444334.889044:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575286528:0@lo:400:kworker.0 00000100:00100000:3.0:1783444334.889133:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575287040:0@lo:400:kworker.0 00000100:00100000:3.0:1783444334.889236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444334.889281:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575286784 00000100:00100000:0.0:1783444334.889287:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575286784 00000100:00100000:0.0:1783444334.889325:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575286656 00000100:00100000:0.0:1783444334.889328:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575286656 00000100:00100000:3.0:1783444334.889339:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575287168 00000100:00100000:0.0:1783444334.889353:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575287040 00000100:00100000:0.0:1783444334.889357:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575287040 00000100:00100000:0.0:1783444334.889377:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00100000:0.0:1783444334.889384:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575286784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444334.889420:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575286784:12345-0@lo:400:kworker.0 Request processed in 36us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444334.889426:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00000100:00100000:0.0:1783444334.889438:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:0.0:1783444334.889444:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575286656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444334.889498:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575286656:12345-0@lo:400:kworker.0 Request processed in 55us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444334.889505:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00100000:0.0:1783444334.889515:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00100000:0.0:1783444334.889521:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575287040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444334.889528:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575287168 00000100:00100000:0.0:1783444334.889556:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575287040:12345-0@lo:400:kworker.0 Request processed in 34us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444334.889563:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00100000:3.0:1783444334.889580:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00100000:3.0:1783444334.889590:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575287168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444334.889640:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575287168:12345-0@lo:400:kworker.0 Request processed in 52us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444334.890009:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575286016 00000100:00100000:1.0:1783444334.890015:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575286016 00000100:00100000:1.0:1783444334.890117:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783444334.890125:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575286016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444334.890164:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575286016:12345-0@lo:400:kworker.0 Request processed in 41us (4026us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444334.890170:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783444334.890219:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444334.890245:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575286912:0@lo:400:kworker.0 00000100:00100000:1.0:1783444334.890271:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444334.890280:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575286784:0@lo:400:kworker.0 00000100:00100000:1.0:1783444334.890312:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575285888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444334.890318:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575286400 00000100:00100000:2.0:1783444334.890323:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575286400 00000100:00100000:2.0:1783444334.890403:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575286912 00000100:00100000:2.0:1783444334.890407:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575286912 00000100:00100000:2.0:1783444334.890432:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1783444334.890439:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e729a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575286400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444334.890483:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1783444334.890493:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575286912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.890496:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e729a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575286400:12345-0@lo:400:kworker.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444334.890505:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:1.0:1783444334.890533:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575286912:12345-0@lo:400:kworker.0 Request processed in 40us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444334.890546:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575286400:0@lo:400:kworker.0 00000100:00100000:1.0:1783444334.890552:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:2.0:1783444334.890564:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575286912:0@lo:400:kworker.0 00000100:00080000:1.0:1783444334.890584:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783444334.890589:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444334.890632:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:2.0:1783444334.890662:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575287040:0@lo:400:kworker.0 00000100:00080000:1.0:1783444334.890727:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444334.890730:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444334.890759:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575286656:0@lo:400:kworker.0 00000100:00100000:1.0:1783444334.890769:0:3633:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 2 00000100:00100000:1.0:1783444334.890779:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575287168:0@lo:400:kworker.0 00000100:00100000:2.0:1783444334.891271:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575286016:0@lo:400:kworker.0 00000100:00100000:3.0:1783444334.893452:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00100000:2.0:1783444335.389083:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575287424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444335.389175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444335.389307:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575287424 00000100:00100000:0.0:1783444335.389316:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575287424 00000100:00100000:0.0:1783444335.389372:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:0.0:1783444335.389383:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575287424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444335.389411:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444335.389471:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575287424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444335.389477:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00100000:2.0:1783444335.389614:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575287424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444335.390947:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444335.390984:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575287552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444335.391033:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444335.394088:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575287552 00000100:00100000:3.0:1783444335.394102:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575287552 00000100:00100000:3.0:1783444335.394264:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:3.0:1783444335.394275:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575287552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444335.394324:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444335.394422:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575287552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (3387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444335.394441:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1783444335.394501:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575287552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783444335.582509:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783444336.353009:0:89634:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1783444336.609172:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444336.731846:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444336.731894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444336.731900:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557779072 00000100:00100000:1.0:1783444336.731910:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557779072 00000100:00100000:3.0:1783444336.731937:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444336.731963:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:1.0:1783444336.731973:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2401:x1870073557779072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444336.732005:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557779456 00000100:00100000:0.0:1783444336.732010:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557779456 00000100:00100000:1.0:1783444336.732047:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2401:x1870073557779072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444336.732056:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2371 00000100:00100000:0.0:1783444336.732063:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557779456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444336.732064:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:0.0:1783444336.732092:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557779456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 31us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444336.732099:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2371 00000100:00080000:3.0:1783444336.732689:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444336.735667:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557779200 00000100:00100000:2.0:1783444336.735693:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557779200 00000100:00100000:2.0:1783444336.735784:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 942 00000100:00100000:2.0:1783444336.735811:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2402:x1870073557779200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444336.735895:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2402:x1870073557779200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 86us (4001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444336.735903:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 942 00000100:00080000:3.0:1783444336.736110:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444336.740568:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444336.740612:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444336.740723:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557779584 00000100:00100000:0.0:1783444336.740733:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557779584 00000100:00100000:0.0:1783444336.740874:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2372 00000100:00100000:0.0:1783444336.740903:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557779584:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444336.740988:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557779584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 87us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444336.740995:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2372 00000100:00080000:3.0:1783444336.741486:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444336.741591:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557779328 00000100:00100000:2.0:1783444336.741598:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557779328 00000100:00100000:2.0:1783444336.741658:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 943 00000100:00100000:2.0:1783444336.741667:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557779328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444336.741767:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557779328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444336.741774:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 943 00000100:00080000:3.0:1783444336.741949:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444337.440068:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575287680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444337.440151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444337.440267:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575287680 00000100:00100000:0.0:1783444337.440277:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575287680 00000100:00100000:0.0:1783444337.440355:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:0.0:1783444337.440368:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575287680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444337.440400:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444337.440448:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575287680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444337.440454:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00080000:1.0:1783444337.443708:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444337.443833:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575287680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444337.443864:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444337.443875:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575287808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444337.443939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444337.444090:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575287808 00000100:00100000:0.0:1783444337.444098:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575287808 00000100:00100000:0.0:1783444337.444165:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:0.0:1783444337.444177:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575287808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444337.444208:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444337.444255:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575287808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444337.444263:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00080000:1.0:1783444337.444594:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444337.444622:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575287808:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783444337.629072:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444338.234903:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444338.235064:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557779712 00000100:00100000:1.0:1783444338.235078:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557779712 00000100:00100000:1.0:1783444338.235191:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1207 00000100:00100000:1.0:1783444338.235211:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+8:68694:x1870073557779712:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1783444338.235269:0:66223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444835328 avail 1298595840 00000100:00100000:1.0:1783444338.235372:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+8:68694:x1870073557779712:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 171us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444338.235381:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1207 00000100:00080000:3.0:1783444338.236829:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444338.238292:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444338.240931:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557779840 00000100:00100000:2.0:1783444338.240947:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557779840 00000100:00100000:2.0:1783444338.241124:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1208 00000100:00100000:2.0:1783444338.241136:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:68694:x1870073557779840:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1783444338.241183:0:67017:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444338.241276:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:68694:x1870073557779840:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 143us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444338.241302:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1208 00000100:00080000:3.0:1783444338.249365:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444338.251262:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444338.251390:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557779968 00000100:00100000:2.0:1783444338.251401:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557779968 00000100:00100000:2.0:1783444338.251547:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1882 00000100:00100000:2.0:1783444338.251559:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:68694:x1870073557779968:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444338.251592:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444338.251680:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:68694:x1870073557779968:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 124us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444338.251687:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1882 00000100:00080000:3.0:1783444338.255710:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444338.256386:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444338.256828:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557780096 00000100:00100000:2.0:1783444338.256838:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557780096 00000100:00100000:2.0:1783444338.256958:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1883 00000100:00100000:2.0:1783444338.256969:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:68694:x1870073557780096:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444338.256997:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444338.257085:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:68694:x1870073557780096:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 117us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444338.257103:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1883 00000100:00080000:3.0:1783444338.259813:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444338.314889:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444338.314997:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557780352 00000100:00100000:2.0:1783444338.315009:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557780352 00000100:00100000:2.0:1783444338.315078:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1209 00000100:00100000:2.0:1783444338.315097:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:68711:x1870073557780352:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1783444338.315121:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444338.315148:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832497 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b2f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315303:0:71469:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 9 pid: 89037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315323:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315336:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315349:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315455:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315463:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315471:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315478:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444338.315482:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315715:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315729:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367c460be00) 00010000:00010000:2.0:1783444338.315733:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444338.315744:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315750:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e383249e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315853:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832497 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b2f expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315863:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c709e700) 00010000:00010000:2.0:1783444338.315866:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783444338.315870:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832497 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b2f expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.315879:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11a00, rc 0) 00000100:00100000:2.0:1783444338.316158:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+9:68711:x1870073557780352:12345-192.168.204.20@tcp:101:cat.0 Request processed in 1071us (1280us total) trans 111669149698 rc 301/301 00000100:00100000:2.0:1783444338.316167:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1209 00000100:00100000:1.0:1783444338.334419:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444338.334534:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557780480 00000100:00100000:2.0:1783444338.334545:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557780480 00000100:00100000:2.0:1783444338.334608:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1210 00000100:00100000:2.0:1783444338.334629:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+9:68711:x1870073557780480:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1783444338.334662:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444338.334687:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38324ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b36 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.334756:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.334835:0:66223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 10 pid: 89037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.334846:0:66223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 4/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.334882:0:66223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 10 pid: 89037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.334898:0:66223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 10 pid: 89037 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444338.334913:0:66223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575287936:192.168.204.20@tcp:104: 00000100:00100000:2.0:1783444338.335012:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444338.338343:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444338.338454:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557780608 00000100:00100000:1.0:1783444338.338466:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557780608 00010000:00010000:1.0:1783444338.338518:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 11 pid: 89037 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444338.338576:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2547 00000100:00100000:1.0:1783444338.338588:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2403:x1870073557780608:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444338.338608:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:1.0:1783444338.338648:0:6491:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:1.0:1783444338.338652:0:6491:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1783444289 00000004:00010000:1.0:1783444338.338654:0:6491:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1783444281 00000004:00010000:1.0:1783444338.338657:0:6491:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1783444289 00010000:00010000:1.0:1783444338.338663:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 11 pid: 89037 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444338.338679:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 11 pid: 89037 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444338.338737:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367c460be00) 00010000:00010000:1.0:1783444338.338744:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444338.338755:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444338.338775:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 4/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444338.338840:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444338.338906:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2403:x1870073557780608:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 320us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444338.338915:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2547 00010000:00010000:2.0:1783444338.339769:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368ef263a00/0x42cb6883e38322b4 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939afe expref: 10 pid: 89037 timeout: 3429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444338.339827:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575287936:192.168.204.20@tcp:104: 00010000:00010000:2.0:1783444338.339857:0:66223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.339867:0:66223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.339872:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444338.339927:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444338.339963:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.339995:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38324ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b36 expref: 10 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.340010:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b36 expref: 9 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.340028:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367c460be00) 00010000:00010000:2.0:1783444338.340032:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444338.340036:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10c00, rc 0) 00000100:00100000:2.0:1783444338.340082:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+9:68711:x1870073557780480:12345-192.168.204.20@tcp:101:cat.0 Request processed in 5464us (5674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444338.340955:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1210 00000100:00100000:0.0:1783444338.345690:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444338.346216:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557780736 00000100:00100000:2.0:1783444338.346230:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557780736 00000100:00100000:2.0:1783444338.346351:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1211 00000100:00100000:2.0:1783444338.346363:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+9:68711:x1870073557780736:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1783444338.346391:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444338.346417:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e38324ba lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b3d expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.346484:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e38324ba lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b3d expref: 10 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.346512:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e38324ba lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b3d expref: 10 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444338.346557:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367c460be00) 00010000:00010000:2.0:1783444338.346561:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783444338.346565:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11200, rc 0) 00000100:00100000:2.0:1783444338.346645:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:68711:x1870073557780736:12345-192.168.204.20@tcp:101:cat.0 Request processed in 283us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444338.346653:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1211 00000100:00100000:1.0:1783444338.351411:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444338.362407:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557780864 00000100:00100000:0.0:1783444338.362425:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557780864 00000100:00100000:0.0:1783444338.362577:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1212 00000100:00100000:0.0:1783444338.362590:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2404:x1870073557780864:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:0.0:1783444338.362685:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444338.362718:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38324c1 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b44 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444338.362955:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38324c1 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b44 expref: 11 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444338.362991:0:66225:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:0.0:1783444338.362994:0:66225:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1783444289 -> 1783444289 00000004:00010000:0.0:1783444338.363008:0:66225:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1783444281 -> 1783444281 00000004:00010000:0.0:1783444338.363011:0:66225:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1783444289 -> 1783444289 00000004:00010000:0.0:1783444338.363013:0:66225:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:0.0:1783444338.363075:0:66225:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:0.0:1783444338.363086:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38324c1 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b44 expref: 11 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444338.363101:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff9367c460be00) 00010000:00010000:0.0:1783444338.363104:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783444338.363109:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751200, rc 0) 00000100:00100000:0.0:1783444338.363182:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2404:x1870073557780864:12345-192.168.204.20@tcp:101:cat.0 Request processed in 594us (11779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444338.363190:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1212 00000100:00100000:1.0:1783444338.372750:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444338.372906:0:66247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557780992 00000100:00100000:2.0:1783444338.372916:0:66247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557780992 00002000:00100000:2.0:1783444338.372977:0:66247:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff9367c33f7100 x1870073557780992/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:714/0 lens 488/0 e 0 to 0 dl 1783444349 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783444338.372988:0:66247:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9367c33f7100 with x1870073557780992 00000100:00100000:2.0:1783444338.373041:0:66247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1783444338.373051:0:66247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2402:x1870073557780992:12345-192.168.204.20@tcp:3:cat.0 00000100:00100000:2.0:1783444338.373251:0:66247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2402:x1870073557780992:12345-192.168.204.20@tcp:3:cat.0 Request processed in 200us (511us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783444338.373259:0:66247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00002000:00100000:2.0:1783444338.373266:0:66247:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff9367c33f7100 x1870073557780992/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:714/0 lens 488/4536 e 0 to 0 dl 1783444349 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783444338.373273:0:66247:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9367c33f7100 with x1870073557780992 00000100:00100000:0.0:1783444338.384455:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444338.384877:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557781248 00000100:00100000:2.0:1783444338.384887:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557781248 00000100:00100000:2.0:1783444338.384955:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:2.0:1783444338.384966:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+11:68711:x1870073557781248:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:2.0:1783444338.385245:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+12:68711:x1870073557781248:12345-192.168.204.20@tcp:35:cat.0 Request processed in 279us (802us total) trans 111669149699 rc 0/0 00000100:00100000:2.0:1783444338.385260:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 225 00010000:00010000:3.0:1783444338.653060:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444339.679887:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444339.997124:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575288064:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997215:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444339.997265:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575288576:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997293:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444339.997310:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575289088:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997332:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444339.997349:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575289600:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997371:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444339.997395:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783444339.997402:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575288192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997423:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444339.997438:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575288704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997479:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444339.997506:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575289216:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997538:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444339.997569:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575288064 00000100:00100000:2.0:1783444339.997577:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575288064 00000100:00100000:2.0:1783444339.997625:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783444339.997634:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575288064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997687:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575288064:12345-0@lo:400:kworker.0 Request processed in 52us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444339.997700:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783444339.997744:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575288576 00000100:00100000:2.0:1783444339.997762:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575288576 00000100:00100000:2.0:1783444339.997822:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575289088 00000100:00100000:2.0:1783444339.997826:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575289088 00000100:00100000:2.0:1783444339.997842:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575289600 00000100:00100000:2.0:1783444339.997844:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575289600 00000100:00100000:2.0:1783444339.997856:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575288192 00000100:00100000:2.0:1783444339.997858:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575288192 00000100:00100000:2.0:1783444339.997871:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1783444339.997877:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575288576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997926:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575288576:12345-0@lo:400:kworker.0 Request processed in 48us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444339.997932:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1783444339.997945:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1783444339.997950:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575289088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.997977:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575289088:12345-0@lo:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444339.997983:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1783444339.998000:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:2.0:1783444339.998006:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575289600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.998033:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575289600:12345-0@lo:400:kworker.0 Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444339.998038:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:2.0:1783444339.998052:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1783444339.998058:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575288192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.998088:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575288192:12345-0@lo:400:kworker.0 Request processed in 30us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444339.998093:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1783444339.998137:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575288320:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.998141:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575288192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.998151:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575288064:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.998160:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575288576:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.998168:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575289088:0@lo:400:kworker.0 00000100:00100000:1.0:1783444339.998169:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444339.998178:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575289600:0@lo:400:kworker.0 00000100:00100000:1.0:1783444339.998191:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575288832:0@lo:400:kworker.0 00000100:00100000:1.0:1783444339.998214:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444339.998418:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575288448:0@lo:400:kworker.0 00000100:00100000:0.0:1783444339.998448:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444339.998468:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575288960:0@lo:400:kworker.0 00000100:00100000:0.0:1783444339.998491:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444339.998510:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575289344:0@lo:400:kworker.0 00000100:00100000:0.0:1783444339.998520:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575289472:0@lo:400:kworker.0 00000100:00100000:1.0:1783444339.998535:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444339.998546:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575288320 00000100:00100000:0.0:1783444339.998568:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575288320 00000100:00100000:0.0:1783444339.998590:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575288448 00000100:00100000:0.0:1783444339.998591:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575288448 00000100:00100000:3.0:1783444339.998649:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575288704 00000100:00100000:3.0:1783444339.998654:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575288704 00000100:00100000:3.0:1783444339.998679:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575289216 00000100:00100000:3.0:1783444339.998683:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575289216 00000100:00100000:3.0:1783444339.998704:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1783444339.998711:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575288704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444339.998757:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575288704:12345-0@lo:400:kworker.0 Request processed in 47us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444339.998764:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1783444339.998776:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:3.0:1783444339.998782:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575289216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444339.998829:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575289216:12345-0@lo:400:kworker.0 Request processed in 47us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444339.998835:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00080000:3.0:1783444339.998851:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444339.998855:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444339.998866:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1783444339.998873:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575288320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444339.998930:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1783444339.998938:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575288448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444339.998981:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575288448:12345-0@lo:400:kworker.0 Request processed in 45us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444339.998986:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:3.0:1783444339.999080:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575288320:12345-0@lo:400:kworker.0 Request processed in 207us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444339.999086:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1783444339.999128:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575288704:0@lo:400:kworker.0 00000100:00100000:3.0:1783444339.999139:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575289216:0@lo:400:kworker.0 00000100:00100000:3.0:1783444339.999156:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444339.999174:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575289728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444339.999202:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444339.999227:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575289728 00000100:00100000:3.0:1783444339.999230:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575289728 00000100:00100000:3.0:1783444339.999257:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1783444339.999262:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575289728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444339.999290:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444339.999319:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575289728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444339.999324:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1783444339.999347:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575289728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444339.999622:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575288320:0@lo:400:kworker.0 00000100:00100000:2.0:1783444339.999652:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444339.999696:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575289856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444339.999722:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444339.999751:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575289856 00000100:00100000:3.0:1783444339.999755:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575289856 00000100:00100000:3.0:1783444339.999777:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1783444339.999782:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575289856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444339.999819:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444339.999851:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575289856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444339.999857:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1783444339.999883:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575289856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444340.000286:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575288448:0@lo:400:kworker.0 00000100:00100000:1.0:1783444340.000363:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575288960 00000100:00100000:0.0:1783444340.000363:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575288832 00000100:00100000:1.0:1783444340.000368:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575288960 00000100:00100000:0.0:1783444340.000368:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575288832 00000100:00100000:1.0:1783444340.000419:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575289344 00000100:00100000:3.0:1783444340.000432:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575289472 00000100:00100000:3.0:1783444340.000436:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575289472 00000100:00100000:1.0:1783444340.000436:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575289344 00000100:00100000:0.0:1783444340.000481:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:0.0:1783444340.000487:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575288960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444340.000543:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575288960:12345-0@lo:400:kworker.0 Request processed in 55us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444340.000550:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00100000:0.0:1783444340.000563:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:0.0:1783444340.000568:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575288832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444340.000594:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575288832:12345-0@lo:400:kworker.0 Request processed in 25us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444340.000599:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:0.0:1783444340.000632:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575288960:0@lo:400:kworker.0 00000100:00100000:0.0:1783444340.000654:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575288832:0@lo:400:kworker.0 00000100:00080000:2.0:1783444340.000785:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444340.000819:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444340.001141:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1783444340.001148:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575289472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444340.001190:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575289472:12345-0@lo:400:kworker.0 Request processed in 43us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444340.001207:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:3.0:1783444340.001215:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575289344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444340.001260:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575289344:12345-0@lo:400:kworker.0 Request processed in 47us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444340.001267:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:2.0:1783444340.001326:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575289344:0@lo:400:kworker.0 00000100:00100000:1.0:1783444340.001362:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1783444340.001395:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575289472:0@lo:400:kworker.0 00000100:00100000:3.0:1783444340.513970:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444340.514001:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575289984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444340.514076:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444340.514205:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575289984 00000100:00100000:0.0:1783444340.514214:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575289984 00000100:00100000:0.0:1783444340.514275:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:0.0:1783444340.514287:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575289984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444340.514320:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444340.514377:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575289984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444340.514384:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:3.0:1783444340.514595:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575289984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444340.517939:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575290112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444340.518015:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444340.518507:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575290112 00000100:00100000:0.0:1783444340.518516:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575290112 00000100:00100000:0.0:1783444340.518677:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:0.0:1783444340.518687:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575290112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444340.518719:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444340.518784:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575290112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444340.518828:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00100000:1.0:1783444340.518917:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575290112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783444340.701096:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444341.725105:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444341.837198:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444341.837237:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444341.837276:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444341.837304:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444341.837327:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444341.837350:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557781376 00000100:00100000:3.0:1783444341.837360:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557781376 00000100:00100000:3.0:1783444341.837408:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1783444341.837418:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557781376:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444341.837502:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557781376:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444341.837510:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1783444341.837539:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557781504 00000100:00100000:3.0:1783444341.837542:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557781504 00000100:00100000:3.0:1783444341.837573:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557781632 00000100:00100000:3.0:1783444341.837576:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557781632 00000100:00100000:3.0:1783444341.837604:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 950 00000100:00100000:3.0:1783444341.837610:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2402:x1870073557781504:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444341.837646:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+12:2402:x1870073557781504:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444341.837653:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 950 00000100:00100000:3.0:1783444341.837665:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 951 00000100:00100000:3.0:1783444341.837671:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557781632:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444341.837696:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557781632:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444341.837702:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 951 00000100:00080000:3.0:1783444341.837847:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444341.837852:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444341.838074:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557781760 00000100:00100000:1.0:1783444341.838080:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557781760 00000100:00100000:1.0:1783444341.838117:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557781888 00000100:00100000:1.0:1783444341.838120:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557781888 00000100:00100000:1.0:1783444341.838141:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2377 00000100:00100000:1.0:1783444341.838148:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557781760:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444341.838182:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557781760:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 34us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444341.838188:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2377 00000100:00100000:1.0:1783444341.838203:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2378 00000100:00100000:1.0:1783444341.838209:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557781888:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444341.838232:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557781888:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444341.838238:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2378 00000100:00080000:3.0:1783444341.838529:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444341.838532:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444342.558884:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575290240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444342.558896:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444342.558913:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575290368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444342.558960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444342.558996:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575290368 00000100:00100000:3.0:1783444342.559005:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575290368 00000100:00100000:2.0:1783444342.559017:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444342.559072:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575290240 00000100:00100000:3.0:1783444342.559076:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575290240 00000100:00080000:0.0:1783444342.559161:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444342.559166:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444342.560036:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1783444342.560053:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575290368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444342.560086:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444342.560155:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575290368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444342.560162:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1783444342.560182:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:2.0:1783444342.560189:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575290240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444342.560205:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444342.560257:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575290240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444342.560264:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:2.0:1783444342.560312:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575290240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444342.560422:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575290368:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783444342.754382:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444343.795537:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783444344.130536:0:89002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:3.0:1783444344.800576:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444345.117347:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575290752:0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.117428:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444345.117463:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575291264:0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.117503:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444345.117523:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575291776:0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.117546:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444345.117567:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783444345.117574:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575290624:0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.117594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444345.117610:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575291136:0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.117630:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444345.117646:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575291648:0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.117665:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444345.117695:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575290752 00000100:00100000:2.0:1783444345.117702:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575290752 00000100:00100000:2.0:1783444345.117750:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575290624 00000100:00100000:2.0:1783444345.117755:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575290624 00000100:00100000:2.0:1783444345.117774:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1783444345.117783:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575290752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.117858:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575290752:12345-0@lo:400:kworker.0 Request processed in 75us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444345.117866:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1783444345.117912:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1783444345.117920:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575290624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444345.117938:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575291264 00000100:00100000:0.0:1783444345.117945:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575291264 00000100:00100000:2.0:1783444345.117954:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575290624:12345-0@lo:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444345.117960:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1783444345.117980:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575291776 00000100:00100000:0.0:1783444345.117984:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575291776 00000100:00100000:2.0:1783444345.117987:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:2.0:1783444345.117997:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575291264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444345.118008:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1783444345.118024:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575291776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.118032:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575291264:12345-0@lo:400:kworker.0 Request processed in 35us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444345.118039:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:2.0:1783444345.118068:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575291136 00000100:00100000:2.0:1783444345.118072:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575291136 00000100:00100000:0.0:1783444345.118077:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575291776:12345-0@lo:400:kworker.0 Request processed in 54us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444345.118085:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:2.0:1783444345.118100:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575291648 00000100:00100000:2.0:1783444345.118104:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575291648 00000100:00080000:0.0:1783444345.118106:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444345.118112:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444345.118124:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00080000:0.0:1783444345.118125:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444345.118132:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575291136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.118167:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575291136:12345-0@lo:400:kworker.0 Request processed in 36us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444345.118173:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:2.0:1783444345.118188:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:2.0:1783444345.118195:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575291648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.118223:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575291648:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444345.118231:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1783444345.118231:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575290624:0@lo:400:kworker.0 00000100:00100000:0.0:1783444345.118248:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575291136:0@lo:400:kworker.0 00000100:00100000:0.0:1783444345.118261:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575291648:0@lo:400:kworker.0 00000100:00100000:0.0:1783444345.118271:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575290752:0@lo:400:kworker.0 00000100:00100000:0.0:1783444345.118279:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575291264:0@lo:400:kworker.0 00000100:00100000:0.0:1783444345.118287:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575291776:0@lo:400:kworker.0 00000100:00100000:1.0:1783444345.118504:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575290496:0@lo:400:kworker.0 00000100:00100000:1.0:1783444345.118540:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444345.118586:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575291008:0@lo:400:kworker.0 00000100:00100000:1.0:1783444345.118611:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444345.118640:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575291520:0@lo:400:kworker.0 00000100:00100000:1.0:1783444345.118657:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444345.118675:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575292032:0@lo:400:kworker.0 00000100:00100000:1.0:1783444345.118694:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444345.118711:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783444345.118718:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575290880:0@lo:400:kworker.0 00000100:00100000:1.0:1783444345.118738:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444345.118756:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575291392:0@lo:400:kworker.0 00000100:00100000:1.0:1783444345.118778:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444345.118829:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575291904:0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.118832:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575291008 00000100:00100000:3.0:1783444345.118838:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575291008 00000100:00100000:1.0:1783444345.118861:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444345.118868:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575291520 00000100:00100000:3.0:1783444345.118871:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575291520 00000100:00100000:3.0:1783444345.118899:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575292032 00000100:00100000:3.0:1783444345.118902:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575292032 00000100:00100000:1.0:1783444345.118913:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575290880 00000100:00100000:1.0:1783444345.118918:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575290880 00000100:00100000:3.0:1783444345.118926:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:3.0:1783444345.118936:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575291008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444345.118951:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1783444345.118960:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575291520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.119009:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575291008:12345-0@lo:400:kworker.0 Request processed in 75us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444345.119012:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575291520:12345-0@lo:400:kworker.0 Request processed in 52us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444345.119022:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1783444345.119110:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575290496 00000100:00100000:2.0:1783444345.119114:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575290496 00000100:00100000:2.0:1783444345.119143:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783444345.119155:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ddd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575290496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.119185:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ddd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575290496:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444345.119191:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783444345.119238:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575291392 00000100:00100000:2.0:1783444345.119242:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575291392 00000100:00100000:2.0:1783444345.119337:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575291904 00000100:00100000:2.0:1783444345.119341:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575291904 00000100:00100000:2.0:1783444345.119362:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:2.0:1783444345.119369:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575291392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.119408:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575291392:12345-0@lo:400:kworker.0 Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444345.119415:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:2.0:1783444345.119426:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:2.0:1783444345.119431:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575291904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444345.119459:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575291904:12345-0@lo:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444345.119464:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:1.0:1783444345.128737:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1783444345.133834:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1783444345.133861:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575292032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.134726:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1783444345.134740:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575290880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.134784:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575290880:12345-0@lo:400:kworker.0 Request processed in 49us (16044us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444345.134804:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1783444345.134913:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575292160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444345.134951:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444345.135037:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444345.135163:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444345.135166:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444345.135201:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575290880:0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.135215:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575291392:0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.135227:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575291904:0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.135238:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575290496:0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.135249:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575291008:0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.135261:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575291520:0@lo:400:kworker.0 00000100:00100000:3.0:1783444345.135347:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444345.135354:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575292288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444345.135580:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444345.135627:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575292160 00000100:00100000:3.0:1783444345.135633:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575292160 00000100:00100000:3.0:1783444345.135666:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575292288 00000100:00100000:3.0:1783444345.135669:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575292288 00000100:00100000:3.0:1783444345.135686:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:3.0:1783444345.135692:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575292160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444345.135717:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444345.135751:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575292160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444345.135758:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:3.0:1783444345.135770:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:3.0:1783444345.135775:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575292288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444345.135813:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444345.135838:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575292288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444345.135843:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:3.0:1783444345.135869:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575292288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444345.135879:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575292160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444345.136026:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575292032:12345-0@lo:400:kworker.0 Request processed in 2178us (17329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444345.136033:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1783444345.136081:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575292032:0@lo:400:kworker.0 00000100:00100000:0.0:1783444345.629636:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575292416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444345.629709:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444345.632837:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575292416 00000100:00100000:1.0:1783444345.632850:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575292416 00000100:00100000:1.0:1783444345.632932:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:1.0:1783444345.632943:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575292416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444345.632973:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444345.633052:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575292416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (3342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444345.633082:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:1.0:1783444345.633133:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575292416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444345.637160:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575292544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444345.637238:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444345.637289:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575292544 00000100:00100000:0.0:1783444345.637296:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575292544 00000100:00100000:0.0:1783444345.637335:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:0.0:1783444345.637342:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575292544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444345.637382:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444345.637436:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575292544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444345.637443:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00100000:0.0:1783444345.637483:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575292544:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783444345.822225:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783444346.304899:0:89830:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:3.0:1783444346.845078:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444346.956285:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444346.956327:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444346.956382:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444346.956410:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444346.956433:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444346.956458:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557782272 00000100:00100000:3.0:1783444346.956477:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557782272 00000100:00100000:1.0:1783444346.956643:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557782528 00000100:00100000:1.0:1783444346.956649:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557782528 00000100:00100000:1.0:1783444346.956686:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557782400 00000100:00100000:1.0:1783444346.956689:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557782400 00000100:00100000:1.0:1783444346.956708:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2383 00000100:00100000:1.0:1783444346.956716:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557782528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444346.956782:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557782528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 66us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444346.956817:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2383 00000100:00100000:1.0:1783444346.956833:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2384 00000100:00100000:1.0:1783444346.956839:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557782400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444346.956862:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557782400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444346.956868:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2384 00000100:00080000:1.0:1783444346.956911:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444346.956915:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444346.956918:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444346.957164:0:89015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557782016 00000100:00100000:2.0:1783444346.957170:0:89015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557782016 00000100:00100000:2.0:1783444346.957206:0:89015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:2.0:1783444346.957213:0:89015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557782016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444346.957245:0:89015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2402:x1870073557782016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 33us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444346.957252:0:89015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:3.0:1783444346.957444:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557782144 00000100:00100000:3.0:1783444346.957448:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557782144 00000100:00100000:3.0:1783444346.957470:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 958 00000100:00100000:3.0:1783444346.957477:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557782272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444346.957573:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557782272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444346.957580:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 958 00000100:00100000:3.0:1783444346.957593:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 959 00000100:00100000:3.0:1783444346.957598:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2402:x1870073557782144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444346.957621:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2402:x1870073557782144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444346.957626:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 959 00000100:00080000:1.0:1783444346.957833:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444347.678189:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575292800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444347.678276:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444347.678322:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575292672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444347.678372:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444347.678501:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575292800 00000100:00100000:0.0:1783444347.678501:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575292672 00000100:00100000:1.0:1783444347.678510:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575292800 00000100:00100000:0.0:1783444347.678510:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575292672 00000100:00100000:0.0:1783444347.678621:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:0.0:1783444347.678633:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575292672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444347.678665:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444347.678722:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575292672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444347.678729:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:3.0:1783444347.678774:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575292672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444347.680667:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:1.0:1783444347.680681:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575292800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444347.680728:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444347.680821:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575292800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444347.680829:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00100000:0.0:1783444347.680969:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575292800:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783444347.686555:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444347.686574:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783444347.870671:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783444348.478593:0:89878:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 13:12:28 (1783444348) 00000100:00100000:1.0:1783444348.576145:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444348.576275:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557782656 00000100:00100000:3.0:1783444348.576285:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557782656 00000100:00080000:1.0:1783444348.576402:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444348.576440:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1213 00000100:00100000:3.0:1783444348.576450:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69442:x1870073557782656:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444348.576470:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444348.576492:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e38324c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b4b expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576572:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576587:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576600:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576614:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576621:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576627:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576679:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576686:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576692:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576699:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576706:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1a800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444348.576716:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576724:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576737:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c709e700) 00010000:00010000:3.0:1783444348.576741:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444348.576745:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576752:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e38324cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576763:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576770:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576776:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576781:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1b200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444348.576784:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576829:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576838:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9367c1e5b100) 00010000:00010000:3.0:1783444348.576840:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444348.576849:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576855:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e38324d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.576995:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e38324c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b4b expref: 11 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.577006:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c709e700) 00010000:00010000:3.0:1783444348.577008:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444348.577012:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e38324c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b4b expref: 11 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.577020:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1ae00, rc 0) 00000100:00100000:3.0:1783444348.577085:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69442:x1870073557782656:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 636us (950us total) trans 0 rc 301/301 00000100:00100000:3.0:1783444348.577093:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1213 00000100:00100000:2.0:1783444348.589049:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444348.590004:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557782912 00000100:00100000:0.0:1783444348.590017:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557782912 00000100:00100000:0.0:1783444348.590080:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1214 00000100:00100000:0.0:1783444348.590090:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69442:x1870073557782912:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444348.590111:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444348.590120:0:66223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783444348.590146:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3832482 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b28 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.590164:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c709e700) 00010000:00010000:0.0:1783444348.590176:0:66223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444348.590192:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e38324dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b52 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596246:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596275:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596288:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596324:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596343:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596351:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596832:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596841:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596849:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444348.596861:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:2.0:1783444348.596885:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596912:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596919:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596926:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596933:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444348.596937:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596946:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596959:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96500) 00010000:00010000:2.0:1783444348.596962:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444348.596967:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596975:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38324e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444348.596987:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071c028b1 reply state 00000000e9ee967e transno 111669149700 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.596998:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.597004:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9367c709ea00) 00010000:00010000:2.0:1783444348.597012:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444348.597015:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783444348.597052:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e38324dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 12 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.597073:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444348.597081:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c709ed00) 00010000:00010000:2.0:1783444348.597083:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783444348.597085:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10800, rc 0) 00000100:00100000:2.0:1783444348.597161:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:69442:x1870073557782912:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 7072us (8122us total) trans 111669149700 rc 0/0 00000100:00100000:2.0:1783444348.597170:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1214 00000100:00100000:1.0:1783444348.606139:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444348.606280:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557783168 00000100:00100000:0.0:1783444348.606302:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557783168 00000100:00100000:0.0:1783444348.606378:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1215 00000100:00100000:0.0:1783444348.606388:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+12:69442:x1870073557783168:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444348.606417:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444348.606442:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3832500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b59 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.606570:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.606584:0:71469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 13 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.606594:0:71469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.606631:0:71469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 13 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.606668:0:71469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 13 pid: 66223 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444348.606682:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:71469:1870073575292928:192.168.204.20@tcp:104: 00000100:00100000:0.0:1783444348.606779:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6118cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444348.609354:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:71469:1870073575292928:192.168.204.20@tcp:104: 00010000:00010000:0.0:1783444348.609382:0:71469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444348.609748:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444348.609849:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557783296 00000100:00100000:0.0:1783444348.609858:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557783296 00010000:00010000:0.0:1783444348.609901:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 14 pid: 66223 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444348.609934:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2548 00000100:00100000:0.0:1783444348.609943:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+14:2404:x1870073557783296:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444348.609959:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444348.609966:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 14 pid: 66223 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.609979:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 14 pid: 66223 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.610000:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38324f2 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b52 expref: 14 pid: 66223 timeout: 3439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.610028:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c709ed00) 00010000:00010000:0.0:1783444348.610033:0:6490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.610043:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.610051:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444348.610073:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444348.610123:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2404:x1870073557783296:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 181us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444348.610130:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2548 00010000:00010000:3.0:1783444348.610605:0:71469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.610615:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444348.610634:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00000004:00080000:3.0:1783444348.610783:0:71469:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x2a3:0x0], count =127 00000004:00080000:3.0:1783444348.610820:0:71469:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x2a3:0x0]+127 in llog 00000004:00080000:3.0:1783444348.610867:0:71469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x322:0x0], index 1: 0 00010000:00010000:3.0:1783444348.610981:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611002:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611010:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611016:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444348.611020:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611028:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611040:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c709ed00) 00010000:00010000:3.0:1783444348.611043:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444348.611047:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611053:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e3832507 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611112:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3832500 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b59 expref: 13 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611122:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c4c96e00) 00010000:00010000:3.0:1783444348.611124:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783444348.611128:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3832500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b59 expref: 13 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444348.611140:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751400, rc 0) 00000100:00100000:3.0:1783444348.611192:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+12:69442:x1870073557783168:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 4804us (5063us total) trans 111669149701 rc 301/301 00000100:00100000:3.0:1783444348.611201:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1215 00000100:00100000:1.0:1783444348.616615:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444348.616694:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557783552 00000100:00100000:0.0:1783444348.616705:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557783552 00000100:00100000:0.0:1783444348.616768:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:0.0:1783444348.616780:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+12:69442:x1870073557783552:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1783444348.617135:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+13:69442:x1870073557783552:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 355us (529us total) trans 111669149702 rc 0/0 00000100:00100000:0.0:1783444348.617143:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:0.0:1783444348.628264:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444348.628401:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557783808 00000100:00100000:2.0:1783444348.628411:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557783808 00000100:00100000:2.0:1783444348.628469:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 227 00000100:00100000:2.0:1783444348.628478:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd128850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+13:69442:x1870073557783808:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1783444348.628706:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd128850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+14:69442:x1870073557783808:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 227us (452us total) trans 111669149703 rc 0/0 00000100:00100000:2.0:1783444348.628715:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 227 00010000:00010000:3.0:1783444348.893578:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783444349.527654:0:89002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149703 is committed 00010000:00010000:3.0:1783444349.527722:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.527739:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.527747:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.527754:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444349.527759:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.527768:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.527933:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9367c709ea00) 00010000:00010000:3.0:1783444349.527938:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444349.527945:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.527952:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38324eb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444349.602584:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444349.602694:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557783936 00000100:00100000:3.0:1783444349.602706:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557783936 00000100:00100000:3.0:1783444349.602785:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1216 00000100:00100000:3.0:1783444349.602823:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+9:69451:x1870073557783936:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444349.602850:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444349.602877:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b60 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.602964:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e383251c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.602978:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e383251c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.602989:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e383251c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444349.603036:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444349.603040:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444349.603061:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e383251c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.603097:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b60 expref: 11 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.603112:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e383251c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b60 expref: 10 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.603120:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c1e5b100) 00010000:00010000:3.0:1783444349.603123:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444349.603126:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1b200, rc 0) 00000100:00100000:3.0:1783444349.603206:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69451:x1870073557783936:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 386us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444349.603222:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1216 00000100:00100000:1.0:1783444349.627074:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444349.627179:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557784064 00000100:00100000:0.0:1783444349.627190:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557784064 00000100:00100000:0.0:1783444349.627257:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1217 00000100:00100000:0.0:1783444349.627268:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69451:x1870073557784064:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1783444349.627343:0:67017:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444835328 avail 1298595840 00000100:00100000:0.0:1783444349.627411:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69451:x1870073557784064:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 144us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444349.627419:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1217 00000100:00100000:3.0:1783444349.631833:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444349.631983:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557784192 00000100:00100000:1.0:1783444349.631993:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557784192 00000100:00100000:1.0:1783444349.632073:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1218 00000100:00100000:1.0:1783444349.632085:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69451:x1870073557784192:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:1.0:1783444349.632129:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444349.632194:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69451:x1870073557784192:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444349.632202:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1218 00000100:00080000:3.0:1783444349.632772:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444349.637941:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444349.638025:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557784320 00000100:00100000:1.0:1783444349.638035:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557784320 00000100:00100000:1.0:1783444349.638103:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1892 00000100:00100000:1.0:1783444349.638114:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:69451:x1870073557784320:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:1.0:1783444349.638147:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444349.638211:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:69451:x1870073557784320:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 98us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444349.638228:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1892 00000100:00080000:3.0:1783444349.641570:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444349.642222:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444349.642306:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557784448 00000100:00100000:3.0:1783444349.642326:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557784448 00000100:00100000:3.0:1783444349.642394:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1893 00000100:00100000:3.0:1783444349.642406:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:69451:x1870073557784448:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:3.0:1783444349.642438:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444349.642509:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+5:69451:x1870073557784448:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444349.642517:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1893 00000100:00080000:1.0:1783444349.642723:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444349.729996:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444349.730274:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557784704 00000100:00100000:0.0:1783444349.730284:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557784704 00000100:00100000:0.0:1783444349.730358:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1219 00000100:00100000:0.0:1783444349.730367:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69458:x1870073557784704:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00010000:0.0:1783444349.730430:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444349.730466:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b200/0x42cb6883e383251c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b60 expref: 10 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.730484:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c1e5b100) 00010000:00010000:0.0:1783444349.730498:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444349.730560:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.730573:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.730582:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.730595:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.730603:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.730631:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731283:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731293:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731300:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731306:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444349.731323:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731330:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731343:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c6b5ee00) 00010000:00010000:0.0:1783444349.731346:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444349.731349:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731356:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832523 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444349.731369:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c5cf212 reply state 00000000299baa39 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731381:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.731396:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c6b5e100) 00010000:00010000:0.0:1783444349.731398:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444349.731401:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444349.731493:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+11:69458:x1870073557784704:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 1124us (1504us total) trans 111669149704 rc 0/0 00000100:00100000:0.0:1783444349.731503:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1219 00000100:00100000:0.0:1783444349.757221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444349.757263:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557784832 00000100:00100000:0.0:1783444349.757287:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557784832 00000100:00100000:0.0:1783444349.757357:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1220 00000100:00100000:0.0:1783444349.757367:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:69461:x1870073557784832:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1783444349.757392:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444349.757419:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b67 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.757493:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3832538 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.757508:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3832538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.757519:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3832538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444349.757568:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444349.757572:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444349.757598:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3832538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.757644:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3832531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b67 expref: 13 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.757664:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3832538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b67 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.757673:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c6b5ee00) 00010000:00010000:0.0:1783444349.757676:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444349.757680:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751000, rc 0) 00000100:00100000:0.0:1783444349.757738:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+12:69461:x1870073557784832:12345-192.168.204.20@tcp:101:rm.0 Request processed in 371us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444349.757744:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1220 00000100:00100000:1.0:1783444349.769102:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444349.769175:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557784960 00000100:00100000:0.0:1783444349.769186:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557784960 00000100:00100000:0.0:1783444349.769252:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1221 00000100:00100000:0.0:1783444349.769262:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+12:69461:x1870073557784960:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1783444349.769294:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444349.769325:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383253f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b6e expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769394:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769408:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769421:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769443:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769451:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769457:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769545:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3832554 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769554:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3832554 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769561:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3832554 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444349.769604:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0xa:0x0]: returning size 0 00000004:00200000:0.0:1783444349.769608:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444349.769625:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3832554 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769637:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3832554 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769646:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769652:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769667:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769673:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769679:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444349.769683:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769690:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769703:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c6b5ee00) 00010000:00010000:0.0:1783444349.769706:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444349.769710:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769716:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3832546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769728:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769734:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769740:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769744:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444349.769754:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769776:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769813:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c6b5e100) 00010000:00010000:0.0:1783444349.769817:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444349.769820:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769826:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e383254d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769855:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383253f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b6e expref: 14 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769869:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3832554 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b6e expref: 13 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444349.769876:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9368c6b5e200) 00010000:00010000:0.0:1783444349.769878:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444349.769880:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751c00, rc 0) 00000100:00100000:0.0:1783444349.769943:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+13:69461:x1870073557784960:12345-192.168.204.20@tcp:101:rm.0 Request processed in 681us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444349.769950:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1221 00000100:00100000:0.0:1783444349.776288:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444349.776426:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557785216 00000100:00100000:3.0:1783444349.776437:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557785216 00000100:00100000:3.0:1783444349.776504:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1222 00000100:00100000:3.0:1783444349.776517:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+13:69461:x1870073557785216:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1783444349.776579:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783444349.776610:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3832554 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b6e expref: 13 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776632:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9368c6b5e200) 00010000:00010000:3.0:1783444349.776650:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3832538 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b67 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776660:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c6b5ee00) 00010000:00010000:3.0:1783444349.776666:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444349.776708:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776722:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776732:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776745:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776752:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776758:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776883:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776891:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.776899:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777098:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777106:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777114:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777127:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777134:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777140:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777157:0:80475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444349.777172:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777177:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777183:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777188:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1ac00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444349.777192:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777200:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777208:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9367c1e5b600) 00010000:00010000:3.0:1783444349.777210:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783444349.777213:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777228:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e3832569 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777243:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777249:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777254:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777259:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1ae00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444349.777262:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777352:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777363:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c1e5bd00) 00010000:00010000:3.0:1783444349.777365:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444349.777368:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777373:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e383255b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444349.777387:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033a7f0a9 reply state 00000000d9decadd transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777398:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777410:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c6b5e100) 00010000:00010000:3.0:1783444349.777413:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444349.777416:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444349.777490:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+13:69461:x1870073557785216:12345-192.168.204.20@tcp:36:rm.0 Request processed in 975us (1222us total) trans 111669149705 rc 0/0 00000100:00100000:3.0:1783444349.777498:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1222 00010000:00010000:3.0:1783444349.777529:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444349.777534:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777540:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1b600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444349.777544:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777550:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777558:0:10324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9367c1e5b600) 00010000:00010000:3.0:1783444349.777561:0:10324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783444349.777564:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777569:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832570 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444349.777582:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444349.777584:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444349.777585:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444349.920033:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444350.237044:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575293056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444350.237134:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444350.237197:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575293056 00000100:00100000:3.0:1783444350.237205:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575293056 00000100:00100000:3.0:1783444350.237283:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:3.0:1783444350.237291:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575293056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444350.237340:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444350.237386:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575293056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444350.237392:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:3.0:1783444350.237437:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575293056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444350.238202:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575293184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444350.238245:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.239342:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575293312:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.239391:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.239433:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444350.239439:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575293440:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.239467:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.239501:0:89008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575293312 00000100:00100000:1.0:1783444350.239508:0:89008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575293312 00000100:00100000:1.0:1783444350.239550:0:89008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783444350.239559:0:89008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575293312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.239606:0:89008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575293312:12345-0@lo:400:kworker.0 Request processed in 49us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.239614:0:89008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783444350.239649:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575293440 00000100:00100000:1.0:1783444350.239652:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575293440 00000100:00100000:1.0:1783444350.239689:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1783444350.239696:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575293440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.239729:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575293440:12345-0@lo:400:kworker.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.239735:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00080000:1.0:1783444350.239756:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444350.239785:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575293440:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.239830:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575293312:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.239854:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575293568:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.239880:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.239916:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575293568 00000100:00100000:1.0:1783444350.239920:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575293568 00000100:00100000:1.0:1783444350.239949:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1783444350.239956:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575293568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.239993:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575293568:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.239999:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00080000:1.0:1783444350.240016:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444350.240032:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575293568:0@lo:400:kworker.0 00000100:00100000:3.0:1783444350.240928:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575293184 00000100:00100000:3.0:1783444350.240938:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575293184 00000100:00100000:3.0:1783444350.241255:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:3.0:1783444350.241271:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575293184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444350.241432:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444350.241488:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575293184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 218us (3243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444350.241497:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:1.0:1783444350.241562:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575293696:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.241596:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.241629:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575294208:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.241651:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.241689:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575293184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444350.241709:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783444350.241715:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575294080:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.241737:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.241754:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575294592:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.241771:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.241824:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575293696 00000100:00100000:1.0:1783444350.241828:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575293696 00000100:00100000:1.0:1783444350.241872:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575294208 00000100:00100000:1.0:1783444350.241875:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575294208 00000100:00100000:1.0:1783444350.241889:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575294592 00000100:00100000:1.0:1783444350.241891:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575294592 00000100:00100000:1.0:1783444350.241908:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1783444350.241914:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575293696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.241950:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575293696:12345-0@lo:400:kworker.0 Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.241957:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1783444350.241972:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1783444350.241990:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575294208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242015:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575294208:12345-0@lo:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.242021:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1783444350.242032:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1783444350.242038:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575294592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242063:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575294592:12345-0@lo:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.242069:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1783444350.242087:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575294080 00000100:00100000:1.0:1783444350.242089:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575294080 00000100:00100000:1.0:1783444350.242115:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:1.0:1783444350.242120:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575294080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242151:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575294080:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.242157:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00080000:1.0:1783444350.242180:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444350.242191:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444350.242210:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575293824:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242240:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.242258:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575294336:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242542:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.242564:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783444350.242570:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575293952:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242592:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.242607:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575294464:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242626:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444350.242653:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575294336 00000100:00100000:1.0:1783444350.242656:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575294336 00000100:00100000:1.0:1783444350.242688:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575293952 00000100:00100000:1.0:1783444350.242691:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575293952 00000100:00100000:1.0:1783444350.242712:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575294464 00000100:00100000:1.0:1783444350.242715:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575294464 00000100:00100000:1.0:1783444350.242736:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:1.0:1783444350.242742:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575294336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242780:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575294336:12345-0@lo:400:kworker.0 Request processed in 38us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.242786:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:1.0:1783444350.242840:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:1.0:1783444350.242847:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575293952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242875:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575293952:12345-0@lo:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.242881:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00100000:1.0:1783444350.242893:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:1.0:1783444350.242906:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575294464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.242936:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575294464:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.242942:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00080000:1.0:1783444350.243039:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444350.243043:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444350.243053:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575293824 00000100:00100000:1.0:1783444350.243057:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575293824 00000100:00100000:1.0:1783444350.243086:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1783444350.243092:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575293824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.243123:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575293824:12345-0@lo:400:kworker.0 Request processed in 31us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444350.243129:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00080000:1.0:1783444350.243145:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444350.243172:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575294080:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.243184:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575294592:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.243195:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575293696:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.243205:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4b2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575294208:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.243238:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575293952:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.243248:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575294464:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.243257:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575293824:0@lo:400:kworker.0 00000100:00100000:1.0:1783444350.243450:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575294336:0@lo:400:kworker.0 00000100:00100000:0.0:1783444350.748931:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444350.748954:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575294720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444350.749032:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444350.749078:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575294720 00000100:00100000:0.0:1783444350.749085:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575294720 00000100:00100000:0.0:1783444350.749133:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:0.0:1783444350.749143:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575294720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444350.749166:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444350.749212:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575294720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444350.749218:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:3.0:1783444350.749442:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444350.749452:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575294848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444350.749484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444350.749511:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575294848 00000100:00100000:3.0:1783444350.749515:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575294848 00000100:00100000:3.0:1783444350.749539:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:3.0:1783444350.749551:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575294848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444350.749563:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444350.749597:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575294848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444350.749602:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:3.0:1783444350.749634:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575294848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444350.749725:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575294720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783444350.941175:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444351.968955:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444352.077259:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444352.077325:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444352.077355:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444352.077398:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557785856 00000100:00100000:3.0:1783444352.077411:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557785856 00000100:00100000:3.0:1783444352.077492:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2389 00000100:00100000:3.0:1783444352.077504:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557785856:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444352.077607:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2401:x1870073557785856:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444352.077616:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2389 00000100:00100000:1.0:1783444352.077999:0:89006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557785344 00000100:00100000:1.0:1783444352.078021:0:89006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557785344 00000100:00100000:1.0:1783444352.078064:0:89006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1783444352.078071:0:89006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2401:x1870073557785344:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444352.078112:0:89006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2401:x1870073557785344:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444352.078119:0:89006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1783444352.078159:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557785600 00000100:00100000:1.0:1783444352.078163:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557785600 00000100:00100000:1.0:1783444352.078199:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 966 00000100:00100000:1.0:1783444352.078205:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557785600:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444352.078237:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557785600:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444352.078243:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 966 00000100:00080000:1.0:1783444352.078260:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444352.078277:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444352.081228:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444352.081291:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444352.081328:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557785728 00000100:00100000:1.0:1783444352.081340:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557785728 00000100:00100000:1.0:1783444352.081412:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2390 00000100:00100000:1.0:1783444352.081424:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557785728:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444352.081513:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2402:x1870073557785728:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444352.081522:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2390 00000100:00080000:1.0:1783444352.081547:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444352.081603:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557785472 00000100:00100000:3.0:1783444352.081608:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557785472 00000100:00100000:3.0:1783444352.081660:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 967 00000100:00100000:3.0:1783444352.081668:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2402:x1870073557785472:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000080:3.0:1783444352.081764:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9369005b2d80 x1870073557785472/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:728/0 lens 224/224 e 0 to 0 dl 1783444363 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444352.081818:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2402:x1870073557785472:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 151us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444352.081838:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 967 00000100:00080000:1.0:1783444352.084184:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444352.802031:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575294976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444352.802132:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444352.802213:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575294976 00000100:00100000:1.0:1783444352.802224:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575294976 00000100:00100000:1.0:1783444352.802308:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:1.0:1783444352.802320:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575294976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444352.802367:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444352.802429:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575294976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444352.802437:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00080000:1.0:1783444352.802465:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444352.802764:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575294976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444352.804065:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575295104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444352.804127:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444352.804392:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575295104 00000100:00100000:2.0:1783444352.804400:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575295104 00000100:00100000:2.0:1783444352.804471:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:2.0:1783444352.804481:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575295104:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783444352.804582:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783444352.804639:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444352.804832:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575295104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444352.805041:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575295104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 561us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444352.805050:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00010000:00010000:3.0:1783444352.990063:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444354.013327:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444355.038335:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444355.357502:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444355.357535:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575295232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444355.357614:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.357671:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575295232 00000100:00100000:3.0:1783444355.357679:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575295232 00000100:00100000:3.0:1783444355.357726:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1783444355.357735:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575295232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444355.357770:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444835328 avail 1298595840 00010000:00000080:3.0:1783444355.357818:0:23687:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7ac000 x1870073575295232/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:731/0 lens 224/368 e 0 to 0 dl 1783444366 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444355.357872:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575295232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444355.357879:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1783444355.357932:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575295360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444355.357957:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.357991:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575295360 00000100:00100000:3.0:1783444355.357994:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575295360 00000100:00100000:3.0:1783444355.358019:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:3.0:1783444355.358025:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575295360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444355.358042:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444355.358074:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575295360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444355.358079:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:3.0:1783444355.358135:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575295360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444355.358164:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575295232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444355.363325:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575295872:0@lo:400:kworker.0 00000100:00100000:2.0:1783444355.363401:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.363999:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575295488:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.364040:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.364076:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575296000:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.364101:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.364119:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575296512:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.364140:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.364195:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575296512 00000100:00100000:3.0:1783444355.364213:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575296512 00000100:00100000:3.0:1783444355.364277:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:3.0:1783444355.364286:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575296512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.365954:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575296512:12345-0@lo:400:kworker.0 Request processed in 1661us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444355.365968:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:3.0:1783444355.366033:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575296512:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.368279:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575295744:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.368616:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444355.370814:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575296384:0@lo:400:kworker.0 00000100:00080000:0.0:1783444355.370891:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444355.378266:0:89014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575295488 00000100:00100000:1.0:1783444355.378283:0:89014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575295488 00000100:00100000:1.0:1783444355.378379:0:89014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783444355.378390:0:89014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575295488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444355.378499:0:89014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575295488:12345-0@lo:400:kworker.0 Request processed in 111us (14456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444355.378506:0:89014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783444355.378604:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575295488:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.381815:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575296256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.381890:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.381914:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575296768:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.381939:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.381967:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783444355.381974:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575295616:0@lo:400:kworker.0 00000100:00100000:2.0:1783444355.381975:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575295872 00000100:00100000:2.0:1783444355.381982:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575295872 00000100:00100000:3.0:1783444355.382018:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.382038:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575296128:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.382059:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.382077:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575296640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.382098:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444355.382130:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575296256 00000100:00100000:3.0:1783444355.382134:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575296256 00000100:00100000:3.0:1783444355.382170:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575296128 00000100:00100000:3.0:1783444355.382173:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575296128 00000100:00100000:3.0:1783444355.382193:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575296640 00000100:00100000:3.0:1783444355.382195:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575296640 00000100:00100000:3.0:1783444355.382232:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1783444355.382240:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575296256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.382291:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575296256:12345-0@lo:400:kworker.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444355.382311:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:2.0:1783444355.382665:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575296000 00000100:00100000:2.0:1783444355.382670:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575296000 00000100:00100000:2.0:1783444355.382686:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575295744 00000100:00100000:2.0:1783444355.382688:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575295744 00000100:00100000:2.0:1783444355.382699:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575296768 00000100:00100000:2.0:1783444355.382702:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575296768 00000100:00100000:2.0:1783444355.382710:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575295616 00000100:00100000:2.0:1783444355.382713:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575295616 00000100:00100000:2.0:1783444355.382727:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1783444355.382734:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575295872:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444355.382748:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9369018a9c00 x1870073575295872/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1783444366 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444355.382783:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575295872:12345-0@lo:400:kworker.0 Request processed in 49us (19383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444355.382807:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1783444355.382821:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1783444355.382827:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575296000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444355.382863:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575296000:12345-0@lo:400:kworker.0 Request processed in 36us (18761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444355.382881:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1783444355.382894:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1783444355.382900:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575295744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444355.382928:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575295744:12345-0@lo:400:kworker.0 Request processed in 29us (14314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444355.382933:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1783444355.382943:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1783444355.382947:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575296768:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444355.382957:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7af800 x1870073575296768/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1783444366 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444355.382980:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575296768:12345-0@lo:400:kworker.0 Request processed in 32us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444355.382986:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1783444355.382994:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1783444355.382999:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575295616:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444355.383500:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7af100 x1870073575295616/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1783444366 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444355.383532:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575295616:12345-0@lo:400:kworker.0 Request processed in 532us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444355.383539:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1783444355.383565:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444355.383674:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575295872:0@lo:400:kworker.0 00000100:00080000:2.0:1783444355.383702:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444355.383707:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444355.383717:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444355.383719:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444355.383730:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575296384 00000100:00100000:2.0:1783444355.383734:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575296384 00000100:00100000:2.0:1783444355.383756:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1783444355.383762:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575296384:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444355.383775:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9369018a9f80 x1870073575296384/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:731/0 lens 224/224 e 0 to 0 dl 1783444366 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444355.383827:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575296384:12345-0@lo:400:kworker.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444355.383833:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1783444355.383859:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575296384:0@lo:400:kworker.0 00000100:00100000:2.0:1783444355.383886:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575296000:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.384195:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:3.0:1783444355.384219:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575296128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.384254:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575296128:12345-0@lo:400:kworker.0 Request processed in 41us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444355.384260:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:3.0:1783444355.384274:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:3.0:1783444355.384280:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575296640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.384417:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575296640:12345-0@lo:400:kworker.0 Request processed in 136us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444355.384424:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00100000:3.0:1783444355.384617:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575295616:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.384631:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575296128:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.384642:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575296640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.384652:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575295744:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.384662:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575296256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444355.384672:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575296768:0@lo:400:kworker.0 00000001:00080000:0.0:1783444355.873278:0:89002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149705 is committed 00010000:00010000:0.0:1783444355.873323:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.873335:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.873343:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.873349:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444355.873353:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.873370:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.873388:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c6b5e100) 00010000:00010000:0.0:1783444355.873391:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444355.873396:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.873403:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e383252a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.873421:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444355.875247:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575296896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444355.875321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444355.875371:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444355.875380:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575297024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444355.875406:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444355.875448:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575296896 00000100:00100000:2.0:1783444355.875456:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575296896 00000100:00100000:2.0:1783444355.875497:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575297024 00000100:00100000:2.0:1783444355.875499:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575297024 00000100:00100000:2.0:1783444355.875513:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:2.0:1783444355.875520:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575296896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444355.875552:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444355.875592:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575296896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444355.875606:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:2.0:1783444355.875621:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1783444355.875626:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575297024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444355.875640:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444355.875664:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575297024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444355.875669:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1783444355.875709:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575297024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444355.875721:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575296896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783444355.875983:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.875991:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.875997:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1a800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444355.876003:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.876011:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.876027:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c6b5e100) 00010000:00010000:0.0:1783444355.876030:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444355.876035:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444355.876049:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1a800/0x42cb6883e3832562 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.062807:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783444356.567149:0:90273:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1783444356.640090:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444356.640151:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557785984 00000100:00100000:3.0:1783444356.640162:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557785984 00000100:00100000:3.0:1783444356.640236:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1223 00000100:00100000:3.0:1783444356.640245:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:69528:x1870073557785984:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444356.640264:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444356.640285:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b75 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.640348:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b800/0x42cb6883e383257e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.640362:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b800/0x42cb6883e383257e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.640373:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b800/0x42cb6883e383257e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444356.640414:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444356.640418:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444356.640434:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b800/0x42cb6883e383257e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.640478:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b600/0x42cb6883e3832577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b75 expref: 11 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.640495:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b800/0x42cb6883e383257e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b75 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.640504:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c1e5b600) 00010000:00010000:3.0:1783444356.640507:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444356.640510:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1b800, rc 0) 00010000:00000080:3.0:1783444356.640517:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9369005b3480 x1870073557785984/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 576/688 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444356.640572:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69528:x1870073557785984:12345-192.168.204.20@tcp:101:dd.0 Request processed in 329us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444356.640580:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1223 00000100:00080000:0.0:1783444356.640738:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444356.651760:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444356.651886:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557786240 00000100:00100000:3.0:1783444356.651896:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557786240 00000100:00100000:3.0:1783444356.652228:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1224 00000100:00100000:3.0:1783444356.652238:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:69528:x1870073557786240:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444356.652260:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444356.652263:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783444356.652287:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1b800/0x42cb6883e383257e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b75 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652302:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c1e5b600) 00010000:00010000:3.0:1783444356.652313:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444356.652327:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832585 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b7c expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652446:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652459:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652469:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652479:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652486:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652493:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652544:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383259a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652551:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383259a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652557:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383259a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444356.652566:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:3.0:1783444356.652649:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652657:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652669:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652676:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652682:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1ac00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444356.652686:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652694:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652703:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367c1e5b400) 00010000:00010000:3.0:1783444356.652706:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444356.652709:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652716:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ac00/0x42cb6883e383258c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652725:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652731:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652737:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652742:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1ba00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444356.652748:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652755:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652761:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9367c1e5bb00) 00010000:00010000:3.0:1783444356.652764:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444356.652767:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652772:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ba00/0x42cb6883e3832593 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652826:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e3832585 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b7c expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652840:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383259a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b7c expref: 11 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.652847:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:3.0:1783444356.652849:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444356.652851:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1aa00, rc 0) 00010000:00000080:3.0:1783444356.652858:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9369005b1180 x1870073557786240/t111669149706(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 776/848 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444356.652920:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:69528:x1870073557786240:12345-192.168.204.20@tcp:101:dd.0 Request processed in 683us (1179us total) trans 111669149706 rc 0/0 00000100:00100000:3.0:1783444356.652927:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1224 00000100:00100000:1.0:1783444356.671861:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444356.671980:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557786368 00000100:00100000:2.0:1783444356.671990:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557786368 00000100:00100000:2.0:1783444356.672046:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1225 00000100:00100000:2.0:1783444356.672056:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+11:69528:x1870073557786368:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444356.672082:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444356.672104:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38325a8 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b83 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.672138:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e38325af lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.672152:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e38325af lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.672165:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e38325af lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.672290:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38325a8 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b83 expref: 13 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.672307:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e38325af lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b83 expref: 12 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.672316:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:2.0:1783444356.672319:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783444356.672323:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11000, rc 0) 00010000:00000080:2.0:1783444356.672330:0:71469:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c4b2b480 x1870073557786368/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 568/1344 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444356.672458:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+12:69528:x1870073557786368:12345-192.168.204.20@tcp:101:dd.0 Request processed in 401us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444356.672466:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1225 00000100:00100000:2.0:1783444356.677136:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444356.677218:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557786624 00000100:00100000:0.0:1783444356.677227:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557786624 00000100:00100000:0.0:1783444356.677283:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1226 00000100:00100000:0.0:1783444356.677293:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+12:69528:x1870073557786624:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1783444356.677352:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444356.677379:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1aa00/0x42cb6883e383259a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b7c expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.677398:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:0.0:1783444356.677403:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444356.677580:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.677594:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.677605:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444356.677641:0:66226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149707 00000004:00010000:0.0:1783444356.677661:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e229d92 reply state 00000000cc0f8173 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.677672:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.677688:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:0.0:1783444356.677691:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444356.677694:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1783444356.677730:0:66226:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9369018aa300 x1870073557786624/t111669149708(0) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 488/456 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444356.677822:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+14:69528:x1870073557786624:12345-192.168.204.20@tcp:36:dd.0 Request processed in 529us (695us total) trans 111669149708 rc 0/0 00000100:00100000:0.0:1783444356.677830:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1226 00000020:00080000:0.0:1783444356.677836:0:66226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783444356.687455:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444356.687501:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557786752 00000100:00100000:3.0:1783444356.687511:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557786752 00000100:00100000:3.0:1783444356.687571:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1227 00000100:00100000:3.0:1783444356.687581:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+14:69528:x1870073557786752:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444356.687607:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444356.687630:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e38325bd lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b8a expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.687687:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e38325bd lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b8a expref: 15 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.687701:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e38325bd lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b8a expref: 15 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.687720:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:3.0:1783444356.687723:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444356.687727:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1ae00, rc 0) 00010000:00000080:3.0:1783444356.687735:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7ad500 x1870073557786752/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 376/584 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444356.688224:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+15:69528:x1870073557786752:12345-192.168.204.20@tcp:101:dd.0 Request processed in 234us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444356.688233:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1227 00000100:00100000:1.0:1783444356.696873:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444356.697079:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557787008 00000100:00100000:2.0:1783444356.697089:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557787008 00000100:00100000:2.0:1783444356.697150:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1228 00000100:00100000:2.0:1783444356.697160:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+15:69528:x1870073557787008:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444356.697196:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444356.697199:0:66225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783444356.697232:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6b1ae00/0x42cb6883e38325bd lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b8a expref: 15 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.697250:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:2.0:1783444356.697261:0:66225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444356.697275:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38325c4 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b91 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.697329:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38325cb lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.697344:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38325cb lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.697354:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38325cb lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783444356.697466:0:66225:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xb1:0x0], count =625 00000004:00080000:2.0:1783444356.697486:0:66225:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xb1:0x0]+625 in llog 00000004:00080000:2.0:1783444356.697514:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x322:0x0], index 0: 0 00000004:00080000:2.0:1783444356.697521:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x323:0x0], index 1: 0 00010000:00010000:2.0:1783444356.697614:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38325cb lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b91 expref: 17 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.697622:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:2.0:1783444356.697625:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1783444356.697635:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e38325c4 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b91 expref: 17 pid: 66225 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.697647:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38325cb lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b91 expref: 16 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.697676:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:2.0:1783444356.697679:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1783444356.697686:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10200, rc 0) 00010000:00000080:2.0:1783444356.697695:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f973ca80 x1870073557787008/t111669149709(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 376/608 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444356.697756:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+16:69528:x1870073557787008:12345-192.168.204.20@tcp:101:dd.0 Request processed in 597us (893us total) trans 111669149709 rc 0/0 00000100:00100000:2.0:1783444356.697763:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1228 00000100:00100000:0.0:1783444356.711868:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444356.712134:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557787136 00000100:00100000:3.0:1783444356.712153:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557787136 00000100:00080000:0.0:1783444356.712211:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444356.712233:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5878 00000100:00100000:3.0:1783444356.712247:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:778015c5-4969-44f5-82a5-0f6eadd152d5+5:69528:x1870073557787136:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444356.712265:0:26208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444356.712298:0:26208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3397423/0x42cb6883e38325d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b98 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444356.712324:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444356.712346:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x322:0x0].0x0 since=3347s v=(0 0) 00010000:00010000:3.0:1783444356.712351:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444356.712362:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3397423/0x42cb6883e38325d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b98 expref: 6 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.712381:0:26208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b3397423/0x42cb6883e38325d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b98 expref: 6 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.712394:0:26208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1ba00, rc 0) 00000100:00100000:3.0:1783444356.712458:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69528:x1870073557787136:12345-192.168.204.20@tcp:101:dd.0 Request processed in 214us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444356.712467:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5878 00000100:00100000:3.0:1783444356.718733:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444356.718768:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557787264 00000100:00100000:3.0:1783444356.718777:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557787264 00000100:00100000:3.0:1783444356.719206:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5879 00000100:00100000:3.0:1783444356.719216:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+5:69528:x1870073557787264:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444356.719234:0:26206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444356.719255:0:26206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071722605/0x42cb6883e38325d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b9f expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444356.719283:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444356.719308:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x322:0x0].0x0 since=3347s v=(0 0) 00010000:00010000:3.0:1783444356.719324:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444356.719334:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071722605/0x42cb6883e38325d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b9f expref: 6 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.719353:0:26206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000071722605/0x42cb6883e38325d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b9f expref: 6 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.719368:0:26206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1ac00, rc 0) 00000100:00100000:3.0:1783444356.719422:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69528:x1870073557787264:12345-192.168.204.20@tcp:101:dd.0 Request processed in 208us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444356.719429:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5879 00000100:00080000:1.0:1783444356.719497:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444356.723338:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444356.723421:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557787392 00000100:00100000:1.0:1783444356.723430:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557787392 00000100:00100000:1.0:1783444356.723505:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5880 00000100:00100000:1.0:1783444356.723515:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69528:x1870073557787392:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444356.723542:0:17653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444356.723562:0:17653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38325e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ba6 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444356.723587:0:17653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444356.723606:0:17653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x323:0x0].0x0 since=3347s v=(0 0) 00010000:00010000:1.0:1783444356.723611:0:17653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x323:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444356.723619:0:17653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38325e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ba6 expref: 7 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.723634:0:17653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38325e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ba6 expref: 7 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.723647:0:17653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756800, rc 0) 00000100:00100000:1.0:1783444356.723701:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:69528:x1870073557787392:12345-192.168.204.20@tcp:101:dd.0 Request processed in 187us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444356.723708:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5880 00000100:00100000:0.0:1783444356.732079:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444356.732142:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557787520 00000100:00100000:2.0:1783444356.732152:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557787520 00002000:00010000:2.0:1783444356.732199:0:8427:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/802 (1048576->18446744073709551615) 00002000:00100000:2.0:1783444356.732204:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5099880 with x1870073557787520 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1783444356.732224:0:8427:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c5099880. 00000100:00100000:2.0:1783444356.732254:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1000 00000100:00100000:2.0:1783444356.732263:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557787520:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:2.0:1783444356.732475:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1783444356.732479:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb mtime from disk: 0 -> 1783444357 00002000:00010000:2.0:1783444356.732482:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783444356.732484:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb ctime from disk: 0 -> 1783444357 00002000:00010000:2.0:1783444356.732486:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783444356.732544:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557787520:12345-192.168.204.20@tcp:10:dd.0 Request processed in 281us (474us total) trans 4294969450 rc 0/0 00000100:00100000:2.0:1783444356.732552:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1000 00002000:00010000:2.0:1783444356.732556:0:8427:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/802 (1048576->18446744073709551615) 00002000:00100000:2.0:1783444356.732559:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5099880 with x1870073557787520 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1783444356.732563:0:8427:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c5099880. 00000100:00100000:3.0:1783444356.733279:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444356.733364:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557787648 00000100:00100000:1.0:1783444356.733369:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557787648 00002000:00010000:1.0:1783444356.733391:0:25160:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/803 (0->18446744073709551615) 00002000:00100000:1.0:1783444356.733395:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff7aea00 with x1870073557787648 ext(0->18446744073709551615) 00002000:00010000:1.0:1783444356.733402:0:25160:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9368ff7aea00. 00000100:00100000:1.0:1783444356.733465:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1001 00000100:00100000:1.0:1783444356.733473:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557787648:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:1.0:1783444356.733595:0:25160:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783444356.733598:0:25160:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb mtime from disk: 0 -> 1783444357 00002000:00010000:1.0:1783444356.733600:0:25160:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783444356.733603:0:25160:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb ctime from disk: 0 -> 1783444357 00002000:00010000:1.0:1783444356.733605:0:25160:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783444356.733645:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2404:x1870073557787648:12345-192.168.204.20@tcp:10:dd.0 Request processed in 173us (368us total) trans 4294969454 rc 0/0 00000100:00100000:1.0:1783444356.733651:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1001 00002000:00010000:1.0:1783444356.733654:0:25160:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/803 (0->18446744073709551615) 00002000:00100000:1.0:1783444356.733657:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff7aea00 with x1870073557787648 ext(0->18446744073709551615) 00002000:00010000:1.0:1783444356.733661:0:25160:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9368ff7aea00. 00000100:00100000:0.0:1783444356.786481:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444356.786578:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557787904 00000100:00100000:2.0:1783444356.786588:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557787904 00000100:00100000:2.0:1783444356.786656:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:2.0:1783444356.786666:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+16:69528:x1870073557787904:12345-192.168.204.20@tcp:35:dd.0 00010000:00000080:2.0:1783444356.786926:0:66228:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd159180 x1870073557787904/t111669149710(0) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 392/456 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444356.786990:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+17:69528:x1870073557787904:12345-192.168.204.20@tcp:35:dd.0 Request processed in 326us (519us total) trans 111669149710 rc 0/0 00000100:00100000:2.0:1783444356.786998:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:0.0:1783444356.816523:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444356.816637:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557788032 00000100:00100000:1.0:1783444356.816647:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557788032 00000100:00100000:1.0:1783444356.816703:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1229 00000100:00100000:1.0:1783444356.816713:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+17:69529:x1870073557788032:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444356.816736:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444356.816770:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38325e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bad expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.816862:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e38325ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.816876:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e38325ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.816888:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e38325ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444356.816957:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783444356.816961:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444356.816979:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e38325ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.817003:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38325e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bad expref: 19 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.817020:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e38325ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bad expref: 18 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.817029:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3d5b800) 00010000:00010000:1.0:1783444356.817032:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444356.817035:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757e00, rc 0) 00010000:00000080:1.0:1783444356.817043:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd159f80 x1870073557788032/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 576/688 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444356.817119:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+18:69529:x1870073557788032:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 407us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444356.817126:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1229 00000100:00100000:3.0:1783444356.825182:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444356.825372:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557788288 00000100:00100000:0.0:1783444356.825382:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557788288 00000100:00100000:0.0:1783444356.825449:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1230 00000100:00100000:0.0:1783444356.825459:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+18:69529:x1870073557788288:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444356.825479:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444356.825499:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e38325f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bb4 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825569:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825582:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825606:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825621:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825628:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825635:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825715:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825722:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825728:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825736:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825742:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444356.825747:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825754:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825766:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3d5b800) 00010000:00010000:0.0:1783444356.825774:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444356.825779:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.825785:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38325fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.826341:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.826347:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.826353:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.826359:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444356.826362:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.826368:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.826377:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9368c6b5e100) 00010000:00010000:0.0:1783444356.826380:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444356.826383:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.826389:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e3832603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.827085:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e38325f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bb4 expref: 19 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.827110:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3d5b800) 00010000:00010000:0.0:1783444356.827112:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783444356.827117:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e38325f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bb4 expref: 19 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444356.827127:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751e00, rc 0) 00010000:00000080:0.0:1783444356.827147:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7adf80 x1870073557788288/t0(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 800/608 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444356.827228:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+18:69529:x1870073557788288:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1769us (2065us total) trans 0 rc 301/301 00000100:00100000:0.0:1783444356.827237:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1230 00000100:00100000:2.0:1783444356.833274:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444356.833365:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557788416 00000100:00100000:1.0:1783444356.833374:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557788416 00000100:00100000:1.0:1783444356.833439:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1231 00000100:00100000:1.0:1783444356.833449:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+18:69529:x1870073557788416:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:1.0:1783444356.833518:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833534:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833559:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833575:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833582:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833588:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833662:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833670:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833677:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444356.833716:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:1.0:1783444356.833720:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444356.833731:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833744:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833751:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833767:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833774:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833780:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444356.833785:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833955:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833969:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3d5b800) 00010000:00010000:1.0:1783444356.833972:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444356.833976:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833983:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e383260a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.833998:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834004:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834009:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834014:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444356.834023:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834029:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834038:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9368c3d5b300) 00010000:00010000:1.0:1783444356.834040:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444356.834043:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834048:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e3832611 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834061:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834067:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834073:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834078:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444356.834081:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834086:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834092:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:1.0:1783444356.834094:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444356.834101:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444356.834106:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832618 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1783444356.834126:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9369018aad80 x1870073557788416/t0(0) o34->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 472/728 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444356.834203:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+18:69529:x1870073557788416:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 755us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444356.834211:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1231 00000100:00100000:1.0:1783444356.866248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444356.866344:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557788672 00000100:00100000:2.0:1783444356.866354:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557788672 00000100:00100000:2.0:1783444356.866420:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1232 00000100:00100000:2.0:1783444356.866430:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+18:69531:x1870073557788672:12345-192.168.204.20@tcp:101:md5sum.0 00010000:00010000:2.0:1783444356.866450:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444356.866470:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e383261f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bbb expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866540:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866554:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866565:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866578:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866586:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866606:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866731:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e3832634 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866741:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e3832634 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444356.866748:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e3832634 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444356.866757:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00010000:00010000:3.0:1783444356.867366:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867376:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867383:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867390:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867406:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444356.867411:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867419:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867440:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3d5b800) 00010000:00010000:3.0:1783444356.867443:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444356.867447:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867453:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867467:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867474:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867480:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867485:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444356.867488:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867493:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867499:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9367c709e400) 00010000:00010000:3.0:1783444356.867501:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444356.867504:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867509:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383262d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867575:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e383261f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bbb expref: 21 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867588:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e3832634 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bbb expref: 20 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444356.867595:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:3.0:1783444356.867597:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444356.867600:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10400, rc 0) 00010000:00000080:3.0:1783444356.867608:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f973c380 x1870073557788672/t111669149711(0) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 800/872 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444356.867675:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+20:69531:x1870073557788672:12345-192.168.204.20@tcp:101:md5sum.0 Request processed in 1247us (1438us total) trans 111669149711 rc 0/0 00000100:00100000:3.0:1783444356.867683:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1232 00000100:00100000:0.0:1783444356.890919:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444356.891020:0:25162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557788800 00000100:00100000:1.0:1783444356.891030:0:25162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557788800 00002000:00100000:1.0:1783444356.891084:0:25162:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff9368dd15bb80 x1870073557788800/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 488/0 e 0 to 0 dl 1783444367 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444356.891095:0:25162:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd15bb80 with x1870073557788800 ext(0->32767) 00002000:00010000:1.0:1783444356.891101:0:25162:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9368dd15bb80 00000100:00100000:1.0:1783444356.891138:0:25162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1002 00000100:00100000:1.0:1783444356.891148:0:25162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2402:x1870073557788800:12345-192.168.204.20@tcp:3:md5sum.0 00000100:00100000:1.0:1783444356.894262:0:25162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2402:x1870073557788800:12345-192.168.204.20@tcp:3:md5sum.0 Request processed in 3106us (3344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444356.894279:0:25162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1002 00002000:00100000:1.0:1783444356.894290:0:25162:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff9368dd15bb80 x1870073557788800/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 488/440 e 0 to 0 dl 1783444367 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444356.894301:0:25162:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd15bb80 with x1870073557788800 ext(0->32767) 00002000:00010000:1.0:1783444356.894319:0:25162:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9368dd15bb80 00000100:00100000:0.0:1783444356.907713:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444356.911118:0:25148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557788928 00000100:00100000:3.0:1783444356.911134:0:25148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557788928 00002000:00100000:3.0:1783444356.911199:0:25148:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff9368dd15b800 x1870073557788928/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 488/0 e 0 to 0 dl 1783444367 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444356.911211:0:25148:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd15b800 with x1870073557788928 ext(32768->1048575) 00002000:00010000:3.0:1783444356.911216:0:25148:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9368dd15b800 00000100:00100000:3.0:1783444356.911255:0:25148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1003 00000100:00100000:3.0:1783444356.911264:0:25148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2404:x1870073557788928:12345-192.168.204.20@tcp:3:md5sum.0 00000100:00100000:3.0:1783444356.916758:0:25148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2404:x1870073557788928:12345-192.168.204.20@tcp:3:md5sum.0 Request processed in 5483us (9045us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444356.916785:0:25148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1003 00002000:00100000:3.0:1783444356.916833:0:25148:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff9368dd15b800 x1870073557788928/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 488/440 e 0 to 0 dl 1783444367 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444356.916845:0:25148:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd15b800 with x1870073557788928 ext(32768->1048575) 00002000:00010000:3.0:1783444356.916851:0:25148:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9368dd15b800 00000100:00100000:2.0:1783444356.950440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444356.958538:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557789184 00000100:00100000:3.0:1783444356.958554:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557789184 00000100:00100000:3.0:1783444356.958709:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 229 00000100:00100000:3.0:1783444356.958733:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+20:69531:x1870073557789184:12345-192.168.204.20@tcp:35:md5sum.0 00010000:00000080:3.0:1783444356.959014:0:76566:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9369018aaa00 x1870073557789184/t111669149712(0) o35->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:732/0 lens 392/456 e 0 to 0 dl 1783444367 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444356.959097:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+21:69531:x1870073557789184:12345-192.168.204.20@tcp:35:md5sum.0 Request processed in 367us (8669us total) trans 111669149712 rc 0/0 00000100:00100000:3.0:1783444356.959105:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 229 00000100:00100000:0.0:1783444357.012492:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444357.013640:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557789312 00000100:00100000:3.0:1783444357.013653:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557789312 00000100:00100000:2.0:1783444357.014709:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1233 00000100:00100000:2.0:1783444357.014818:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+21:69533:x1870073557789312:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1783444357.014899:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.014917:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.014929:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.014944:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.014951:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.014974:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015050:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015058:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015065:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444357.015103:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:2.0:1783444357.015106:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444357.015118:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015295:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015305:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015311:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015317:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444357.015321:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015328:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015346:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3d5b800) 00010000:00010000:2.0:1783444357.015490:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444357.015496:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015503:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3832642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015519:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015524:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015529:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015534:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444357.015537:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015542:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015549:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9367c709e100) 00010000:00010000:2.0:1783444357.015551:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444357.015554:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015560:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3832649 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015586:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015592:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015597:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015602:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444357.015604:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015609:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015616:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:2.0:1783444357.015618:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444357.015620:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444357.015698:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3832650 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1783444357.015786:0:80475:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd15aa00 x1870073557789312/t0(0) o34->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:733/0 lens 472/728 e 0 to 0 dl 1783444368 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444357.015965:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+21:69533:x1870073557789312:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1174us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444357.015973:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1233 00010000:00010000:3.0:1783444357.085629:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444357.196433:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444357.196483:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444357.196537:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557789568 00000100:00100000:0.0:1783444357.196547:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557789568 00000100:00100000:0.0:1783444357.196607:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 974 00000100:00100000:0.0:1783444357.196617:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557789568:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444357.196690:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557789568:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444357.196699:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 974 00000100:00080000:0.0:1783444357.196722:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444357.196963:0:89009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557789440 00000100:00100000:2.0:1783444357.196974:0:89009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557789440 00000100:00100000:2.0:1783444357.197016:0:89009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:2.0:1783444357.197023:0:89009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2401:x1870073557789440:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444357.197061:0:89009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2401:x1870073557789440:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444357.197068:0:89009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:1.0:1783444357.917029:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444357.917053:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575297152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444357.917120:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444357.917322:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575297152 00000100:00100000:2.0:1783444357.917330:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575297152 00000100:00100000:2.0:1783444357.917389:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1783444357.917400:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575297152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444357.917429:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444357.917476:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575297152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444357.917484:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1783444357.917530:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575297152:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783444357.918830:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444357.921020:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444357.921040:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575297280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444357.921098:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444357.921140:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575297280 00000100:00100000:3.0:1783444357.921163:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575297280 00000100:00100000:3.0:1783444357.921212:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1783444357.921221:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575297280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444357.921248:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444357.921302:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575297280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444357.921309:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00080000:3.0:1783444357.921328:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444357.921360:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575297280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783444358.115372:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444359.149865:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783444359.157940:0:90371:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783444359.157994:0:90371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444359.158010:0:90371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444359.158018:0:90371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444359.158026:0:90371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444359.158046:0:90371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783444359.158051:0:90371:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783444359.158078:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444359.158082:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783444359.158088:0:90371:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783444359.158128:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783444359.158442:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444359.158450:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.158458:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444359.158462:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.158472:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444359.158479:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444359.158500:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783444359.158502:0:6493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783444359.158505:0:6493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783444359.158544:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.158552:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444359.158583:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.158590:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f04a00/0x42cb6883e3832164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383216b expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.158602:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444359.158604:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444359.158605:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444359.158692:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444359.158712:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575297536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444359.158776:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444359.158997:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575297408:0@lo:39:umount.0 00000100:00100000:1.0:1783444359.159032:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444359.159118:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575297408 00000100:00100000:3.0:1783444359.159125:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575297408 00000100:00100000:3.0:1783444359.159187:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1783444359.159197:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575297408:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783444359.159222:0:66223:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832283 00000100:00080000:3.0:1783444359.159238:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9369006a1800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1783444359.159273:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f973ce00 x1870073575297408/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:735/0 lens 224/224 e 0 to 0 dl 1783444370 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444359.159315:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3632:x1870073575297408:12345-0@lo:39:umount.0 Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444359.159322:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000020:00000080:3.0:1783444359.159331:0:66223:0:(genops.c:906:class_export_put()) final put ffff9368f8ca4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783444359.159366:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783444359.159405:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9369006a1800 for lustre-MDT0000 00010000:00010000:1.0:1783444359.159536:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783444359.159562:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783444359.159578:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575297408:0@lo:39:umount.0 00000100:00080000:0.0:1783444359.159631:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444359.159634:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783444359.159638:0:90371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1783444359.160984:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575297536 00000100:00100000:2.0:1783444359.160993:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575297536 00000100:00100000:2.0:1783444359.161196:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1783444359.161205:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575297536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444359.161218:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444359.161235:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262000/0x42cb6883e383216b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832164 expref: 24 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.161249:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444359.161304:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3636:x1870073575297536:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444359.161312:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1783444359.161747:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575297536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444359.164438:0:90371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164456:0:90371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164463:0:90371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164469:0:90371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164492:0:90371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444359.164499:0:90371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164506:0:90371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164539:0:90371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164547:0:90371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164568:0:90371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444359.164576:0:90371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164581:0:90371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164598:0:90371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164604:0:90371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164623:0:90371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783444359.164629:0:90371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164635:0:90371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164641:0:90371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164657:0:90371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164670:0:90371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1783444359.164685:0:90371:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1783444359.164716:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444359.164721:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164728:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444359.164731:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164740:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444359.164747:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444359.164753:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444359.164755:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1783444359.164757:0:10324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1783444359.164811:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164818:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444359.164835:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164842:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef262800/0x42cb6883e383207d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832084 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164860:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444359.164863:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164868:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444359.164871:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164878:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444359.164883:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444359.164888:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444359.164890:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783444359.164891:0:10324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783444359.164902:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164907:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444359.164918:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164925:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f04c00/0x42cb6883e383218e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832195 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164933:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444359.164936:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164947:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444359.164950:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.164956:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444359.164962:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444359.164967:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783444359.164969:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783444359.164971:0:10324:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783444359.170572:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444359.170587:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.170598:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444359.170603:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.170630:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444359.170638:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444359.170643:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783444359.170646:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783444359.170649:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783444359.170708:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.170714:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444359.170729:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.170736:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e383206f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832076 expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.170752:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444359.170754:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444359.170756:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444359.170779:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575297792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444359.170867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444359.170920:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444359.170927:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575297920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444359.170950:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444359.170988:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575297792 00000100:00100000:3.0:1783444359.171001:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575297792 00000100:00100000:3.0:1783444359.171040:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575297920 00000100:00100000:3.0:1783444359.171043:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575297920 00000100:00100000:3.0:1783444359.171066:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1783444359.171074:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575297792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444359.171087:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444359.171114:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262600/0x42cb6883e3832195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383218e expref: 24 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.171126:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444359.171170:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3633:x1870073575297792:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444359.171177:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1783444359.171193:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:3.0:1783444359.171199:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3633:x1870073575297920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444359.171208:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444359.171217:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef263800/0x42cb6883e3832076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383206f expref: 22 pid: 89014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.171225:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444359.171245:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575297920:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444359.171252:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:3.0:1783444359.171274:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444359.171281:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575297664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444359.171309:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444359.171352:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575297920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444359.171361:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575297792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444359.171558:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444359.171575:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575297664 00000100:00100000:0.0:1783444359.171579:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575297664 00000100:00100000:0.0:1783444359.171621:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1783444359.171629:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5390450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3635:x1870073575297664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444359.171643:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444359.171653:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26600/0x42cb6883e3832084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383207d expref: 21 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444359.171662:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444359.171704:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5390450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3635:x1870073575297664:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444359.171710:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1783444359.171765:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575297664:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1783444359.171921:0:90371:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783444359.171926:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1783444359.171931:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1783444359.171937:0:90371:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1783444359.174249:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.174264:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444359.174299:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.174307:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3832156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383215d expref: -99 pid: 89001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444359.174343:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575298048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444359.174402:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444359.174470:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575298048 00000100:00100000:1.0:1783444359.174476:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575298048 00000100:00100000:1.0:1783444359.174523:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1783444359.174533:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3635:x1870073575298048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444359.174558:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444359.174577:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26400/0x42cb6883e383215d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832156 expref: 20 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444359.174589:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444359.174625:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3635:x1870073575298048:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444359.174633:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000004:00000080:0.0:1783444359.175775:0:90371:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1783444359.176259:0:89002:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149712 is committed 00000020:00000080:0.0:1783444359.176313:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1783444359.176320:0:90371:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368ea5f4800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444359.176326:0:90371:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c88cb000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444359.176330:0:90371:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368ff68f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444359.176335:0:90371:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c518e800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444359.176342:0:90371:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368eaf3e000 778015c5-4969-44f5-82a5-0f6eadd152d5 192.168.204.20@tcp 13 (0 0 7) 0 0 0 1: ffff9368e79dc000 111669149712 stale:0 00000020:00080000:0.0:1783444359.176347:0:90371:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9368dd0e8000) has exports, disconnecting them 00000020:00080000:0.0:1783444359.176352:0:90371:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368ea5f4800), last request at 1783444324 00000020:00000080:0.0:1783444359.176358:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383227c 00000100:00080000:0.0:1783444359.176365:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444359.176383:0:90371:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368ea5f4800): rc 0 00000020:00000080:0.0:1783444359.176395:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ea5f4800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1783444359.176405:0:90371:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c88cb000), last request at 1783444355 00000020:00000080:0.0:1783444359.176408:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832275 00000100:00080000:0.0:1783444359.176413:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368ea5f1800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783444359.176426:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea5f4800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783444359.176464:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ea5f0000 for lustre-MDT0000 00010000:00010000:0.0:1783444359.176474:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783444359.176482:0:90371:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c88cb000): rc 0 00000020:00000080:0.0:1783444359.176484:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368c88cb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783444359.176490:0:90371:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368ff68f800), last request at 1783444355 00000020:00000080:0.0:1783444359.176493:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383226e 00000100:00080000:0.0:1783444359.176497:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368c88cb800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783444359.176507:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88cb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783444359.176525:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ea5f1800 for lustre-MDT0000 00010000:00010000:0.0:1783444359.176532:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783444359.176538:0:90371:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368ff68f800): rc 0 00000020:00000080:0.0:1783444359.176539:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ff68f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783444359.176546:0:90371:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c518e800), last request at 1783444319 00000020:00000080:0.0:1783444359.176550:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38320d8 00000100:00080000:0.0:1783444359.176560:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca3800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783444359.176570:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1783444359.176636:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575298048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444359.176668:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444359.176670:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444359.176672:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444359.176849:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.176860:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.176868:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.176874:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444359.176878:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.176885:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.176900:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9367c1e5b000) 00010000:00010000:3.0:1783444359.176904:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444359.176908:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.176914:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e38325b6 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.176953:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783444359.177597:0:90371:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c518e800): rc 0 00000020:00000080:1.0:1783444359.177600:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368c518e800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1783444359.177613:0:90371:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.20@tcp (ffff9368eaf3e000), last request at 1783444357 00000020:00000080:1.0:1783444359.177618:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38320d1 00000020:00010000:1.0:1783444359.177629:0:90371:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368eaf3e000: total 2 00000100:00080000:1.0:1783444359.177632:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368eab72000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783444359.177668:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783444359.177701:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368f8ca3800 for lustre-MDT0000 00000020:00080000:1.0:1783444359.177713:0:90371:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368eaf3e000): rc 0 00000004:00000080:1.0:1783444359.177720:0:90371:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac1c40d7fae0 00000100:00080000:1.0:1783444359.177742:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783444359.177745:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:3.0:1783444359.178198:0:10324:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368eaf3e000: total 1 00010000:00010000:3.0:1783444359.178255:0:10324:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368eaf3e000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1783444359.178287:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e38325ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bad expref: 8 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.178310:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e38324ba lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b3d expref: 7 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.178338:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e3832634 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bbb expref: 6 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.178359:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e38324b3 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b36 expref: 5 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.178372:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e38325cb lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b91 expref: 4 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.178386:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38324c1 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b44 expref: 3 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.178403:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e38325af lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b83 expref: 2 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.178416:0:10324:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368eaf3e000, canceled 7 locks, left on hash table 0. 00000100:00080000:1.0:1783444359.180683:0:90371:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783444359.180715:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368dd20d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783444359.180771:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575298176:0@lo:39:umount.0 00000100:00100000:1.0:1783444359.180864:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444359.180926:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575298176 00000100:00100000:1.0:1783444359.180933:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575298176 00000100:00100000:1.0:1783444359.180980:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1783444359.180988:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575298176:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783444359.181020:0:23687:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832117 00000100:00080000:1.0:1783444359.181028:0:23687:0:(import.c:65:import_set_state_nolock()) ffff9367c5626800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783444359.181050:0:23687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411433 00010000:00010000:2.0:1783444359.182221:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444359.183114:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3632:x1870073575298176:12345-0@lo:39:umount.0 Request processed in 2121us (2244us total) trans 77309411434 rc 0/0 00000100:00100000:1.0:1783444359.183126:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00010000:00010000:1.0:1783444359.183172:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783444359.183230:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783444359.183234:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:1.0:1783444359.183256:0:90371:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783444359.183317:0:90371:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783444359.183339:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368ea608000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783444359.183350:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783444359.183352:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 3 00000004:00080000:1.0:1783444359.183360:0:90371:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783444359.183432:0:90371:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783444359.183441:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368ef0b1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783444359.183481:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368dd0e8000) has no exports 00010000:00010000:0.0:1783444359.184263:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783444359.184312:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c88cb800 for lustre-MDT0000 00000100:00080000:2.0:1783444359.187565:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd20d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783444359.187580:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575298176:0@lo:39:umount.0 00000100:00100000:2.0:1783444359.187605:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575298304:0@lo:9:umount.0 00000100:00100000:2.0:1783444359.187670:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444359.187700:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575298432:0@lo:9:umount.0 00000100:00100000:2.0:1783444359.187721:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444359.187755:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575298304 00000100:00100000:2.0:1783444359.187762:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575298304 00000100:00100000:2.0:1783444359.187829:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575298432 00000100:00100000:2.0:1783444359.187832:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575298432 00000100:00100000:2.0:1783444359.187856:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:2.0:1783444359.187864:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575298304:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783444359.187890:0:26212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832133 00000100:00080000:2.0:1783444359.187897:0:26212:0:(import.c:65:import_set_state_nolock()) ffff9368c3fa7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783444359.187937:0:26212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:2.0:1783444359.188072:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575298304:12345-0@lo:9:umount.0 Request processed in 208us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444359.188079:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00000100:00100000:2.0:1783444359.188181:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:2.0:1783444359.188189:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575298432:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783444359.188202:0:26212:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832141 00000100:00080000:2.0:1783444359.188207:0:26212:0:(import.c:65:import_set_state_nolock()) ffff9368c9a17800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783444359.188232:0:26212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:2.0:1783444359.188307:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575298432:12345-0@lo:9:umount.0 Request processed in 118us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444359.188313:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000100:00080000:2.0:1783444359.188346:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444359.193293:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783444359.193324:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444359.193375:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ea608000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783444359.193399:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783444359.193401:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444359.193407:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575298304:0@lo:9:umount.0 00000100:00080000:2.0:1783444359.193422:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef0b1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783444359.193429:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783444359.193430:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444359.193433:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575298432:0@lo:9:umount.0 00010000:00010000:2.0:1783444359.193471:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783444359.196259:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368dd0e8000) has no exports 00000020:00000080:3.0:1783444359.228598:0:10324:0:(genops.c:906:class_export_put()) final put ffff9368eaf3e000/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:3.0:1783444359.228667:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eaf3e000/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-MDT0000 00000020:00000080:3.0:1783444359.228716:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368eab72000 for lustre-MDT0000 00010000:00010000:2.0:1783444359.228959:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444359.228962:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444359.228965:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783444359.268743:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38320ed 00000020:00000080:1.0:1783444359.268759:0:90371:0:(genops.c:906:class_export_put()) final put ffff9367c229c800/lustre-QMT0000_UUID 00000020:01000000:1.0:1783444359.268771:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783444359.269066:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c229c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783444359.271225:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444359.271243:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783444359.271248:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9367c3333380) has no exports 00000020:00000080:0.0:1783444359.271815:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38320e6 00000020:00000080:0.0:1783444359.271827:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368c5654800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444359.271847:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c5654800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444359.271909:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444359.271919:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783444359.271922:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368dd11a000/lustre-QMT0000_UUID 00000020:00000080:0.0:1783444359.271925:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd11a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783444359.271929:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1783444359.272078:0:90371:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9368eb693300 - data ffff9368ffac0ca8/ffff9367c2f60000 00000020:01000000:1.0:1783444359.272390:0:90371:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c46afae0 - data ffff9368f63d5000/ffff9368f988cc00 00000100:00080000:1.0:1783444359.338254:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783444359.338263:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783444359.338279:0:90371:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9368ff665180 x1870073575298176/t77309411434(77309411434) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444369 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444359.338308:0:90371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783444359.345861:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783444359.345869:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:2.0:1783444359.345883:0:90371:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444359.345885:0:90371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783444359.346299:0:89022:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783444359.346304:0:89022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:3.0:1783444359.346316:0:89022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:2.0:1783444359.347149:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783444359.347154:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 4 00000004:00080000:2.0:1783444359.347163:0:90371:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444359.347165:0:90371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783444359.359805:0:89024:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783444359.359814:0:89024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:3.0:1783444359.359831:0:89024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:1.0:1783444359.361400:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832099 00000020:00000080:1.0:1783444359.361409:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ff68a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444359.361532:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783444359.362257:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38320ae 00000020:00000080:1.0:1783444359.362263:0:90371:0:(genops.c:906:class_export_put()) final put ffff9367c5621000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783444359.362270:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783444359.362278:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5621000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783444359.362288:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444359.362298:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783444359.362302:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9368dd0e99c0) has no exports 00000004:01000000:1.0:1783444359.362496:0:90371:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783444359.362504:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383213a 00000020:00000080:1.0:1783444359.362508:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368dd1ef800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783444359.362515:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783444359.362522:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd1ef800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783444359.362532:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444359.362540:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783444359.362543:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9368dd0ecd40) has no exports 00000020:00000080:1.0:1783444359.362548:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383212c 00000020:00000080:1.0:1783444359.362551:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ef0b0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444359.362562:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0b0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783444359.364564:0:90371:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783444359.364572:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783444359.364576:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 5 00000004:00080000:1.0:1783444359.364583:0:90371:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783444359.364805:0:90371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783444359.364835:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef0b1000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783444359.364880:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444359.364894:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444359.364899:0:90371:0:(genops.c:906:class_export_put()) final put ffff9367c2299800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444359.364903:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c2299800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783444359.365302:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444359.365865:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383211e 00000020:00000080:1.0:1783444359.365873:0:90371:0:(genops.c:906:class_export_put()) final put ffff9367c229d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783444359.365886:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783444359.365897:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c229d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783444359.366405:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444359.366416:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783444359.366421:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9367c33319c0) has no exports 00000020:00000080:1.0:1783444359.366427:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832110 00000020:00000080:1.0:1783444359.366432:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ea60e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444359.366448:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea60e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783444359.368317:0:90371:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783444359.368325:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783444359.368328:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:1.0:1783444359.368335:0:90371:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783444359.368338:0:90371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783444359.368456:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ea608000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783444359.368505:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444359.368516:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444359.368521:0:90371:0:(genops.c:906:class_export_put()) final put ffff9367c229a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444359.368524:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c229a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783444359.368531:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783444359.368631:0:90371:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783444359.368639:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832102 00000020:00000080:1.0:1783444359.368655:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368eb781800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783444359.368662:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783444359.369805:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb781800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783444359.369825:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444359.369834:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783444359.369838:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9367c1e83380) has no exports 00000020:00000080:1.0:1783444359.369845:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38320fb 00000020:00000080:1.0:1783444359.369851:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368dd209000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444359.369867:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd209000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783444359.374873:0:90371:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783444359.374882:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783444359.374886:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783444359.374894:0:90371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783444359.374936:0:80542:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd20d000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783444359.374986:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444359.375002:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444359.375008:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ff68d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444359.375031:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1783444359.375044:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444359.375168:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444359.375174:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444359.375177:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368eb780800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444359.375179:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb780800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783444359.375183:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444359.375237:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38320b5 00000020:00000080:2.0:1783444359.375244:0:90371:0:(genops.c:906:class_export_put()) final put ffff9367c5621800/lustre-MDD0000_UUID 00000020:01000000:2.0:1783444359.375251:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783444359.375259:0:80542:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5621800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783444359.375267:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444359.375273:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783444359.375276:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9368dd0eb380) has no exports 00000020:00000080:2.0:1783444359.375294:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444359.375298:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783444359.375301:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ef0b3000/lustre-MDD0000_UUID 00000020:00000080:2.0:1783444359.375303:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0b3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783444359.375306:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1783444359.375335:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38320bc 00000020:00000080:2.0:1783444359.375339:0:90371:0:(genops.c:906:class_export_put()) final put ffff9367c5625000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444359.375349:0:80542:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5625000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1783444359.375358:0:90371:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ff57c000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783444359.375360:0:90371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ff57c000 3 00000020:01000004:2.0:1783444359.375364:0:90371:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368ff57c000 from lustre-MDT0000 00000020:00000080:2.0:1783444359.375389:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444359.375394:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783444359.375397:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ff68c800/lustre-MDT0000_UUID 00000020:00000080:2.0:1783444359.375399:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783444359.375405:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783444359.375436:0:90371:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783444359.375444:0:90371:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783444359.375448:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783444359.375450:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444359.375453:0:90371:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1783444359.375461:0:90371:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9368ef0cc800 fea1b1de-aca2-4501-86bf-fe28138c0593 192.168.204.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783444359.375468:0:90371:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9368c518c800 c89ab73b-dbb2-4305-b221-37cc64d61227 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783444359.375473:0:90371:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff9367c3330000) has exports, disconnecting them 00000020:00080000:2.0:1783444359.375477:0:90371:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.20@tcp (ffff9368ef0cc800), last request at 1783444319 00000020:00000080:2.0:1783444359.375494:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832172 00000020:00010000:2.0:1783444359.375499:0:90371:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368ef0cc800: total 0 00000100:00080000:2.0:1783444359.375502:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368ef0cf800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783444359.375522:0:90371:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368ef0cc800): rc 0 00000020:00080000:2.0:1783444359.375525:0:90371:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9368c518c800), last request at 1783444319 00000020:00010000:3.0:1783444359.375548:0:10323:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368ef0cc800: total 0 00000020:00000080:2.0:1783444359.375571:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832061 00000020:00010000:2.0:1783444359.375575:0:90371:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368c518c800: total 0 00000100:00080000:2.0:1783444359.375578:0:90371:0:(import.c:65:import_set_state_nolock()) ffff9368c518e000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783444359.375587:0:90371:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c518c800): rc 0 00000020:00080000:2.0:1783444359.375592:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9367c3330000) has no exports 00010000:00010000:3.0:1783444359.375597:0:10323:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368ef0cc800, canceled 0 locks, left on hash table 4. 00000020:00010000:2.0:1783444359.375599:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368c518c800: total 0 00010000:00010000:2.0:1783444359.375603:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444359.375647:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368c518c800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783444359.375671:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b0c expref: 5 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375672:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26000/0x42cb6883e383223d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832236 expref: 14 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.375703:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05400/0x42cb6883e3832260 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b1a expref: 4 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375707:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262e00/0x42cb6883e38321cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38321c6 expref: 13 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375732:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef262a00/0x42cb6883e383224b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832244 expref: 12 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.375736:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b21 expref: 3 pid: 89014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.375756:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c10a00/0x42cb6883e3832259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b13 expref: 2 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375765:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27800/0x42cb6883e38321db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38321d4 expref: 11 pid: 89015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.375781:0:10323:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368ef0cc800, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1783444359.375784:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05e00/0x42cb6883e38321e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38321e2 expref: 10 pid: 89008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783444359.375822:0:10323:0:(genops.c:906:class_export_put()) final put ffff9368ef0cc800/fea1b1de-aca2-4501-86bf-fe28138c0593 00010000:00010000:2.0:1783444359.375831:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27200/0x42cb6883e38321f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38321f0 expref: 9 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444359.375834:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444359.375837:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444359.375839:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783444359.375848:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0cc800/fea1b1de-aca2-4501-86bf-fe28138c0593 for MGS 00010000:00010000:2.0:1783444359.375850:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04800/0x42cb6883e3832213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383220c expref: 8 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375866:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04000/0x42cb6883e38321a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383219c expref: 7 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783444359.375879:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef0cf800 for MGS 00010000:00010000:2.0:1783444359.375880:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368ef263600/0x42cb6883e3832205 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38321fe expref: 6 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375893:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c11800/0x42cb6883e38321bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38321b8 expref: 5 pid: 89009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375904:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383221a expref: 4 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375917:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05600/0x42cb6883e38321b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38321aa expref: 3 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375929:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05a00/0x42cb6883e383222f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832228 expref: 2 pid: 89006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444359.375950:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368c518c800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1783444359.375962:0:6493:0:(genops.c:906:class_export_put()) final put ffff9368c518c800/c89ab73b-dbb2-4305-b221-37cc64d61227 00010000:00010000:2.0:1783444359.375969:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444359.375971:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444359.375973:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783444359.375979:0:80542:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518c800/c89ab73b-dbb2-4305-b221-37cc64d61227 for MGS 00000020:00000080:2.0:1783444359.375995:0:80542:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c518e000 for MGS 00000100:00100000:2.0:1783444359.376078:0:89009:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9368c59ef000:89009] 2 exiting: rc = 0 00000100:00100000:3.0:1783444359.376207:0:89015:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff9368dd2a9200:89015] 4 exiting: rc = 0 00000100:00100000:2.0:1783444359.378900:0:89008:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff936900598600:89008] 1 exiting: rc = 0 00000100:00100000:2.0:1783444359.379003:0:89014:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9368c9afe600:89014] 3 exiting: rc = 0 00000100:00100000:2.0:1783444359.383211:0:89006:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff936900599600:89006] 0 exiting: rc = 1 00000100:00100000:3.0:1783444359.384213:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384225:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384232:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384241:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384252:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384261:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384270:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384277:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384282:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384289:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384295:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384315:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384320:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384328:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384335:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384341:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384347:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384353:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384359:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384363:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384368:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384374:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384379:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384385:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384390:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384396:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384402:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384409:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384415:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384421:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384426:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384432:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384436:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384442:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384448:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384453:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384459:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384469:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384475:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384482:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384488:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384494:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384498:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384504:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384509:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384516:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384528:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384533:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384539:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384545:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384551:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384558:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384564:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384569:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384575:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384580:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384586:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384591:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384596:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384602:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384607:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384614:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384619:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783444359.384626:0:90371:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1783444359.389061:0:90371:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c3972360 - data ffff9368ffb75d80/ffff9368c5ccdc00 00000020:01000000:3.0:1783444359.389234:0:90371:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c7757e40 - data ffff9368ff81c798/ffff9368d42bb000 00000020:00000080:3.0:1783444359.389782:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383205a 00000020:00000080:3.0:1783444359.389805:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368eb6fc000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444359.389818:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb6fc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1783444359.389829:0:90371:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ff57c000 from MGS, refs=2 00000020:01000004:3.0:1783444359.389832:0:90371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ff57c000 2 00000020:01000004:3.0:1783444359.389836:0:90371:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368ff57c000 from MGS 00000020:00000080:3.0:1783444359.389860:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783444359.389869:0:90371:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783444359.389872:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368eb6f8000/MGS 00000020:00000080:3.0:1783444359.389875:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb6f8000/MGS for MGS 00000020:01000000:3.0:1783444359.389881:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783444359.390119:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783444359.390136:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444359.390147:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783444359.390155:0:90371:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9368ff64f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783444359.390161:0:90371:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9367c3334d40) has exports, disconnecting them 00000020:00080000:2.0:1783444359.390166:0:90371:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9368ff64f800), last request at 1783444319 00000020:00000080:2.0:1783444359.390170:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832180 00000020:00080000:2.0:1783444359.390180:0:90371:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368ff64f800): rc 0 00000020:00000080:2.0:1783444359.390183:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ff64f800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783444359.390294:0:80542:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff64f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783444359.391453:0:90371:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783444359.391460:0:90371:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783444359.391465:0:90371:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783444359.391485:0:90371:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783444359.391509:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ea5f7800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783444359.391632:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783444359.391643:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783444359.391647:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368ff64a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783444359.391650:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff64a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783444359.391655:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783444359.391729:0:90371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ff57c000 1 00000020:00000080:3.0:1783444359.391736:0:90371:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383204c 00000020:00000080:3.0:1783444359.391740:0:90371:0:(genops.c:906:class_export_put()) final put ffff9368eb6f8800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783444359.391747:0:90371:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783444359.391755:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb6f8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783444359.391764:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444359.391768:0:90371:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783444359.391772:0:90371:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9367c1e80000) has no exports 00000020:00000080:3.0:1783444359.539174:0:90371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783444359.539189:0:90371:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783444359.539194:0:90371:0:(genops.c:906:class_export_put()) final put ffff9367c6a4f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444359.539199:0:90371:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c6a4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783444359.539209:0:90371:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783444359.539328:0:90371:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9368ff579800 00000020:02000400:3.0:1783444359.539406:0:90371:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783444360.161402:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444360.477073:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575298560:0@lo:400:kworker.0 00000400:00000100:3.0:1783444360.477144:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575298560 offset 0 length 224: 4 00000100:00100000:0.0:1783444360.477768:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575298944:0@lo:400:kworker.0 00000100:00100000:0.0:1783444360.477826:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444360.477861:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575298816:0@lo:400:kworker.0 00000100:00100000:0.0:1783444360.477880:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444360.477905:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444360.477911:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575298688:0@lo:400:kworker.0 00000100:00100000:0.0:1783444360.477931:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444360.477960:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575298944 00000100:00100000:0.0:1783444360.477968:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575298944 00000100:00100000:0.0:1783444360.478001:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575298816 00000100:00100000:0.0:1783444360.478004:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575298816 00000100:00100000:0.0:1783444360.478036:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1783444360.478046:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575298816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444360.478098:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575298816:12345-0@lo:400:kworker.0 Request processed in 54us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444360.478117:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1783444360.478138:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575298688 00000100:00100000:0.0:1783444360.478141:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575298688 00000100:00100000:0.0:1783444360.478156:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1783444360.478161:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3635:x1870073575298944:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444360.478166:0:80475:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783444360.478202:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3635:x1870073575298944:12345-0@lo:400:kworker.0 Request processed in 40us (375us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444360.478208:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1783444360.478218:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1783444360.478222:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3634:x1870073575298688:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444360.478226:0:80475:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783444360.478244:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3634:x1870073575298688:12345-0@lo:400:kworker.0 Request processed in 20us (312us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444360.478249:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00080000:0.0:1783444360.478284:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444360.478315:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783444360.478320:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783444360.478324:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783444360.481465:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444360.481474:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783444360.481478:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783444360.481485:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444360.481489:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3315 00000100:00080000:1.0:1783444360.481498:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444360.481550:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368ff665180 x1870073575299072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444360.481580:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575298688:0@lo:400:kworker.0 00000100:00100000:1.0:1783444360.481600:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575298816:0@lo:400:kworker.0 00000100:00100000:1.0:1783444360.481640:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575299072:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783444360.481695:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444360.481740:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299072 00000100:00100000:1.0:1783444360.481746:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299072 00000100:00100000:1.0:1783444360.481782:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1783444360.481807:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575299072:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1783444360.481845:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444360.481889:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575299072:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 82us (192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444360.481897:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00080000:1.0:1783444360.481929:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444360.481934:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444360.481937:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575299072:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783444360.486664:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575299200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444360.486738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444360.487113:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299200 00000100:00100000:1.0:1783444360.487122:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299200 00000100:00100000:1.0:1783444360.487164:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1783444360.487173:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3636:x1870073575299200:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1783444360.487182:0:29151:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783444360.487229:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3636:x1870073575299200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (490us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783444360.487236:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:02020000:1.0:1783444360.487294:0:3636:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1783444360.487300:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444360.487305:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783444360.487309:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783444360.487315:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444360.487318:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3315 00000100:00080000:1.0:1783444360.487324:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444360.487347:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368ff667800 x1870073575299328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444360.487376:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575299328:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783444360.487409:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444360.487437:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299328 00000100:00100000:1.0:1783444360.487441:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299328 00000100:00100000:1.0:1783444360.487458:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1783444360.487463:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575299328:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783444360.487482:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444360.487510:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575299328:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 45us (100us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444360.487516:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00080000:1.0:1783444360.487558:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444360.487563:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444360.487566:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575299328:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783444360.488570:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575299456:0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.488611:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444360.488662:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575299584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.488686:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444360.488726:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299584 00000100:00100000:2.0:1783444360.488731:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299584 00000100:00100000:2.0:1783444360.488771:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:2.0:1783444360.488777:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575299584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.490271:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575299584:12345-0@lo:400:kworker.0 Request processed in 1489us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444360.490282:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:2.0:1783444360.490340:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444360.490350:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575299712:0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.490380:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444360.490473:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299712 00000100:00100000:2.0:1783444360.490478:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299712 00000100:00100000:2.0:1783444360.490521:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1783444360.490528:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575299712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.490567:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575299712:12345-0@lo:400:kworker.0 Request processed in 39us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444360.490573:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1783444360.490610:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575299712:0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.490643:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575299840:0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.490666:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444360.490727:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299456 00000100:00100000:2.0:1783444360.490731:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299456 00000100:00100000:2.0:1783444360.490757:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299840 00000100:00100000:2.0:1783444360.490760:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299840 00000100:00100000:2.0:1783444360.490774:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1783444360.490780:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575299456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.490831:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575299456:12345-0@lo:400:kworker.0 Request processed in 51us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444360.490844:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1783444360.490856:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1783444360.490861:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1870073575299840:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783444360.490866:0:71469:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783444360.491007:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575299584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.494518:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1870073575299840:12345-0@lo:400:kworker.0 Request processed in 32us (226us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783444360.494536:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1783444360.494623:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575299456:0@lo:400:kworker.0 00000100:00080000:2.0:1783444360.494658:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444360.494663:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444360.494667:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444360.494688:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783444360.494694:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783444360.494698:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783444360.494703:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444360.494707:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3315 00000100:00080000:2.0:1783444360.494715:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444360.494755:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5507b80 x1870073575299968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444360.494785:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575299840:0@lo:400:kworker.0 00000100:00100000:1.0:1783444360.494827:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575299968:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1783444360.494901:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444360.494946:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299968 00000100:00100000:1.0:1783444360.494952:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299968 00000100:00100000:1.0:1783444360.494992:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1783444360.494999:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575299968:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783444360.495017:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444360.495056:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575299968:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 56us (168us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444360.495062:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00080000:1.0:1783444360.495091:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444360.495095:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444360.495119:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575299968:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1783444360.507675:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444360.507690:0:3635:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3315 00000100:00080000:0.0:1783444360.507701:0:3635:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444360.510911:0:3635:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a93800 x1870073575300096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444360.510951:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575298944:0@lo:400:kworker.0 00000100:00100000:2.0:1783444360.513065:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575300096:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783444360.513168:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444360.513586:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575300096 00000100:00100000:1.0:1783444360.513595:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575300096 00000100:00100000:1.0:1783444360.513641:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1783444360.513650:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575300096:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1783444360.513675:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444360.513726:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575300096:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 76us (557us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444360.513733:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00080000:2.0:1783444360.513841:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444360.513847:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444360.513864:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575300096:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1783444361.182065:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444361.807179:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444361.807227:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444361.807312:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557789824 00000100:00100000:1.0:1783444361.807322:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557789824 00000100:00100000:1.0:1783444361.807388:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5883 00000100:00100000:1.0:1783444361.807398:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2401:x1870073557789824:12345-192.168.204.20@tcp:16:kworker.0 00000100:00080000:2.0:1783444361.808333:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444361.808478:0:25139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557789696 00000100:00100000:3.0:1783444361.808486:0:25139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557789696 00002000:00100000:3.0:1783444361.808523:0:25139:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff9367c5507800 x1870073557789696/t0(0) o4->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:737/0 lens 488/0 e 0 to 0 dl 1783444372 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444361.808541:0:25139:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5507800 with x1870073557789696 ext(1048576->2097151) 00002000:00010000:3.0:1783444361.808547:0:25139:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c5507800 00000100:00100000:3.0:1783444361.808587:0:25139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1004 00000100:00100000:3.0:1783444361.808596:0:25139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2401:x1870073557789696:12345-192.168.204.20@tcp:4:md5sum.0 00000001:00100000:1.0:1783444361.810324:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444361.810332:0:8415:0:(genops.c:906:class_export_put()) final put ffff9368c3fa5800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783444361.810350:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969450 is committed 00000020:00000080:1.0:1783444361.810379:0:54930:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c3fa5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783444361.810416:0:54930:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c3fa7800 for lustre-OST0000 00000100:00100000:2.0:1783444361.810672:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2401:x1870073557789824:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 3271us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444361.810684:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5883 00000100:00100000:0.0:1783444361.879742:0:25139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2401:x1870073557789696:12345-192.168.204.20@tcp:4:md5sum.0 Request processed in 71133us (72558us total) trans 4294969451 rc 0/0 00000100:00100000:0.0:1783444361.879761:0:25139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1004 00002000:00100000:0.0:1783444361.879775:0:25139:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff9367c5507800 x1870073557789696/t4294969451(0) o4->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:737/0 lens 488/448 e 0 to 0 dl 1783444372 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444361.879785:0:25139:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5507800 with x1870073557789696 ext(1048576->2097151) 00002000:00010000:0.0:1783444361.879825:0:25139:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c5507800 00010000:00010000:3.0:1783444362.205050:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1783444362.314219:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557789952 offset 0 length 224: 4 00000100:00100000:3.0:1783444362.314264:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444362.314301:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444362.314340:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444362.314449:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557790208 00000100:00100000:2.0:1783444362.314460:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557790208 00000100:00100000:0.0:1783444362.314482:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557790336 00000100:00100000:0.0:1783444362.314488:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557790336 00000100:00100000:2.0:1783444362.314542:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557790080 00000100:00100000:2.0:1783444362.314547:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557790080 00000100:00100000:0.0:1783444362.314559:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2397 00000100:00100000:2.0:1783444362.314573:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 977 00000100:00100000:0.0:1783444362.314575:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2401:x1870073557790336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444362.314587:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557790208:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1783444362.314660:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444362.314666:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444362.314725:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557790208:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 142us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444362.314733:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 977 00000100:00100000:2.0:1783444362.314752:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1241 00000100:00100000:2.0:1783444362.314756:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1870073557790080:12345-192.168.204.20@tcp:400:kworker.0 00000020:00080000:2.0:1783444362.314762:0:66225:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.20@tcp 00000100:00100000:0.0:1783444362.314858:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2401:x1870073557790336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 288us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444362.314865:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2397 00000100:00100000:2.0:1783444362.320037:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1870073557790080:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 5265us (5721us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783444362.320054:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1241 00000100:00100000:3.0:1783444362.327696:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444362.328084:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557790464 00000100:00100000:1.0:1783444362.328094:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557790464 00000100:00100000:1.0:1783444362.328224:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1242 00000100:00100000:1.0:1783444362.328233:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557790464:12345-192.168.204.20@tcp:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783444362.328266:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444362.328336:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557790464:12345-192.168.204.20@tcp:38:ptlrpcd_00_00.0 Request processed in 103us (652us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444362.328343:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1242 00000100:00100000:1.0:1783444363.037194:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444363.037227:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575300224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444363.037342:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444363.038251:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575300224 00000100:00100000:3.0:1783444363.038265:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575300224 00000100:00100000:3.0:1783444363.038340:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00080000:0.0:1783444363.038766:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444363.038843:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575300224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444363.038877:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444363.038988:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575300352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444363.039039:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444363.048878:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575300352 00000100:00100000:2.0:1783444363.048909:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575300352 00000100:00100000:2.0:1783444363.049023:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1783444363.049032:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575300352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444363.049076:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444363.049155:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575300352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (10114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444363.049162:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1783444363.049205:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575300352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444363.053196:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575300224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 14837us (15844us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444363.053210:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1783444363.053306:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575300224:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783444363.058186:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1783444363.065871:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444363.065884:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368c9a10800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783444363.065908:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969454 is committed 00000020:00000080:2.0:1783444363.065928:0:80542:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a10800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783444363.065976:0:80542:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c9a17800 for lustre-OST0001 00010000:00010000:2.0:1783444363.231859:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444364.252955:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783444365.096963:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783444365.096992:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411434 is committed 00000020:00000080:3.0:1783444365.096998:0:75651:0:(genops.c:906:class_export_put()) final put ffff9367c5623000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444365.097052:0:83732:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5623000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783444365.097101:0:83732:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c5626800 for lustre-MDT0001 00010000:00010000:2.0:1783444365.276960:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444365.596979:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783444365.596980:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575300480:0@lo:400:kworker.0 00000100:00080000:2.0:1783444365.596989:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444365.596993:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444365.597000:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3351 00000100:00080000:2.0:1783444365.597005:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444365.597025:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444365.597051:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5507b80 x1870073575300608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1783444365.597061:0:3635:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575300480 offset 0 length 224: 4 00000100:00100000:2.0:1783444365.597082:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575300608:0@lo:38:kworker.0 00000100:00100000:2.0:1783444365.597127:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783444365.597203:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444365.597208:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444365.597210:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444365.597214:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3351 00000100:00080000:2.0:1783444365.597216:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444365.597219:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444365.597230:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368c59bb100 x1870073575300864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444365.597249:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575300864:0@lo:38:kworker.0 00000100:00100000:2.0:1783444365.597273:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444365.597317:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575300736:0@lo:400:kworker.0 00000100:00100000:0.0:1783444365.597348:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444365.597386:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575300608 00000100:00100000:0.0:1783444365.597394:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575300608 00000100:00100000:0.0:1783444365.597429:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575300864 00000100:00100000:0.0:1783444365.597432:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575300864 00000100:00100000:0.0:1783444365.597446:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575300736 00000100:00100000:0.0:1783444365.597449:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575300736 00000100:00100000:0.0:1783444365.597487:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1783444365.597499:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575300736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444365.597566:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575300736:12345-0@lo:400:kworker.0 Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444365.597573:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1783444365.597589:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1783444365.597595:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575300608:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444365.597623:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444365.597670:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575300608:12345-0@lo:38:kworker.0 Request processed in 73us (543us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444365.597676:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1783444365.597687:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1783444365.597691:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575300864:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444365.597700:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444365.597724:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575300864:12345-0@lo:38:kworker.0 Request processed in 31us (451us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444365.597729:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00080000:0.0:1783444365.597743:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444365.597780:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444365.597785:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444365.597809:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575300864:0@lo:38:kworker.0 00000100:00080000:0.0:1783444365.597820:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444365.597823:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444365.597826:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575300608:0@lo:38:kworker.0 00000100:00100000:0.0:1783444365.597861:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575300736:0@lo:400:kworker.0 00000100:00080000:2.0:1783444365.597983:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444365.597987:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444365.597989:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444365.597995:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3351 00000100:00080000:2.0:1783444365.597998:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444365.598002:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444365.598031:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575300992:0@lo:400:kworker.0 00000100:00100000:2.0:1783444365.598034:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e726ad80 x1870073575301120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444365.598064:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444365.598070:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e726ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575301120:0@lo:38:kworker.0 00000100:00080000:2.0:1783444365.598089:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1783444365.598090:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1783444365.598096:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1783444365.598099:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575301248:0@lo:400:kworker.0 00000100:00080000:2.0:1783444365.598100:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783444365.598106:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783444365.598109:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3351 00000100:00080000:2.0:1783444365.598114:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444365.598119:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444365.598126:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444365.598133:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575301376:0@lo:400:kworker.0 00000100:00100000:0.0:1783444365.598148:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575300992 00000100:00100000:0.0:1783444365.598159:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575300992 00000100:00100000:2.0:1783444365.598173:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444365.598211:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1783444365.598217:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7c8ea00 x1870073575301504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444365.598221:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575300992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444365.598267:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575300992:12345-0@lo:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444365.598273:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1783444365.599252:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575300992:0@lo:400:kworker.0 00000100:00100000:3.0:1783444365.599607:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575301248 00000100:00100000:3.0:1783444365.599613:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575301248 00000100:00100000:3.0:1783444365.599667:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575301376 00000100:00100000:3.0:1783444365.599671:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575301376 00000100:00100000:3.0:1783444365.599709:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:3.0:1783444365.599717:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575301248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444365.599780:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575301248:12345-0@lo:400:kworker.0 Request processed in 64us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444365.599815:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:3.0:1783444365.599831:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:3.0:1783444365.599838:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575301376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444365.599872:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575301376:12345-0@lo:400:kworker.0 Request processed in 35us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444365.599877:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00080000:3.0:1783444365.599892:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444365.599896:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444365.599899:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444365.599913:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575301504:0@lo:38:kworker.0 00000100:00100000:3.0:1783444365.599944:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444365.600385:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575301504 00000100:00100000:0.0:1783444365.600391:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575301504 00000100:00100000:0.0:1783444365.600424:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1783444365.600439:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575301504:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444365.600457:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444365.600504:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575301504:12345-0@lo:38:kworker.0 Request processed in 73us (558us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444365.600510:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1783444365.601569:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575301120 00000100:00100000:1.0:1783444365.601579:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575301120 00000100:00100000:1.0:1783444365.601614:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:1.0:1783444365.601621:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575301120:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444365.601640:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444365.601687:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575301120:12345-0@lo:38:kworker.0 Request processed in 65us (3582us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444365.601694:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:2.0:1783444365.602607:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575301248:0@lo:400:kworker.0 00000100:00100000:2.0:1783444365.602646:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575301376:0@lo:400:kworker.0 00000100:00080000:3.0:1783444365.602995:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444365.603002:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444365.603015:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575301504:0@lo:38:kworker.0 00000100:00080000:3.0:1783444365.603029:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444365.603049:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444365.603052:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e726ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575301120:0@lo:38:kworker.0 00010000:00010000:3.0:1783444366.304591:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444367.326080:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444367.435367:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444367.435410:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:3.0:1783444367.435438:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557790592 offset 0 length 224: 4 00000100:00100000:3.0:1783444367.435454:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444367.435490:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444367.435515:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557791104 00000100:00100000:3.0:1783444367.435524:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557791104 00000100:00100000:2.0:1783444367.435597:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557790976 00000100:00100000:2.0:1783444367.435611:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557790976 00000100:00100000:3.0:1783444367.435627:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2400 00000100:00100000:3.0:1783444367.435639:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2402:x1870073557791104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444367.435706:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2402:x1870073557791104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 70us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444367.435713:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2400 00000100:00100000:3.0:1783444367.435728:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2401 00000100:00100000:3.0:1783444367.435734:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2402:x1870073557790976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444367.435752:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2402:x1870073557790976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 19us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444367.435757:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2401 00000100:00080000:3.0:1783444367.435771:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444367.435774:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444367.435928:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557790848 00000100:00100000:0.0:1783444367.435933:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557790848 00000100:00100000:0.0:1783444367.435988:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557790720 00000100:00100000:0.0:1783444367.435992:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557790720 00000100:00100000:0.0:1783444367.436008:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 980 00000100:00100000:0.0:1783444367.436016:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557790848:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444367.436053:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557790848:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444367.436060:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 980 00000100:00100000:0.0:1783444367.436072:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1246 00000100:00100000:0.0:1783444367.436076:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557790720:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444367.436095:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444367.436126:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557790720:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 49us (635us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444367.436133:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1246 00000100:00080000:3.0:1783444367.436232:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444368.159154:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444368.159190:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575301632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444368.159273:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444368.159350:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575301632 00000100:00100000:0.0:1783444368.159359:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575301632 00000100:00100000:0.0:1783444368.159437:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:0.0:1783444368.159447:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575301632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444368.159480:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444368.159526:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575301632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444368.159534:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00080000:1.0:1783444368.159599:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444368.159680:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff665f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575301632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444368.160430:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444368.160443:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575301760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444368.160479:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444368.160645:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575301760 00000100:00100000:2.0:1783444368.160651:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575301760 00000100:00100000:2.0:1783444368.160699:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:2.0:1783444368.160708:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575301760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444368.160728:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3922481152 avail 3690958848 00000100:00080000:1.0:1783444368.160885:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444368.161164:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575301760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 455us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444368.161172:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000001:00080000:1.0:1783444368.162078:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969451 is committed 00000100:00100000:3.0:1783444368.165718:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575301760:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783444368.348942:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444369.374457:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444370.399290:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444370.716932:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444370.716938:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444370.716955:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444370.716964:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3356 00000100:00080000:2.0:1783444370.716970:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444370.716976:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444370.716999:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7c8d500 x1870073575302016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444370.717044:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444370.717048:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444370.717050:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444370.717053:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3356 00000100:00080000:2.0:1783444370.717056:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444370.717059:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444370.717069:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7c8c000 x1870073575302272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444370.717083:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444370.717086:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444370.717087:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444370.717090:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3356 00000100:00080000:2.0:1783444370.717093:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444370.717097:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444370.717108:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd140700 x1870073575302528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444370.717127:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444370.717130:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444370.717137:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444370.717140:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3356 00000100:00080000:2.0:1783444370.717143:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444370.717146:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444370.717159:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c56f7800 x1870073575302912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444370.717188:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575302144:0@lo:400:kworker.0 00000100:00100000:2.0:1783444370.717251:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444370.717288:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444370.717294:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575302400:0@lo:400:kworker.0 00000100:00100000:2.0:1783444370.717312:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444370.717381:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e726ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575302656:0@lo:400:kworker.0 00000100:00100000:0.0:1783444370.717412:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444370.717437:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783444370.717442:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575301888:0@lo:400:kworker.0 00000400:00000100:0.0:1783444370.717457:0:3633:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575301888 offset 0 length 224: 4 00000100:00100000:0.0:1783444370.717477:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575302784:0@lo:400:kworker.0 00000100:00100000:0.0:1783444370.717494:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444370.717521:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575302656 00000100:00100000:0.0:1783444370.717528:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575302656 00000100:00100000:0.0:1783444370.717592:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575302784 00000100:00100000:0.0:1783444370.717596:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575302784 00000100:00100000:0.0:1783444370.717620:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:0.0:1783444370.717629:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575302656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444370.717686:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575302656:12345-0@lo:400:kworker.0 Request processed in 57us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444370.717717:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:0.0:1783444370.717732:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:0.0:1783444370.717739:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575302784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444370.717770:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575302784:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444370.717776:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:0.0:1783444370.717868:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575302784:0@lo:400:kworker.0 00000100:00100000:0.0:1783444370.717880:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e726ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575302656:0@lo:400:kworker.0 00000100:00100000:1.0:1783444370.718187:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575302016:0@lo:38:kworker.0 00000100:00100000:1.0:1783444370.718221:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444370.718250:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575302272:0@lo:38:kworker.0 00000100:00100000:1.0:1783444370.718272:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444370.718291:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575302528:0@lo:38:kworker.0 00000100:00100000:1.0:1783444370.718314:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444370.718329:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575302912:0@lo:38:kworker.0 00000100:00100000:1.0:1783444370.718346:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444370.718373:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575302144 00000100:00100000:1.0:1783444370.718378:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575302144 00000100:00100000:1.0:1783444370.718407:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575302400 00000100:00100000:1.0:1783444370.718409:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575302400 00000100:00100000:1.0:1783444370.718422:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575302016 00000100:00100000:1.0:1783444370.718432:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575302016 00000100:00100000:1.0:1783444370.718443:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575302272 00000100:00100000:1.0:1783444370.718445:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575302272 00000100:00100000:1.0:1783444370.718452:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575302912 00000100:00100000:1.0:1783444370.718454:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575302912 00000100:00100000:1.0:1783444370.718463:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1783444370.718470:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575302144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444370.718508:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575302144:12345-0@lo:400:kworker.0 Request processed in 38us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444370.718514:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1783444370.718529:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1783444370.718534:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575302400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444370.718562:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575302400:12345-0@lo:400:kworker.0 Request processed in 27us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444370.718567:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1783444370.718579:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1783444370.718583:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575302016:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444370.718601:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444370.718634:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575302016:12345-0@lo:38:kworker.0 Request processed in 48us (412us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444370.718640:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1783444370.718651:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1783444370.718655:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575302272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444370.718664:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444370.718686:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575302272:12345-0@lo:38:kworker.0 Request processed in 30us (414us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444370.718718:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1783444370.718731:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1783444370.718735:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575302912:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444370.718745:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444370.718769:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575302912:12345-0@lo:38:kworker.0 Request processed in 32us (422us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444370.718775:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1783444370.718816:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575302528 00000100:00100000:1.0:1783444370.718820:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575302528 00000100:00100000:1.0:1783444370.718841:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:1.0:1783444370.718845:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575302528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444370.718854:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444370.718881:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575302528:12345-0@lo:38:kworker.0 Request processed in 35us (566us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444370.718886:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00080000:1.0:1783444370.718918:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444370.718924:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444370.718926:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444370.718949:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575302400:0@lo:400:kworker.0 00000100:00100000:1.0:1783444370.718962:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575302144:0@lo:400:kworker.0 00000100:00080000:1.0:1783444370.718993:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444370.718998:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444370.719001:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575302016:0@lo:38:kworker.0 00000100:00080000:1.0:1783444370.719008:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444370.719018:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444370.719021:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575302272:0@lo:38:kworker.0 00000100:00080000:1.0:1783444370.719031:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444370.719033:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444370.719036:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575302528:0@lo:38:kworker.0 00000100:00080000:1.0:1783444370.719043:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444370.719046:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444370.719048:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575302912:0@lo:38:kworker.0 00010000:00010000:2.0:1783444371.421244:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444372.445300:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444372.557613:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444372.557654:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:3.0:1783444372.557678:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557791232 offset 0 length 224: 4 00000100:00100000:3.0:1783444372.557694:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444372.557715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444372.558473:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557791488 00000100:00100000:0.0:1783444372.558485:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557791488 00000100:00100000:0.0:1783444372.558550:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557791360 00000100:00100000:0.0:1783444372.558554:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557791360 00000100:00100000:0.0:1783444372.558575:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 983 00000100:00100000:0.0:1783444372.558584:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557791488:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444372.558656:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557791488:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444372.558663:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 983 00000100:00100000:0.0:1783444372.558679:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1250 00000100:00100000:0.0:1783444372.558684:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557791360:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444372.558703:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444372.558729:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557791360:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 43us (1013us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444372.558735:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1250 00000100:00080000:0.0:1783444372.558752:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444372.561007:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557791744 00000100:00100000:2.0:1783444372.561019:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557791744 00000100:00100000:2.0:1783444372.561370:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557791616 00000100:00100000:2.0:1783444372.561375:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557791616 00000100:00100000:2.0:1783444372.561405:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2404 00000100:00100000:2.0:1783444372.561415:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2402:x1870073557791744:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444372.561481:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2402:x1870073557791744:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 67us (3824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444372.561489:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2404 00000100:00100000:2.0:1783444372.561505:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2405 00000100:00100000:2.0:1783444372.561512:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557791616:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444372.561536:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557791616:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444372.561554:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2405 00000100:00080000:1.0:1783444372.564195:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444372.564206:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444373.278104:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575303040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444373.278174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444373.278214:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444373.278221:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575303168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444373.278245:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444373.278287:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575303040 00000100:00100000:2.0:1783444373.278295:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575303040 00000100:00100000:2.0:1783444373.278344:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575303168 00000100:00100000:2.0:1783444373.278348:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575303168 00000100:00100000:2.0:1783444373.278366:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:2.0:1783444373.278374:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575303040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444373.278403:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444373.278447:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575303040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444373.278454:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:2.0:1783444373.278471:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:2.0:1783444373.278478:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575303168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444373.278492:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444373.278519:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575303168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444373.278525:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00080000:2.0:1783444373.278544:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444373.278548:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444373.278583:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575303168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444373.278598:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575303040:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783444373.469019:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444374.498034:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444375.528408:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444375.839302:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444375.839309:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444375.839313:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444375.839321:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3361 00000100:00080000:2.0:1783444375.839327:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444375.839335:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444375.839359:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c56f5880 x1870073575303424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444375.839383:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444375.839386:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444375.839388:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444375.839391:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3361 00000100:00080000:2.0:1783444375.839394:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444375.839397:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444375.839406:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368eaaf4380 x1870073575303680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444375.839430:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444375.839433:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444375.839434:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444375.839439:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3361 00000100:00080000:2.0:1783444375.839441:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444375.839444:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444375.839457:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69adf80 x1870073575303936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444375.840928:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444375.840951:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575303808:0@lo:400:kworker.0 00000100:00100000:0.0:1783444375.841041:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444375.841106:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575303296:0@lo:400:kworker.0 00000400:00000100:0.0:1783444375.841126:0:3633:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575303296 offset 0 length 224: 4 00000100:00100000:0.0:1783444375.841151:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444375.841157:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575303552:0@lo:400:kworker.0 00000100:00100000:0.0:1783444375.841179:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444375.841208:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575303808 00000100:00100000:0.0:1783444375.841215:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575303808 00000100:00100000:0.0:1783444375.841268:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575303552 00000100:00100000:0.0:1783444375.841272:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575303552 00000100:00100000:0.0:1783444375.841298:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1783444375.841306:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e726ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575303808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444375.841360:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e726ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575303808:12345-0@lo:400:kworker.0 Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444375.841367:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1783444375.841382:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1783444375.841388:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575303552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444375.841418:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575303552:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444375.841424:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:0.0:1783444375.841441:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444375.841894:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575303552:0@lo:400:kworker.0 00000100:00100000:0.0:1783444375.841937:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575303808:0@lo:400:kworker.0 00000100:00100000:1.0:1783444375.842042:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575303424:0@lo:38:kworker.0 00000100:00100000:1.0:1783444375.842077:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444375.842099:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575303680:0@lo:38:kworker.0 00000100:00100000:1.0:1783444375.842119:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444375.842151:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575303424 00000100:00100000:1.0:1783444375.842156:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575303424 00000100:00100000:1.0:1783444375.842178:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575303680 00000100:00100000:1.0:1783444375.842181:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575303680 00000100:00100000:1.0:1783444375.842196:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1783444375.842201:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575303424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444375.842222:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444375.842258:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575303424:12345-0@lo:38:kworker.0 Request processed in 55us (180us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444375.842265:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1783444375.842295:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1783444375.842299:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575303680:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444375.842309:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444375.842334:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575303680:12345-0@lo:38:kworker.0 Request processed in 33us (213us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444375.842340:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00080000:1.0:1783444375.842364:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444375.842369:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444375.842373:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575303424:0@lo:38:kworker.0 00000100:00080000:1.0:1783444375.842382:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444375.842386:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444375.842388:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575303680:0@lo:38:kworker.0 00000100:00080000:2.0:1783444375.843182:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444375.843188:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444375.843191:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444375.843196:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3361 00000100:00080000:2.0:1783444375.843201:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444375.843206:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444375.843230:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ace00 x1870073575304320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444375.843564:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575304192:0@lo:400:kworker.0 00000100:00100000:0.0:1783444375.843619:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444375.843665:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575304192 00000100:00100000:0.0:1783444375.843671:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575304192 00000100:00100000:0.0:1783444375.843721:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:0.0:1783444375.843729:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575304192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444375.843896:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575303936:0@lo:38:kworker.0 00000100:00100000:1.0:1783444375.843927:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444375.843947:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575304320:0@lo:38:kworker.0 00000100:00100000:1.0:1783444375.843969:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444375.843998:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575303936 00000100:00100000:1.0:1783444375.844002:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575303936 00000100:00100000:1.0:1783444375.844024:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:1.0:1783444375.844029:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575303936:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444375.844045:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444375.844074:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575303936:12345-0@lo:38:kworker.0 Request processed in 44us (146us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444375.844081:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00080000:1.0:1783444375.844125:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444375.844130:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444375.844133:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575303936:0@lo:38:kworker.0 00000100:00100000:0.0:1783444375.844278:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575304192:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444375.844287:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:0.0:1783444375.844309:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575304320 00000100:00100000:0.0:1783444375.844313:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575304320 00000100:00100000:0.0:1783444375.844375:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1783444375.844380:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575304320:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444375.844391:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444375.844425:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575304320:12345-0@lo:38:kworker.0 Request processed in 43us (454us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444375.844431:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1783444375.847132:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444375.847161:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575304064:0@lo:400:kworker.0 00000100:00100000:3.0:1783444375.847253:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783444375.859275:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444375.859355:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575304192:0@lo:400:kworker.0 00000100:00080000:3.0:1783444375.860175:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444375.860185:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444375.860189:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575304320:0@lo:38:kworker.0 00000100:00100000:0.0:1783444375.860661:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575304064 00000100:00100000:0.0:1783444375.860670:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575304064 00000100:00100000:0.0:1783444375.860741:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:0.0:1783444375.860752:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575304064:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783444375.860875:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444375.860880:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575304064:12345-0@lo:400:kworker.0 Request processed in 130us (13627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444375.860887:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:0.0:1783444375.860933:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575304064:0@lo:400:kworker.0 00010000:00010000:2.0:1783444376.541225:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1783444376.861126:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444360/real 1783444360] req@ffff9369018a8700 x1870073575298560/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444376 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444376.861162:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9369018a8700 x1870073575298560/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444376 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444376.861173:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783444376.861177:0:3636:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1783444376.861181:0:3636:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783444376.861183:0:3636:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783444376.861188:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9369018a8700 x1870073575298560/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444376 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444376.861198:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c5505500 x1870073575300480/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444376.861222:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368e7c8d180 x1870073575301888/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444376.861236:0:3636:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c56f5500 x1870073575303296/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444391 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783444376.861257:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783444376.861260:0:3636:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783444376.861261:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783444376.861264:0:3636:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1783444376.861302:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575298560:0@lo:400:kworker.0 00000100:00080000:2.0:1783444376.861333:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444376.861338:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783444376.861341:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444376.861346:0:80542:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3310 00000100:00080000:2.0:1783444376.861354:0:80542:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444376.861381:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69afb80 x1870073575304448/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444376.861403:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444376.861407:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444376.861408:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444376.861411:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3366 00000100:00080000:2.0:1783444376.861414:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444376.861418:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444376.861433:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ace00 x1870073575304576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444376.861455:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444376.861458:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444376.861459:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444376.861463:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3366 00000100:00080000:2.0:1783444376.861465:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444376.861476:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444376.861490:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69adf80 x1870073575304832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444376.861511:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444376.861514:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444376.861516:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444376.861519:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3366 00000100:00080000:2.0:1783444376.861522:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444376.861525:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444376.861537:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fd880 x1870073575305088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444376.861571:0:80542:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444376.861574:0:80542:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444376.861576:0:80542:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444376.861579:0:80542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3366 00000100:00080000:2.0:1783444376.861581:0:80542:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444376.861585:0:80542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444376.861596:0:80542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fdc00 x1870073575305472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444376.861618:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575304448:0@lo:250:kworker.0 00000400:00000100:2.0:1783444376.861664:0:3632:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575304448 offset 0 length 520: 4 00000100:00100000:2.0:1783444376.861694:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575304576:0@lo:38:kworker.0 00000100:00100000:2.0:1783444376.861724:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444376.861745:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575304832:0@lo:38:kworker.0 00000100:00100000:2.0:1783444376.862019:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444376.862043:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575305088:0@lo:38:kworker.0 00000100:00100000:2.0:1783444376.862069:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444376.862088:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575305472:0@lo:38:kworker.0 00000100:00100000:2.0:1783444376.862107:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444376.862135:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575304704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.862154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444376.862170:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444376.862174:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575305344:0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.862193:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444376.862216:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575304576 00000100:00100000:2.0:1783444376.862223:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575304576 00000100:00100000:2.0:1783444376.862248:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575304832 00000100:00100000:2.0:1783444376.862250:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575304832 00000100:00100000:2.0:1783444376.862262:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575305472 00000100:00100000:2.0:1783444376.862264:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575305472 00000100:00100000:2.0:1783444376.862270:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575304704 00000100:00100000:2.0:1783444376.862272:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575304704 00000100:00100000:2.0:1783444376.862405:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1783444376.862415:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575304704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.862464:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575304704:12345-0@lo:400:kworker.0 Request processed in 50us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444376.862470:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1783444376.862485:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1783444376.862489:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575304576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444376.862507:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444376.862544:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575304576:12345-0@lo:38:kworker.0 Request processed in 53us (819us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444376.862617:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1783444376.862630:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1783444376.862634:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575304832:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444376.862644:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444376.862669:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575304832:12345-0@lo:38:kworker.0 Request processed in 33us (650us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444376.862674:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1783444376.862683:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1783444376.862686:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575305472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444376.862694:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444376.862713:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575305472:12345-0@lo:38:kworker.0 Request processed in 25us (604us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444376.862718:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1783444376.862741:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575305088 00000100:00100000:2.0:1783444376.862744:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575305088 00000100:00100000:2.0:1783444376.862762:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:2.0:1783444376.862766:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575305088:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444376.862775:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444376.862966:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575305088:12345-0@lo:38:kworker.0 Request processed in 197us (894us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444376.862971:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:2.0:1783444376.862995:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575305344 00000100:00100000:2.0:1783444376.862998:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575305344 00000100:00100000:2.0:1783444376.863092:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:2.0:1783444376.863098:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575305344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.863131:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575305344:12345-0@lo:400:kworker.0 Request processed in 34us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444376.863137:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:2.0:1783444376.863174:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575305344:0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.863186:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575304704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.863213:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575305216:0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.863240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444376.863264:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444376.863269:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575304960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.863561:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444376.864043:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575300480:0@lo:400:kworker.0 00000100:00100000:1.0:1783444376.864073:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575303296:0@lo:400:kworker.0 00000100:00100000:1.0:1783444376.864080:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575301888:0@lo:400:kworker.0 00000100:00100000:1.0:1783444376.864102:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575304960 00000100:00100000:1.0:1783444376.864107:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575304960 00000100:00100000:1.0:1783444376.864147:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1783444376.864155:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575304960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444376.864202:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575304960:12345-0@lo:400:kworker.0 Request processed in 48us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444376.864210:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1783444376.864235:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575305216 00000100:00100000:1.0:1783444376.864239:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575305216 00000100:00100000:1.0:1783444376.864263:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:1.0:1783444376.864269:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575305216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444376.864313:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575305216:12345-0@lo:400:kworker.0 Request processed in 43us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444376.864319:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00080000:3.0:1783444376.866978:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444376.866992:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444376.866998:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575304576:0@lo:38:kworker.0 00000100:00080000:3.0:1783444376.867027:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444376.867031:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444376.867034:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575304832:0@lo:38:kworker.0 00000100:00080000:3.0:1783444376.867046:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444376.867049:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444376.867051:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575305088:0@lo:38:kworker.0 00000100:00080000:3.0:1783444376.867061:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444376.867064:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444376.867075:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575305472:0@lo:38:kworker.0 00000100:00100000:2.0:1783444376.868380:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575304960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444376.868398:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575305216:0@lo:400:kworker.0 00010000:00010000:3.0:1783444377.572945:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444377.684942:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444377.684984:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:0.0:1783444377.685030:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557791872 offset 0 length 224: 4 00000100:00100000:0.0:1783444377.685050:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444377.685076:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444377.685104:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557792384 00000100:00100000:0.0:1783444377.685113:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557792384 00000100:00100000:0.0:1783444377.685170:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557792256 00000100:00100000:0.0:1783444377.685174:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557792256 00000100:00100000:0.0:1783444377.685200:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2410 00000100:00100000:0.0:1783444377.685209:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2402:x1870073557792384:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444377.685733:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557792128 00000100:00100000:1.0:1783444377.685750:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557792128 00000100:00100000:1.0:1783444377.685810:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557792000 00000100:00100000:1.0:1783444377.685822:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557792000 00000100:00100000:1.0:1783444377.685848:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 988 00000100:00100000:1.0:1783444377.685856:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557792128:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444377.685935:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2402:x1870073557792384:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 726us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444377.685943:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2410 00000100:00100000:0.0:1783444377.686131:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2411 00000100:00100000:0.0:1783444377.686139:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557792256:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444377.687164:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557792128:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 1303us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444377.687175:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 988 00000100:00100000:1.0:1783444377.687203:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1257 00000100:00100000:1.0:1783444377.687209:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557792000:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:1.0:1783444377.687230:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444377.687266:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557792000:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 55us (2188us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444377.687442:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2402:x1870073557792256:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 1303us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444377.687451:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2411 00000100:00080000:0.0:1783444377.687477:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444377.687482:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444377.687485:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444377.689566:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1257 00000100:00100000:2.0:1783444378.396926:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575305600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444378.396993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444378.397044:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575305600 00000100:00100000:2.0:1783444378.397051:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575305600 00000100:00100000:2.0:1783444378.397097:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:2.0:1783444378.397105:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575305600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444378.397134:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444378.397171:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575305600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444378.397178:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:2.0:1783444378.397230:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575305600:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783444378.399235:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444378.399252:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444378.399267:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575305728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444378.399327:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444378.399378:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575305728 00000100:00100000:0.0:1783444378.399385:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575305728 00000100:00100000:0.0:1783444378.399433:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:0.0:1783444378.399450:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575305728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444378.399479:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444378.399519:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575305728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444378.399526:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00080000:0.0:1783444378.399560:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444378.399592:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575305728:0@lo:13:osp-pre-0-1.0 00000400:00000100:2.0:1783444378.521584:0:3626:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557792512 offset 0 length 520: 4 00010000:00010000:1.0:1783444378.591948:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444379.614984:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444380.636970:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444381.672775:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444381.980873:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444381.980884:0:50586:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444381.980887:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444381.980890:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444381.980894:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444381.980904:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3367 00000100:00080000:2.0:1783444381.980909:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444381.980916:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444381.980957:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ff480 x1870073575305856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444381.981011:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444381.981015:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444381.981017:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444381.981021:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3367 00000100:00080000:2.0:1783444381.981024:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444381.981027:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444381.981038:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fed80 x1870073575306112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444381.981060:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444381.981063:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444381.981064:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444381.981079:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3367 00000100:00080000:2.0:1783444381.981081:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444381.981085:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444381.981097:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fd880 x1870073575306368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444381.981118:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444381.981121:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444381.981123:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444381.981126:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3367 00000100:00080000:2.0:1783444381.981128:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444381.981132:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444381.981140:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ace00 x1870073575306752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444381.981167:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575306624:0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981234:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444381.981271:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444381.981277:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575305984:0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981305:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444381.981332:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575306240:0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981355:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444381.981373:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444381.981378:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575306496:0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981404:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444381.981437:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575306624 00000100:00100000:2.0:1783444381.981444:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575306624 00000100:00100000:2.0:1783444381.981500:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575306496 00000100:00100000:2.0:1783444381.981503:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575306496 00000100:00100000:2.0:1783444381.981528:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:2.0:1783444381.981536:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575306624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981590:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575306624:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444381.981597:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00100000:2.0:1783444381.981613:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:2.0:1783444381.981620:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575306496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981650:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575306496:12345-0@lo:400:kworker.0 Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444381.981656:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:2.0:1783444381.981673:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575305984 00000100:00100000:2.0:1783444381.981676:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575305984 00000100:00100000:2.0:1783444381.981715:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575306240 00000100:00100000:2.0:1783444381.981718:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575306240 00000100:00100000:2.0:1783444381.981740:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1783444381.981746:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575305984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981776:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575305984:12345-0@lo:400:kworker.0 Request processed in 30us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444381.981782:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1783444381.981816:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1783444381.981822:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575306240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981849:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575306240:12345-0@lo:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444381.981854:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00080000:2.0:1783444381.981875:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444381.981887:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444381.981889:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444381.981926:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575305984:0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981939:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575306624:0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981975:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575306496:0@lo:400:kworker.0 00000100:00100000:2.0:1783444381.981985:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575306240:0@lo:400:kworker.0 00000100:00100000:0.0:1783444381.983036:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575305856:0@lo:38:kworker.0 00000100:00100000:0.0:1783444381.983094:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444381.983124:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575306112:0@lo:38:kworker.0 00000100:00100000:0.0:1783444381.983147:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444381.983167:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575306368:0@lo:38:kworker.0 00000100:00100000:0.0:1783444381.983190:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444381.983208:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575306752:0@lo:38:kworker.0 00000100:00100000:0.0:1783444381.983228:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444381.983270:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575305856 00000100:00100000:0.0:1783444381.983276:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575305856 00000100:00100000:0.0:1783444381.983306:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575306112 00000100:00100000:0.0:1783444381.983309:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575306112 00000100:00100000:0.0:1783444381.983321:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575306752 00000100:00100000:0.0:1783444381.983324:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575306752 00000100:00100000:0.0:1783444381.983338:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1783444381.983344:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575305856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444381.983365:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444381.983403:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575305856:12345-0@lo:38:kworker.0 Request processed in 57us (307us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444381.983421:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1783444381.983436:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1783444381.983440:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575306112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444381.983450:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444381.983474:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575306112:12345-0@lo:38:kworker.0 Request processed in 32us (326us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444381.983479:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1783444381.983488:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1783444381.983492:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575306752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444381.983500:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444381.983521:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575306752:12345-0@lo:38:kworker.0 Request processed in 27us (292us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444381.983527:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1783444381.983545:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575306368 00000100:00100000:0.0:1783444381.983549:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575306368 00000100:00100000:0.0:1783444381.983569:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:0.0:1783444381.983573:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575306368:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444381.983582:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444381.983608:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575306368:12345-0@lo:38:kworker.0 Request processed in 33us (417us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444381.983613:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00080000:0.0:1783444381.983676:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444381.983682:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444381.983686:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575305856:0@lo:38:kworker.0 00000100:00080000:0.0:1783444381.983716:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444381.983720:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444381.983722:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575306112:0@lo:38:kworker.0 00000100:00080000:0.0:1783444381.983730:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444381.983732:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444381.983735:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575306368:0@lo:38:kworker.0 00000100:00080000:0.0:1783444381.983741:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444381.983743:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444381.983746:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575306752:0@lo:38:kworker.0 00010000:00010000:3.0:1783444382.685011:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783444383.410351:0:90989:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783444383.410357:0:90989:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783444383.410359:0:90989:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783444383.410473:0:90989:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9368cb785000 00000020:01000004:3.0:1783444383.410489:0:90989:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783444383.410503:0:90989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783444383.410517:0:90989:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9367c1e80000) 00000020:00000080:3.0:1783444383.410534:0:90989:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1783444383.517125:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444383.517144:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575306880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444383.517211:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444383.517258:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575306880 00000100:00100000:0.0:1783444383.517266:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575306880 00000100:00100000:0.0:1783444383.517321:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:0.0:1783444383.517330:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575306880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444383.517359:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444383.517404:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575306880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444383.517411:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00080000:0.0:1783444383.517430:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444383.517463:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575306880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444383.518384:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444383.518397:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575307008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444383.518434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444383.519277:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575307008 00000100:00100000:0.0:1783444383.519286:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575307008 00000100:00100000:0.0:1783444383.519341:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:0.0:1783444383.519357:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575307008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444383.519381:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444383.519492:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575307008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444383.519499:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00080000:2.0:1783444383.520205:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444383.526114:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575307008:0@lo:13:osp-pre-1-1.0 00100000:10000000:2.0:1783444383.558179:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783444383.566868:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783444383.578597:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783444383.582435:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783444383.583125:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783444383.583589:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.588716:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.589360:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.589699:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.589994:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.590152:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.590468:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.591174:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.591590:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.592000:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.592608:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.593105:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.593467:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.593875:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.594172:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.595070:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.595862:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.596327:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.596692:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.597118:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.598379:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.600489:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.601990:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.603550:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.604071:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.604419:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.604708:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783444383.605147:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783444383.605535:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783444383.613297:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.613864:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1783444383.614537:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.614734:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.615641:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783444383.616619:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783444383.617083:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.617439:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783444383.618030:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.618372:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783444383.618871:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.619160:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783444383.619464:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.620169:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.622387:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.623012:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.625745:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.626736:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1783444383.628027:0:90989:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1783444383.631162:0:90989:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783444383.631427:0:90989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783444383.631439:0:90989:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783444383.631452:0:90989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e383265e 00000020:01000004:2.0:1783444383.631461:0:90989:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783444383.631474:0:90989:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783444383.631479:0:90989:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9368cb785000 from MGS 00000020:01000004:2.0:1783444383.631483:0:90989:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783444383.631494:0:90989:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9367c3330000) 00000020:00000080:2.0:1783444383.631507:0:90989:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:2.0:1783444383.631574:0:90989:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368cb785000 from MGS, refs=2 00080000:01000000:2.0:1783444383.631578:0:90989:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783444383.631583:0:90989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e383266c 00010000:00010000:2.0:1783444383.631720:0:90989:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1783444383.638188:0:90989:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783444383.648027:0:90993:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783444383.648082:0:90989:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783444383.648142:0:90989:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783444383.649197:0:90989:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783444383.649474:0:90989:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783444383.649642:0:90989:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783444383.649648:0:90989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783444383.650367:0:90989:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783444383.650374:0:90989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783444383.650745:0:90989:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783444383.650752:0:90989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783444383.651454:0:90989:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783444383.651484:0:90989:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1783444383.651485:0:90989:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1783444383.651489:0:90989:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1783444383.651496:0:90989:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 80, was 0): CONNECTING 00000100:00100000:0.0:1783444383.651504:0:90989:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:0.0:1783444383.709678:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444383.822705:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444383.822761:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444383.822839:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444383.822907:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557792768 00000100:00100000:1.0:1783444383.822931:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557792768 00000100:00100000:2.0:1783444383.822996:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557793024 00000100:00100000:2.0:1783444383.823001:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557793024 00000100:00100000:1.0:1783444383.823021:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 991 00000100:00100000:1.0:1783444383.823032:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557792768:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444383.823039:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557792896 00000100:00100000:2.0:1783444383.823041:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557792896 00000100:00100000:2.0:1783444383.823061:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2414 00000100:00100000:2.0:1783444383.823067:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2401:x1870073557793024:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444383.823120:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557792768:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 90us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444383.823126:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 991 00000100:00100000:3.0:1783444383.824700:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2415 00000100:00100000:3.0:1783444383.824721:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557792896:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444383.827853:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2401:x1870073557793024:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 4772us (5078us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444383.827871:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2414 00000100:00080000:2.0:1783444383.827992:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444383.827999:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444383.828004:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444383.829588:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444383.829618:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557792896:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 4901us (6773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444383.829639:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2415 00000100:00100000:1.0:1783444383.829827:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557792640 00000100:00100000:1.0:1783444383.829837:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557792640 00000100:00100000:1.0:1783444383.829874:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1261 00000100:00100000:1.0:1783444383.829881:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557792640:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:1.0:1783444383.829913:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444383.830154:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557792640:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 271us (574us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444383.830162:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1261 00010000:00010000:2.0:1783444384.732950:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444385.758901:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444386.076921:0:3632:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444376/real 1783444376] req@ffff9368e69afb80 x1870073575304448/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444386 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444386.076957:0:3632:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9368e69afb80 x1870073575304448/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444386 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444386.076978:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444386.076993:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1783444386.077014:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575304448:0@lo:250:kworker.0 00000100:00080000:1.0:1783444386.077064:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444386.077068:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783444386.077071:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444386.077094:0:86011:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3367 00000100:00080000:1.0:1783444386.077099:0:86011:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444386.077107:0:86011:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444386.077141:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5504e00 x1870073575307136/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444386.077159:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444386.077162:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444386.077163:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444386.077167:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3373 00000100:00080000:1.0:1783444386.077169:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783444386.077173:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444386.077188:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5505180 x1870073575307264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444386.077292:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575307392:0@lo:400:kworker.0 00000100:00100000:3.0:1783444386.077361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.077458:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575307392 00000100:00100000:2.0:1783444386.077473:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575307392 00000100:00100000:2.0:1783444386.077528:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1783444386.077538:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575307392:12345-0@lo:400:kworker.0 10000000:01000000:0.0:1783444386.077647:0:90989:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1783444386.077664:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383223d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077675:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383223d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077693:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1783444386.077705:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.077715:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef263c00/0x42cb6883e3832236 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383223d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.077733:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38321a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077739:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38321a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077744:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.077747:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.077751:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383219c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38321a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.077760:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38321bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077766:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38321bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077771:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.077775:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.077778:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e38321b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38321bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.077786:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38321e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077848:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38321e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077853:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.077857:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.077862:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef263200/0x42cb6883e38321e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38321e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.077872:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38321f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077878:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38321f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077882:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.077886:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.077889:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef263400/0x42cb6883e38321f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38321f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.077897:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832213 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077903:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832213 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077908:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.077911:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.077915:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef263e00/0x42cb6883e383220c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832213 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.077933:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832221 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077939:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832221 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077944:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.077948:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.077951:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef262400/0x42cb6883e383221a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832221 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.077959:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383224b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077965:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383224b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077969:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.077972:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.077975:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef263000/0x42cb6883e3832244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383224b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.077985:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38321b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.077990:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38321b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.077995:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.078006:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.078010:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef262200/0x42cb6883e38321aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38321b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.078023:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38321cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.078030:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38321cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.078034:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444386.078037:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.078040:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f05200/0x42cb6883e38321c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38321cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.078051:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38321db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.078057:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38321db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.078062:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444386.078064:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.078068:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f04600/0x42cb6883e38321d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38321db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.078076:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832205 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.078082:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832205 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.078096:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444386.078100:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.078105:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26800/0x42cb6883e38321fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832205 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.078113:0:90989:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383222f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444386.078118:0:90989:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383222f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444386.078123:0:90989:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444386.078126:0:90989:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444386.078129:0:90989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368ef262c00/0x42cb6883e3832228 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383222f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783444386.078142:0:90989:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 81, was 0): CONNECTING 00000100:00080000:0.0:1783444386.078147:0:90989:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:0.0:1783444386.078162:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444386.078183:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575307136:0@lo:250:kworker.0 00000100:00100000:0.0:1783444386.078218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444386.078245:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575307264:0@lo:38:kworker.0 00000100:00100000:0.0:1783444386.078265:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444386.078298:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575307136 00000100:00100000:0.0:1783444386.078302:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575307136 00000100:00100000:0.0:1783444386.078322:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783444386.078327:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3632:x1870073575307136:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1783444386.078358:0:90995:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo t0 exp 0000000000000000 cur 3377 last 0 00000020:00000080:0.0:1783444386.078385:0:90995:0:(genops.c:1406:class_connect()) connect: client c89ab73b-dbb2-4305-b221-37cc64d61227, cookie 0x42cb6883e3832673 00000100:00080000:0.0:1783444386.078510:0:90995:0:(import.c:65:import_set_state_nolock()) ffff9368ff649000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444386.078547:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+5:3632:x1870073575307136:12345-0@lo:250:kworker.0 Request processed in 218us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.078553:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783444386.078596:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 10000000:01000000:0.0:1783444386.078604:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1783444386.078607:0:3632:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x42cb6883e3832673 00000100:00080000:1.0:1783444386.079675:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444386.079682:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444386.079685:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444386.079691:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3373 00000100:00080000:1.0:1783444386.079694:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783444386.079700:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444386.079727:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5505500 x1870073575307520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444386.079762:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444386.079766:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444386.079768:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444386.079771:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3373 00000100:00080000:1.0:1783444386.079782:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783444386.079802:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444386.079819:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7c8df80 x1870073575307776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444386.085911:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575307392:12345-0@lo:400:kworker.0 Request processed in 8364us (8539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.085926:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1783444386.085956:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575307264 00000100:00100000:2.0:1783444386.085964:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575307264 00000100:00100000:2.0:1783444386.086009:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1783444386.086015:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575307264:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444386.086038:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444386.086093:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575307264:12345-0@lo:38:kworker.0 Request processed in 77us (7827us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444386.086099:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1783444386.086143:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575308032:0@lo:400:kworker.0 00000100:00100000:2.0:1783444386.086177:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.086260:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575307648:0@lo:400:kworker.0 00000100:00100000:2.0:1783444386.086284:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.086300:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444386.086305:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575307904:0@lo:400:kworker.0 00000100:00100000:2.0:1783444386.086321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.086349:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575307648 00000100:00100000:2.0:1783444386.086352:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575307648 00000100:00100000:2.0:1783444386.086388:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1783444386.086393:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575307648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444386.086432:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575307648:12345-0@lo:400:kworker.0 Request processed in 38us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.086451:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1783444386.086484:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575307648:0@lo:400:kworker.0 00000100:00100000:2.0:1783444386.086518:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575308032 00000100:00100000:2.0:1783444386.086521:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575308032 00000100:00100000:2.0:1783444386.086541:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575307904 00000100:00100000:2.0:1783444386.086543:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575307904 00000100:00100000:2.0:1783444386.086557:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:2.0:1783444386.086562:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575308032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444386.086591:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575308032:12345-0@lo:400:kworker.0 Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.086596:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:2.0:1783444386.086606:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:2.0:1783444386.086611:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575307904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444386.086659:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575307904:12345-0@lo:400:kworker.0 Request processed in 48us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.086665:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:2.0:1783444386.086693:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575308032:0@lo:400:kworker.0 00000100:00100000:2.0:1783444386.086715:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575307904:0@lo:400:kworker.0 00000100:00080000:2.0:1783444386.086745:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444386.086750:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444386.086752:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444386.090667:0:86011:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783444386.090677:0:86011:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783444386.090682:0:86011:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444386.090691:0:86011:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3373 00000100:00080000:1.0:1783444386.090696:0:86011:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783444386.090704:0:86011:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444386.090765:0:86011:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7c8d500 x1870073575308160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444386.091207:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575307392:0@lo:400:kworker.0 00000100:00080000:0.0:1783444386.094964:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1783444386.094978:0:3632:0:(import.c:1673:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:0.0:1783444386.098721:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575307136:0@lo:250:kworker.0 00000100:00080000:0.0:1783444386.098764:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444386.098770:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444386.098773:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575307264:0@lo:38:kworker.0 00000100:00100000:0.0:1783444386.098868:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575307520:0@lo:38:kworker.0 00000100:00100000:0.0:1783444386.098928:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444386.098959:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575307776:0@lo:38:kworker.0 00000100:00100000:0.0:1783444386.098987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444386.099016:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575307776 00000100:00100000:0.0:1783444386.099022:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575307776 00000100:00100000:0.0:1783444386.099054:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:0.0:1783444386.099077:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575307776:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444386.099100:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444386.099134:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575307776:12345-0@lo:38:kworker.0 Request processed in 57us (145us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444386.099149:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00080000:0.0:1783444386.099181:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444386.099186:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444386.099189:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575307776:0@lo:38:kworker.0 00000100:00100000:0.0:1783444386.099197:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575308160:0@lo:38:kworker.0 00000100:00100000:0.0:1783444386.099220:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444386.099242:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575307520 00000100:00100000:0.0:1783444386.099246:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575307520 00000100:00100000:0.0:1783444386.099263:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575308160 00000100:00100000:0.0:1783444386.099266:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575308160 00000100:00100000:0.0:1783444386.099279:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1783444386.099284:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575307520:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444386.099295:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444386.099318:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575307520:12345-0@lo:38:kworker.0 Request processed in 33us (391us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444386.099325:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1783444386.099334:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1783444386.099339:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575308160:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444386.099348:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1783444386.099360:0:90998:0:(import.c:1597:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.204.120@tcp to MGS@0@lo 00000100:00100000:1.0:1783444386.099365:0:90998:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783444386.099370:0:90998:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:0.0:1783444386.099373:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575308160:12345-0@lo:38:kworker.0 Request processed in 31us (151us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444386.099380:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00080000:1.0:1783444386.099384:0:90998:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1783444386.099391:0:90998:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1783444386.099393:0:90998:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783444386.099408:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444386.099412:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444386.099418:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575308160:0@lo:38:kworker.0 00000100:00080000:1.0:1783444386.099424:0:90998:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1783444386.099433:0:90998:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) MGC192.168.204.120@tcp: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1783444386.099455:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444386.099460:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444386.099463:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575307520:0@lo:38:kworker.0 00000100:00080000:2.0:1783444386.099824:0:90989:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1783444386.099837:0:90989:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783444386.099869:0:90989:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783444386.099875:0:90989:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783444386.099991:0:90989:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783444386.100038:0:90989:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783444386.100042:0:90989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783444386.100044:0:90989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444386.100045:0:90989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444386.100046:0:90989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444386.100047:0:90989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444386.100048:0:90989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444386.100050:0:90989:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444386.100051:0:90989:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444386.100053:0:90989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444386.100054:0:90989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783444386.100057:0:90989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783444386.100059:0:90989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783444386.100060:0:90989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444386.100061:0:90989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444386.100062:0:90989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444386.100063:0:90989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444386.100063:0:90989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444386.100064:0:90989:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444386.100065:0:90989:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444386.100066:0:90989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444386.100067:0:90989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783444386.100089:0:90989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783444386.100104:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575308288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783444386.100146:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.100178:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0f90b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444386.101945:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575308288 00000100:00100000:0.0:1783444386.101956:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575308288 00000100:00100000:0.0:1783444386.102018:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783444386.102027:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+5:90989:x1870073575308288:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783444386.102633:0:90997:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783444386.102636:0:90997:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783444386.102639:0:90997:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783444386.103428:0:90999:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783444386.103546:0:90997:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 115 20000000:01000000:3.0:1783444386.109886:0:91000:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783444386.109897:0:91000:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1783444386.109900:0:91000:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783444386.109903:0:91000:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783444386.110232:0:91000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783444386.110493:0:86011:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.120@tcp 10000000:01000000:1.0:1783444386.110518:0:86011:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783444386.110522:0:86011:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783444386.110524:0:86011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783444386.110525:0:86011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444386.110526:0:86011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444386.110527:0:86011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444386.110529:0:86011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444386.110530:0:86011:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783444386.110532:0:86011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444386.110538:0:86011:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783444386.110581:0:86011:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783444386.110589:0:86011:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783444386.110591:0:86011:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783444386.110593:0:86011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783444386.110594:0:86011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444386.110595:0:86011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444386.110597:0:86011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444386.110598:0:86011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444386.110599:0:86011:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783444386.110600:0:86011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444386.110601:0:86011:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783444386.110628:0:86011:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783444386.110633:0:86011:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1783444386.110634:0:86011:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783444386.110635:0:86011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783444386.110636:0:86011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444386.110637:0:86011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444386.110638:0:86011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444386.110640:0:86011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444386.110641:0:86011:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783444386.110642:0:86011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444386.110643:0:86011:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783444386.110655:0:86011:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1783444386.110765:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444386.110783:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575308416:0@lo:253:kworker.0 00000100:00100000:2.0:1783444386.110892:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.110940:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575308544:0@lo:253:kworker.0 00000100:00100000:2.0:1783444386.110964:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.110979:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444386.110985:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575308672:0@lo:253:kworker.0 00000100:00100000:2.0:1783444386.111007:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.111272:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575308416 00000100:00100000:2.0:1783444386.111281:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575308416 00000100:00100000:2.0:1783444386.111315:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575308544 00000100:00100000:2.0:1783444386.111317:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575308544 00000100:00100000:2.0:1783444386.111325:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575308672 00000100:00100000:2.0:1783444386.111328:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575308672 00000100:00100000:2.0:1783444386.111341:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783444386.111350:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3633:x1870073575308416:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783444386.111379:0:90995:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783444386.112780:0:90997:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783444386.113396:0:90997:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783444386.115851:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:90989:x1870073575308288:12345-0@lo:253:mount.lustre.0 Request processed in 13814us (15693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.115867:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783444386.115914:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783444386.115928:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3635:x1870073575308544:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1783444386.115958:0:90997:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783444386.115971:0:90997:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783444386.125265:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575308288:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783444386.125287:0:90989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783444386.125291:0:90989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783444386.125292:0:90989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444386.125293:0:90989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444386.125295:0:90989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444386.125296:0:90989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444386.125297:0:90989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444386.125298:0:90989:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444386.125300:0:90989:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444386.125301:0:90989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444386.125303:0:90989:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783444386.125328:0:90989:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9368cb785000 from lustre-MDT0000 10000000:01000000:3.0:1783444386.125363:0:90989:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783444386.125366:0:90989:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783444386.125375:0:90989:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9368cb785000 10000000:01000000:3.0:1783444386.125379:0:90989:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783444386.125385:0:90989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9368cb785000 10000000:01000000:3.0:1783444386.125388:0:90989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783444386.125391:0:90989:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368cb785000 from 1 10000000:01000000:3.0:1783444386.125394:0:90989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783444386.125432:0:90989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.125444:0:90989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.125455:0:90989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444386.125476:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575308800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783444386.125544:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.125599:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0f90b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444386.125941:0:90996:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1783444386.125951:0:90996:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:1.0:1783444386.127292:0:90997:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783444386.127309:0:90997:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783444386.127568:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3635:x1870073575308544:12345-0@lo:253:kworker.0 Request processed in 11644us (16600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.127594:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783444386.127638:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575308800 00000100:00100000:1.0:1783444386.127646:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575308800 00000100:00100000:1.0:1783444386.127677:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783444386.127685:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3635:x1870073575308672:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783444386.127713:0:90997:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783444386.127728:0:90997:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783444386.127925:0:90999:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444386.127929:0:90999:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444386.127949:0:90999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.127965:0:90999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444386.127975:0:90999:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000045657s 00010000:00010000:0.0:1783444386.127993:0:90999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.128000:0:90999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783444386.128005:0:3635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00010000:00010000:0.0:1783444386.128008:0:90999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783444386.128009:0:3635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783444386.128012:0:3635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444386.128015:0:3635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444386.128017:0:3635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444386.128020:0:3635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444386.128022:0:3635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:0.0:1783444386.128022:0:90999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783444386.128026:0:3635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444386.128028:0:3635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783444386.128035:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575308544:0@lo:253:kworker.0 00010000:00010000:0.0:1783444386.128035:0:90999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444386.128043:0:90999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.128052:0:90999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.128066:0:90999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.128075:0:90999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.128081:0:90999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4750000/0x42cb6883e3832681 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444386.128403:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783444386.128415:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+7:90989:x1870073575308800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444386.128425:0:91001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444386.128438:0:91001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5756e00/0x42cb6883e3832688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383267a expref: -99 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.128453:0:91001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5756e00/0x42cb6883e3832688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383267a expref: 8 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.128462:0:91001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5756e00/0x42cb6883e3832688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383267a expref: 8 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.128468:0:91001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756e00, rc 0) 00000100:00100000:1.0:1783444386.128517:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:90989:x1870073575308800:12345-0@lo:101:mount.lustre.0 Request processed in 103us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.128523:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783444386.128726:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575308800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444386.128744:0:90989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444386.128755:0:90989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444386.128772:0:90989:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783444386.128811:0:90989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444386.128842:0:90989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444386.128850:0:90989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783444386.128854:0:90989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783444386.128860:0:90989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9368cb785000 10000000:01000000:2.0:1783444386.128862:0:90989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783444386.128866:0:90989:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783444386.128869:0:90989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783444386.128893:0:90989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444386.128900:0:90989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444386.128907:0:90989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444386.128925:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575308928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783444386.128959:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.128996:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d08bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.129228:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575308928 00000100:00100000:1.0:1783444386.129235:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575308928 00000100:00100000:1.0:1783444386.129273:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783444386.129280:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:90989:x1870073575308928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444386.129289:0:90996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444386.129298:0:90996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5757200/0x42cb6883e3832696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383268f expref: -99 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.129313:0:90996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5757200/0x42cb6883e3832696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383268f expref: 9 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.129322:0:90996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5757200/0x42cb6883e3832696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383268f expref: 9 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.129341:0:90996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757200, rc 0) 00000100:00100000:1.0:1783444386.129372:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:90989:x1870073575308928:12345-0@lo:101:mount.lustre.0 Request processed in 92us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.129378:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783444386.129554:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575308928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444386.129566:0:90989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444386.129575:0:90989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444386.129659:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575309056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444386.129687:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.129715:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d08bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1783444386.129730:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575309056 00000100:00100000:2.0:1783444386.129733:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575309056 00000100:00100000:2.0:1783444386.129754:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783444386.129760:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:90989:x1870073575309056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444386.129910:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575309056:12345-0@lo:501:mount.lustre.0 Request processed in 149us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.129917:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783444386.130057:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575309056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444386.130091:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575309184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444386.130133:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.130157:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0f90d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.130359:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575309184 00000100:00100000:1.0:1783444386.130364:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575309184 00000100:00100000:1.0:1783444386.130382:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783444386.130387:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575309184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444386.131029:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575309184:12345-0@lo:503:mount.lustre.0 Request processed in 639us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.131037:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783444386.131114:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575309184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444386.133924:0:91002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91002:1870073575309312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.134012:0:91002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.134053:0:91002:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0f90b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.134117:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575309312 00000100:00100000:1.0:1783444386.134124:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575309312 00000100:00100000:1.0:1783444386.134165:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783444386.134173:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:91002:x1870073575309312:12345-0@lo:502:llog_process_th.0 20000000:01000000:1.0:1783444386.137044:0:90997:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783444386.137063:0:90997:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783444386.137154:0:90999:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444386.137161:0:90999:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444386.137186:0:90999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137222:0:90999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444386.137234:0:90999:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000074141s 00010000:00010000:0.0:1783444386.137240:0:90999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137248:0:90999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137256:0:90999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137264:0:90999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137271:0:90999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444386.137277:0:90999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137286:0:90999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137301:0:90999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137310:0:90999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.137318:0:90999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751e00/0x42cb6883e383269d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444386.137327:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:91002:x1870073575309312:12345-0@lo:502:llog_process_th.0 Request processed in 3148us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.137340:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783444386.137522:0:91002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91002:1870073575309312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444386.137560:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444386.137570:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.137572:0:91002:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783444386.137580:0:91002:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783444386.137582:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783444386.137597:0:91002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9368dd0ecd40) 00000020:00000080:1.0:1783444386.137630:0:91002:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1783444386.137636:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783444386.137732:0:91002:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783444386.137742:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38326ab 00000020:00000080:1.0:1783444386.137991:0:91002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783444386.137996:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444386.137999:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.138001:0:91002:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783444386.138004:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444386.138007:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.138009:0:91002:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783444386.138012:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783444386.138020:0:91002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9368dd0e8000) 00000020:00000080:1.0:1783444386.138033:0:91002:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1783444386.138038:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783444386.138040:0:91002:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783444386.138043:0:91002:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783444386.138049:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783444386.138098:0:91002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368cb785000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783444386.138109:0:91002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9368dd0eb380) 00000020:00000080:1.0:1783444386.138117:0:91002:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1783444386.138168:0:91002:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783444386.138172:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38326c0 00000100:00100000:0.0:1783444386.138824:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:3635:x1870073575308672:12345-0@lo:253:kworker.0 Request processed in 11134us (27811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.138846:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:3.0:1783444386.140523:0:90995:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000080:1.0:1783444386.141508:0:91002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783444386.141524:0:91002:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783444386.141534:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42cb6883e38326c7 00080000:01000000:1.0:1783444386.141543:0:91002:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783444386.141548:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38326ce 00000020:01000004:2.0:1783444386.143171:0:3635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783444386.143176:0:3635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783444386.143177:0:3635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444386.143178:0:3635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444386.143179:0:3635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444386.143182:0:3635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444386.143184:0:3635:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444386.143185:0:3635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444386.143186:0:3635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783444386.143192:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575308672:0@lo:253:kworker.0 20000000:01000000:3.0:1783444386.156033:0:90995:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783444386.156062:0:90995:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783444386.156421:0:90999:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444386.156427:0:90999:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444386.156450:0:90999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156469:0:90999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444386.156479:0:90999:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000074141s 00010000:00010000:0.0:1783444386.156486:0:90999:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156493:0:90999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156501:0:90999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156509:0:90999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156516:0:90999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444386.156521:0:90999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156531:0:90999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156557:0:90999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156566:0:90999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.156574:0:90999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751e00/0x42cb6883e38326d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444386.157470:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3633:x1870073575308416:12345-0@lo:253:kworker.0 Request processed in 46113us (46571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.157484:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:3.0:1783444386.157502:0:3633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783444386.157505:0:3633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783444386.157507:0:3633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444386.157508:0:3633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444386.157509:0:3633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444386.157511:0:3633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444386.157512:0:3633:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783444386.157514:0:3633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444386.157516:0:3633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783444386.157520:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575308416:0@lo:253:kworker.0 00010000:00010000:3.0:1783444386.285146:0:91002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1783444386.285997:0:91002:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 778015c5-4969-44f5-82a5-0f6eadd152d5 idx: 0 lr: 107374182411 srv lr: 111669149696 lx: 0 gen 23 00000001:00080000:3.0:1783444386.286048:0:91002:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149696 lx: 0 gen 22 00000001:00000004:3.0:1783444386.286071:0:91002:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149696 00000001:00080000:3.0:1783444386.286181:0:91002:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1783444386.287018:0:91002:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9367c3ac9000: xid 1870073557783808, transno 111669149703, client gen 23, slot idx 0 00000001:00080000:3.0:1783444386.287038:0:91002:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9367c3ac9a80: xid 1870073557783552, transno 111669149702, client gen 23, slot idx 1 00000020:00000080:3.0:1783444386.287776:0:91002:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9367c1e83380) 00000020:00000080:3.0:1783444386.288655:0:91002:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1783444386.288754:0:91002:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783444386.288762:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38326f1 00000020:00000080:1.0:1783444386.295674:0:91002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783444386.302503:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42cb6883e38326f8 00000020:00000080:0.0:1783444386.303096:0:91002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783444386.303108:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444386.303115:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444386.303118:0:91002:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783444386.303122:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783444386.303124:0:91002:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783444386.303126:0:91002:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444386.303127:0:91002:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444386.303129:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783444386.303132:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444386.303134:0:91002:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783444386.303137:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444386.303142:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444386.303143:0:91002:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783444386.303148:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783444386.303194:0:91002:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783444386.303210:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444386.303214:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444386.303216:0:91002:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783444386.303219:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444386.303222:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444386.303230:0:91002:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783444386.303235:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783444386.303241:0:91002:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:0.0:1783444386.303265:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783444386.303279:0:91002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9368e7123380) 00000020:00000080:0.0:1783444386.303296:0:91002:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783444386.303300:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783444386.303370:0:91002:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783444386.303376:0:91002:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783444386.303381:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832706 00010000:00080000:0.0:1783444386.303412:0:91002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ef12f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1783444386.306644:0:91002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1783444386.308291:0:91002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444386.308309:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783444386.308353:0:91002:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783444386.308383:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e383270d 00000100:00080000:3.0:1783444386.308396:0:91002:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783444386.308402:0:91002:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9368ef12f800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444386.308442:0:91002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e68e5500 x1870073575309440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444386.308550:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575309440:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783444386.308569:0:91002:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783444386.308646:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1783444386.308665:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444386.308671:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444386.308674:0:91002:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783444386.308679:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783444386.308683:0:91002:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783444386.308685:0:91002:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783444386.308688:0:91002:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783444386.308689:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783444386.308693:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444386.308694:0:91002:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783444386.308698:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783444386.308703:0:91002:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783444386.308707:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444386.308709:0:91002:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783444386.308713:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783444386.308718:0:91002:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000100:00100000:0.0:1783444386.308719:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575309440 00000100:00100000:0.0:1783444386.308728:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575309440 00000020:01000000:3.0:1783444386.308741:0:91002:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783444386.308746:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1783444386.308761:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:0.0:1783444386.308770:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575309440:12345-0@lo:38:llog_process_th.0 00000020:00000080:3.0:1783444386.308777:0:91002:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9367c2c63380) 00010000:00080000:0.0:1783444386.308816:0:8431:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3377 last 0 00000020:00000080:3.0:1783444386.308983:0:91002:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783444386.308992:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:00000080:0.0:1783444386.308993:0:8431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e383271b 00000004:00100000:0.0:1783444386.309011:0:8431:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00080000:3.0:1783444386.309071:0:91002:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783444386.309078:0:91002:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783444386.309084:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832722 00010000:00080000:3.0:1783444386.309114:0:91002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9367c5623000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1783444386.309333:0:91002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:0.0:1783444386.309434:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9368dd1ef800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444386.309499:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575309440:12345-0@lo:38:llog_process_th.0 Request processed in 727us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.309507:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:0.0:1783444386.309547:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783444386.309555:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1783444386.309564:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783444386.309568:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000040:01000000:1.0:1783444386.312352:0:91002:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783444386.312392:0:91002:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783444386.312974:0:91002:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1783444386.313767:0:91002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783444386.313891:0:91002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000100:00080000:0.0:1783444386.317936:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef12f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783444386.317974:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575309440:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1783444386.317997:0:91002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000100:00100000:0.0:1783444386.318742:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000040:00080000:3.0:1783444386.319016:0:91008:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:3.0:1783444386.319022:0:91008:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783444386.319200:0:91008:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:3.0:1783444386.319221:0:91008:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1783444386.319367:0:91008:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1783444386.319370:0:91008:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783444386.320366:0:91002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444386.320381:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783444386.320422:0:91002:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783444386.320447:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832729 00000100:00080000:1.0:1783444386.320459:0:91002:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783444386.320466:0:91002:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9367c5623000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444386.320502:0:91002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7c8df80 x1870073575309696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444386.320587:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575309696:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783444386.320683:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.320775:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575309696 00000100:00100000:3.0:1783444386.320784:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575309696 00000100:00100000:3.0:1783444386.320853:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5884 00000100:00100000:3.0:1783444386.320861:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3632:x1870073575309696:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783444386.320887:0:26202:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3377 last 0 00000020:00000080:3.0:1783444386.320913:0:26202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832730 00002000:00100000:3.0:1783444386.320926:0:26202:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9367c5621800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783444386.320931:0:26202:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783444386.320934:0:26202:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783444386.321019:0:26202:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783444386.321048:0:26202:0:(import.c:65:import_set_state_nolock()) ffff9367c5621000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1783444386.321136:0:91002:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783444386.321225:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444386.321230:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.321233:0:91002:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783444386.321237:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783444386.321240:0:91002:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1783444386.321242:0:91002:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783444386.321244:0:91002:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783444386.321245:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783444386.321248:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.321249:0:91002:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783444386.321252:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783444386.321256:0:91002:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783444386.321259:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.321260:0:91002:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783444386.321263:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783444386.321267:0:91002:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:1.0:1783444386.321289:0:91002:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783444386.321292:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783444386.321305:0:91002:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9368dd0e99c0) 00000020:00000080:1.0:1783444386.321321:0:91002:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783444386.321326:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783444386.321415:0:91002:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783444386.321422:0:91002:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783444386.321429:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e383273e 00010000:00080000:1.0:1783444386.321458:0:91002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ff68c800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1783444386.321670:0:91002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1783444386.321735:0:91002:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783444386.321750:0:91002:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1783444386.322524:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575309568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444386.322588:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.322782:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575309568 00000100:00100000:1.0:1783444386.322813:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575309568 00000100:00100000:1.0:1783444386.322863:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:1.0:1783444386.322870:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575309568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444386.322904:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444386.322949:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575309568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.322956:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1783444386.323103:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575309568:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1783444386.323215:0:91002:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000100:00100000:3.0:1783444386.324146:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575309696:12345-0@lo:8:llog_process_th.0 Request processed in 3282us (3460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.324156:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5884 00000040:00080000:1.0:1783444386.324385:0:91002:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783444386.324416:0:91002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:1.0:1783444386.324537:0:91002:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:0.0:1783444386.325373:0:91010:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:0.0:1783444386.325378:0:91010:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783444386.325507:0:91010:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:0.0:1783444386.325520:0:91010:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1783444386.325650:0:91010:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:0.0:1783444386.325654:0:91010:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783444386.326710:0:91002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444386.326725:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783444386.326766:0:91002:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783444386.326903:0:91002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832745 00000100:00080000:1.0:1783444386.326917:0:91002:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783444386.326924:0:91002:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9368ff68c800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444386.326963:0:91002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e7c8d180 x1870073575309824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444386.326981:0:91002:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783444386.327064:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444386.327069:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.327078:0:91002:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783444386.327082:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444386.327087:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.327088:0:91002:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783444386.327091:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783444386.327093:0:91002:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783444386.327095:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444386.327097:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.327099:0:91002:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783444386.327101:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444386.327104:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.327105:0:91002:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783444386.327108:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783444386.327140:0:91002:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91002:1870073575309952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444386.327215:0:91002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.327342:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575309952 00000100:00100000:3.0:1783444386.327349:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575309952 00000100:00100000:3.0:1783444386.327394:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783444386.327403:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:91002:x1870073575309952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.327530:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:91002:x1870073575309952:12345-0@lo:502:llog_process_th.0 Request processed in 126us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.327538:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783444386.327751:0:91002:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.327776:0:91002:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91002:1870073575309952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444386.327943:0:91002:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444386.327948:0:91002:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444386.327950:0:91002:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783444386.327953:0:91002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1783444386.328017:0:90989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783444386.328042:0:90989:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783444386.328064:0:90989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.328076:0:90989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444386.328084:0:90989:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368cb785000 from 1 10000000:01000000:1.0:1783444386.328086:0:90989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783444386.328121:0:90989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.328129:0:90989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.328139:0:90989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444386.328153:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444386.328184:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.328206:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.328225:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575310080 00000100:00100000:1.0:1783444386.328230:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575310080 00000100:00100000:2.0:1783444386.328456:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783444386.328465:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783444386.328473:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783444386.328477:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783444386.328481:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c5623000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783444386.328584:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783444386.328594:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:90989:x1870073575310080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444386.328605:0:90997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444386.328629:0:90997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383274c expref: -99 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.328651:0:90997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383274c expref: 9 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.328662:0:90997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383274c expref: 9 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.328670:0:90997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756a00, rc 0) 00000100:00100000:1.0:1783444386.328704:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:90989:x1870073575310080:12345-0@lo:101:mount.lustre.0 Request processed in 112us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.328711:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783444386.328762:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444386.328774:0:90989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.328784:0:90989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444386.329560:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310208:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783444386.329666:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.329699:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.329722:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575310208 00000100:00100000:1.0:1783444386.329726:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575310208 00000100:00100000:1.0:1783444386.329758:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783444386.329764:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:90989:x1870073575310208:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783444386.329781:0:91001:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 00000004:00080000:2.0:1783444386.329899:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783444386.329907:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575309696:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783444386.329932:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575309824:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783444386.329967:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.330043:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575310336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444386.330069:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444386.330101:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575310336 00000100:00100000:2.0:1783444386.330105:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575310336 00000100:00100000:2.0:1783444386.330144:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:2.0:1783444386.330149:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575310336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444386.330170:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444386.330212:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575310336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.330218:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00080000:2.0:1783444386.330250:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444386.330281:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575310336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444386.330319:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575309824 00000100:00100000:2.0:1783444386.330323:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575309824 00000100:00100000:2.0:1783444386.330342:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5885 00000100:00100000:2.0:1783444386.330346:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3632:x1870073575309824:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1783444386.330377:0:26199:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3377 last 0 00000020:00000080:2.0:1783444386.330401:0:26199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e383275a 00002000:00100000:2.0:1783444386.330413:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9368c6bc8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783444386.330417:0:26199:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783444386.330420:0:26199:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783444386.330499:0:26199:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783444386.330525:0:26199:0:(import.c:65:import_set_state_nolock()) ffff9368c6bce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444386.330564:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575309824:12345-0@lo:8:llog_process_th.0 Request processed in 215us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.330570:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5885 00000100:00100000:2.0:1783444386.330611:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783444386.330629:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783444386.330638:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783444386.330643:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783444386.330646:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ff68c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783444386.330655:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783444386.330659:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575309824:0@lo:8:llog_process_th.0 20000000:01000000:1.0:1783444386.331035:0:91001:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783444386.331041:0:91001:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783444386.331045:0:91001:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783444386.331047:0:91001:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 118 00000100:00100000:1.0:1783444386.331130:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:90989:x1870073575310208:12345-0@lo:256:mount.lustre.0 Request processed in 1364us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.331137:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783444386.331182:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310208:0@lo:256:mount.lustre.0 00000004:00080000:0.0:1783444386.331905:0:91010:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783444386.331979:0:91010:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3377374189500ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783444386.331987:0:91010:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783444386.332065:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575310464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444386.332108:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444386.332983:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575310464 00000100:00100000:0.0:1783444386.332993:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575310464 00000100:00100000:0.0:1783444386.333046:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:0.0:1783444386.333054:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575310464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444386.333081:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444386.333129:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575310464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.333135:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00080000:0.0:1783444386.333165:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444386.333201:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575310464:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1783444386.336384:0:90989:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783444386.336423:0:90989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.336438:0:90989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444386.336461:0:90989:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368cb785000 from 1 10000000:01000000:1.0:1783444386.336464:0:90989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783444386.336509:0:90989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.336518:0:90989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.336529:0:90989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444386.336556:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310592:0@lo:101:mount.lustre.0 00000004:00080000:2.0:1783444386.336785:0:90990:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783444386.337027:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.337074:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444386.337432:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575310592 00000100:00100000:0.0:1783444386.337441:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575310592 00000100:00100000:0.0:1783444386.337499:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783444386.337510:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:90989:x1870073575310592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444386.337526:0:90997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444386.337541:0:90997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751e00/0x42cb6883e3832768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832761 expref: -99 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.337566:0:90997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751e00/0x42cb6883e3832768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832761 expref: 10 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.337590:0:90997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751e00/0x42cb6883e3832768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832761 expref: 10 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.337600:0:90997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751e00, rc 0) 00000100:00100000:0.0:1783444386.337649:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575310592:12345-0@lo:101:mount.lustre.0 Request processed in 141us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.337657:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783444386.338050:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444386.338067:0:90989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.338076:0:90989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444386.338144:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444386.338176:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.338250:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000004:00080000:3.0:1783444386.338350:0:91008:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783444386.338439:0:91008:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3377380649035ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783444386.338445:0:91008:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1783444386.339722:0:90990:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783444386.340053:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575310720 00000100:00100000:2.0:1783444386.340063:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575310720 00000100:00100000:2.0:1783444386.340147:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783444386.340157:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575310720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444386.340352:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575310720:12345-0@lo:501:mount.lustre.0 Request processed in 196us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444386.340360:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783444386.340435:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444386.340482:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444386.340532:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.340744:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.340975:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575310848 00000100:00100000:1.0:1783444386.340980:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575310848 00000100:00100000:1.0:1783444386.341017:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783444386.341031:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575310848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444386.341112:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575310848:12345-0@lo:503:mount.lustre.0 Request processed in 81us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.341118:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783444386.341195:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575310848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444386.341538:0:91012:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91012:1870073575310976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.341585:0:91012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.341610:0:91012:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9480 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.341661:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575310976 00000100:00100000:1.0:1783444386.341666:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575310976 00000100:00100000:1.0:1783444386.341698:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783444386.341705:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:91012:x1870073575310976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444386.342303:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:91012:x1870073575310976:12345-0@lo:502:llog_process_th.0 Request processed in 594us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.342311:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783444386.342432:0:91012:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91012:1870073575310976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444386.342460:0:91012:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444386.342470:0:91012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444386.342473:0:91012:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783444386.342480:0:91012:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9368cb785000 00000020:00000080:3.0:1783444386.342483:0:91012:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783444386.342491:0:91012:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444386.342493:0:91012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444386.342501:0:91012:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783444386.342504:0:91012:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444386.342507:0:91012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444386.342509:0:91012:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783444386.342512:0:91012:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9368cb785000 00000020:00000080:3.0:1783444386.342514:0:91012:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783444386.342604:0:91012:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91012:1870073575311104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.342651:0:91012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.342678:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575311104 00000100:00100000:3.0:1783444386.342682:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575311104 00000100:00100000:3.0:1783444386.342708:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783444386.342714:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:91012:x1870073575311104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.342838:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:91012:x1870073575311104:12345-0@lo:502:llog_process_th.0 Request processed in 123us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.342845:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783444386.342882:0:91012:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9480 going to sleep for 11 seconds 00000100:00100000:3.0:1783444386.342895:0:91012:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91012:1870073575311104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444386.342912:0:91012:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444386.342917:0:91012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444386.342918:0:91012:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783444386.342921:0:91012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783444386.343739:0:90989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1783444386.343765:0:90989:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783444386.343814:0:90989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.343835:0:90989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444386.343888:0:90989:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783444386.343891:0:90989:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9368cb785000 10000000:01000000:1.0:1783444386.343894:0:90989:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9368cb785000 10000000:01000000:1.0:1783444386.343897:0:90989:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783444386.343903:0:90989:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368cb785000 from 1 10000000:01000000:1.0:1783444386.343906:0:90989:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783444386.343933:0:90989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.343942:0:90989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.343960:0:90989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444386.343978:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575311232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444386.344018:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.344044:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444386.347543:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575311232 00000100:00100000:3.0:1783444386.347559:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575311232 00000100:00100000:3.0:1783444386.347643:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783444386.347653:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:90989:x1870073575311232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444386.347670:0:90995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444386.347692:0:90995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1b800/0x42cb6883e3832776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383276f expref: -99 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.347735:0:90995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1b800/0x42cb6883e3832776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383276f expref: 11 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.347746:0:90995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1b800/0x42cb6883e3832776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383276f expref: 11 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.347755:0:90995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1b800, rc 0) 00000100:00100000:3.0:1783444386.347864:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:90989:x1870073575311232:12345-0@lo:101:mount.lustre.0 Request processed in 212us (3844us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.347871:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783444386.348156:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575311232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444386.348174:0:90989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.348184:0:90989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444386.348503:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575311360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444386.348542:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.348684:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444386.351691:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575311360 00000100:00100000:0.0:1783444386.351707:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575311360 00000100:00100000:3.0:1783444386.356297:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783444386.356324:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:90989:x1870073575311360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444386.356526:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:90989:x1870073575311360:12345-0@lo:501:mount.lustre.0 Request processed in 215us (7982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.356533:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783444386.357296:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575311360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444386.357363:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575311488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444386.357424:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.357464:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3203900 going to sleep for 11 seconds 00000100:00100000:3.0:1783444386.357515:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575311488 00000100:00100000:3.0:1783444386.357522:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575311488 00000100:00100000:3.0:1783444386.357651:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783444386.357662:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:90989:x1870073575311488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444386.357761:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:90989:x1870073575311488:12345-0@lo:503:mount.lustre.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.357768:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783444386.361785:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575311488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783444386.362961:0:91015:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91015:1870073575311616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444386.363050:0:91015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444386.363086:0:91015:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.363167:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575311616 00000100:00100000:1.0:1783444386.363174:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575311616 00000100:00100000:1.0:1783444386.363225:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783444386.363235:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:91015:x1870073575311616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444386.363461:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:91015:x1870073575311616:12345-0@lo:502:llog_process_th.0 Request processed in 226us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444386.363469:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783444386.365267:0:91015:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91015:1870073575311616:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783444386.365346:0:91015:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783444386.365368:0:91015:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9368e7120000) 00000020:00000080:0.0:1783444386.365399:0:91015:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783444386.365703:0:91015:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368cb785000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783444386.365708:0:91015:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368cb785000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783444386.365710:0:91015:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368cb785000 4 00010000:00080000:0.0:1783444386.365736:0:91015:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368eb18b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1783444386.367558:0:91015:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1783444386.368404:0:91015:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783444386.368447:0:91015:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783444386.368457:0:91015:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42cb6883e3832784 00000100:00080000:0.0:1783444386.368467:0:91015:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783444386.368472:0:91015:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9368eb18b000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444386.368507:0:91015:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e68f4e00 x1870073575311744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444386.368538:0:91015:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783444386.368693:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575311744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783444386.368762:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.369156:0:91015:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91015:1870073575311872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.369196:0:91015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.369220:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575311872 00000100:00100000:3.0:1783444386.369226:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575311872 00000100:00100000:3.0:1783444386.369260:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783444386.369267:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:91015:x1870073575311872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.369372:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:91015:x1870073575311872:12345-0@lo:502:llog_process_th.0 Request processed in 105us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.369379:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783444386.369419:0:91015:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444386.369439:0:91015:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91015:1870073575311872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.369472:0:91015:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91015:1870073575312000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.369500:0:91015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.369518:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575312000 00000100:00100000:3.0:1783444386.369521:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575312000 00000100:00100000:3.0:1783444386.369547:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783444386.369552:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:91015:x1870073575312000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444386.369688:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:91015:x1870073575312000:12345-0@lo:502:llog_process_th.0 Request processed in 134us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.369694:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783444386.369716:0:91015:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444386.369726:0:91015:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:91015:1870073575312000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783444386.369740:0:91015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:2.0:1783444386.370093:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575311744 00000100:00100000:2.0:1783444386.370103:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575311744 00000100:00100000:2.0:1783444386.370158:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1783444386.370163:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575311744:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783444386.370217:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575311744:12345-0@lo:38:llog_process_th.0 Request processed in 53us (1454us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783444386.370223:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000020:01000000:1.0:1783444386.370317:0:90989:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783444386.370341:0:90989:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783444386.370356:0:90989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444386.370367:0:90989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783444386.370412:0:90989:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783444386.370414:0:90989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783444386.370415:0:90989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444386.370416:0:90989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444386.370418:0:90989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444386.370419:0:90989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444386.370420:0:90989:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783444386.370422:0:90989:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783444386.370424:0:90989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444386.370425:0:90989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783444386.370429:0:90989:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783444386.370431:0:90989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783444386.370432:0:90989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783444386.370433:0:90989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444386.370434:0:90989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444386.370435:0:90989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444386.370436:0:90989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444386.370437:0:90989:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783444386.370438:0:90989:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783444386.370439:0:90989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444386.370440:0:90989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783444386.370453:0:90989:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783444386.370464:0:90989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575312128:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783444386.370499:0:90989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.370518:0:90989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3203540 going to sleep for 11 seconds 00000100:00100000:1.0:1783444386.370570:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575312128 00000100:00100000:1.0:1783444386.370586:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575312128 00000100:00100000:1.0:1783444386.370622:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783444386.370628:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:90989:x1870073575312128:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783444386.370655:0:90997:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783444386.370669:0:90997:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783444386.371213:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783444386.371223:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb18b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444386.371229:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783444386.371241:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575311744:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1783444386.379986:0:90997:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783444386.380002:0:90997:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783444386.380121:0:90999:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444386.380128:0:90999:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444386.380155:0:90999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.380177:0:90999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383274c expref: 11 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.380186:0:90999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.380229:0:90999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e383274c expref: 11 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.380259:0:90999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e383274c expref: 11 pid: 90997 timeout: 3477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444386.380279:0:90999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90999:1870073575312256:0@lo:104: 00000100:00100000:0.0:1783444386.380353:0:90999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444386.380397:0:90999:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444386.380422:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575312256 00000100:00100000:0.0:1783444386.380429:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575312256 00000100:00100000:0.0:1783444386.380491:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1783444386.380500:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:90999:x1870073575312256:12345-0@lo:104: 00010000:00010000:0.0:1783444386.380513:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.380577:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783444386.380583:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:90999:x1870073575312256:12345-0@lo:104: Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.380590:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1783444386.380646:0:90999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90999:1870073575312256:0@lo:104: 00010000:00010000:0.0:1783444386.380665:0:90999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444386.381518:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:90989:x1870073575312128:12345-0@lo:253:mount.lustre.0 Request processed in 10886us (11014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.381530:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1783444386.382181:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444386.382190:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382200:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444386.382204:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382214:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444386.382220:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444386.382226:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783444386.382269:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382275:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444386.382295:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382302:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5757a00/0x42cb6883e383274c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832753 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382317:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444386.382319:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444386.382320:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444386.382337:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575312384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444386.382387:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444386.382440:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575312384 00000100:00100000:3.0:1783444386.382446:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575312384 00010000:00010000:3.0:1783444386.382466:0:19646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383274c expref: 11 pid: 90997 timeout: 3477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444386.382490:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:3.0:1783444386.382497:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:3636:x1870073575312384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444386.382509:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444386.382514:0:19646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383274c expref: 11 pid: 90997 timeout: 3477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382525:0:19646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e383274c expref: 11 pid: 90997 timeout: 3477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382538:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5756a00/0x42cb6883e3832753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e383274c expref: 11 pid: 90997 timeout: 3477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382552:0:19646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.382560:0:19646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444386.382963:0:90989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:90989:1870073575312128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783444386.382975:0:90989:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783444386.382978:0:90989:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783444386.382980:0:90989:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444386.382981:0:90989:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444386.382983:0:90989:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444386.382984:0:90989:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444386.382985:0:90989:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444386.382987:0:90989:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444386.382989:0:90989:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444386.382990:0:90989:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444386.382991:0:90989:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783444386.383005:0:90989:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1783444386.384090:0:19646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003963519s 00010000:00010000:3.0:1783444386.384102:0:19646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.384112:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.384133:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.384140:0:19646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.384146:0:19646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444386.384150:0:19646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.384158:0:19646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.384189:0:19646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444386.384201:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444386.384270:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+10:3636:x1870073575312384:12345-0@lo:103:ldlm_bl.0 Request processed in 1771us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444386.384279:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00010000:00010000:0.0:1783444386.384662:0:90999:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.384683:0:90999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444386.384689:0:90999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4750000/0x42cb6883e383278b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444386.385716:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575312384:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1783444386.394580:0:90989:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:3.0:1783444386.395370:0:90989:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1783444386.395594:0:91021:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783444386.395737:0:90989:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1783444386.396145:0:91022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91022:1870073575312512:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783444386.396222:0:91022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.396259:0:91022:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d240 going to sleep for 11 seconds 00000100:00100000:0.0:1783444386.396318:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575312512 00000100:00100000:0.0:1783444386.396325:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575312512 00000100:00100000:0.0:1783444386.396379:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:0.0:1783444386.396388:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91022:x1870073575312512:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444386.396459:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91022:x1870073575312512:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.396466:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:1.0:1783444386.396536:0:91022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91022:1870073575312512:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783444386.396562:0:91022:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783444386.396584:0:91022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91022:1870073575312640:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783444386.396619:0:91022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.396640:0:91022:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444386.396685:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575312640 00000100:00100000:0.0:1783444386.396689:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575312640 00000100:00100000:0.0:1783444386.396717:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1783444386.396723:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91022:x1870073575312640:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444386.396854:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91022:x1870073575312640:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 131us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.396861:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000040:01000000:3.0:1783444386.397321:0:90989:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783444386.397366:0:90989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783444386.397968:0:91022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91022:1870073575312640:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783444386.398042:0:91022:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91022:1870073575312768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783444386.398085:0:91022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444386.398105:0:91022:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c696d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444386.398523:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575312768 00000100:00100000:0.0:1783444386.398530:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575312768 00000100:00100000:0.0:1783444386.398570:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:0.0:1783444386.398590:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91022:x1870073575312768:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444386.398683:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91022:x1870073575312768:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444386.398707:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1783444386.398948:0:91022:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91022:1870073575312768:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783444386.398992:0:91022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783444386.399956:0:91021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783444386.400936:0:90989:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783444386.400953:0:90989:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783444386.401038:0:90989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1783444386.402942:0:91020:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:2.0:1783444386.402949:0:91020:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:00080000:3.0:1783444386.404268:0:90989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783444386.405587:0:91022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783444386.405669:0:91022:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1783444386.406568:0:91021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783444386.406648:0:91021:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783444386.406653:0:91021:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1783444386.407108:0:90989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783444386.407154:0:90989:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783444386.407281:0:90989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783444386.408223:0:90989:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00010000:00080000:3.0:1783444386.410451:0:90989:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149703 00010000:00080000:1.0:1783444386.411290:0:91023:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 91023 00010000:02000000:1.0:1783444386.411338:0:91023:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783444386.411341:0:91023:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783444386.411346:0:91023:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1783444386.411720:0:90989:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783444386.411737:0:90989:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783444386.411762:0:90989:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783444386.411780:0:90989:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783444386.413207:0:90989:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783444386.413469:0:90989:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783444386.782126:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783444387.167993:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783444387.168001:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368cb785000 from 119 10000000:01000000:2.0:1783444387.168005:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783444387.168055:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.168067:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.168097:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.168124:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575312896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.168193:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.168243:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88180 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.168511:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575312896 00000100:00100000:3.0:1783444387.168519:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575312896 00000100:00100000:3.0:1783444387.168582:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783444387.168593:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:6503:x1870073575312896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.168624:0:90996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444387.168638:0:90996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1b000/0x42cb6883e3832799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832792 expref: -99 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.168663:0:90996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1b000/0x42cb6883e3832799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832792 expref: 11 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.168679:0:90996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1b000/0x42cb6883e3832799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832792 expref: 11 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.168689:0:90996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1b000, rc 0) 00000100:00100000:3.0:1783444387.168749:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575312896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.168758:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783444387.168774:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575312896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444387.168811:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.168821:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444387.168871:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.169059:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444387.169086:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4deff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444387.169910:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575313024 00000100:00100000:1.0:1783444387.169917:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575313024 00000100:00100000:0.0:1783444387.169967:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783444387.169978:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575313024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783444387.169996:0:90997:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783444387.170013:0:90997:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783444387.170016:0:90997:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 119 00000100:00100000:0.0:1783444387.170148:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575313024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.170154:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783444387.171541:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783444387.171616:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783444387.171626:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.171642:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444387.171652:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444387.171655:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 52 10000000:01000000:3.0:1783444387.171658:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444387.171688:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.171697:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.171705:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444387.171724:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.171774:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.171837:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444387.172180:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575313152 00000100:00100000:0.0:1783444387.172186:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575313152 00000100:00100000:0.0:1783444387.172222:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783444387.172237:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575313152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444387.172250:0:91001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444387.172262:0:91001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4750e00/0x42cb6883e38327a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38327a0 expref: -99 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.172285:0:91001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4750e00/0x42cb6883e38327a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38327a0 expref: 12 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.172295:0:91001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4750e00/0x42cb6883e38327a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38327a0 expref: 12 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.172303:0:91001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750e00, rc 0) 00000100:00100000:0.0:1783444387.172342:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575313152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.172348:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783444387.174378:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.174404:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327a7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.174416:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38327a7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444387.174493:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.174546:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.174613:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.175111:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575313280 00000100:00100000:2.0:1783444387.175120:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575313280 00000100:00100000:2.0:1783444387.175167:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783444387.175181:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575313280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.175319:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575313280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.175327:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783444387.175383:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.175421:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.175468:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.175484:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab21180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444387.176228:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575313408 00000100:00100000:1.0:1783444387.176236:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575313408 00000100:00100000:1.0:1783444387.176273:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783444387.176282:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575313408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.176469:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575313408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.176476:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783444387.176537:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444387.178700:0:91047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783444387.178778:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783444387.179096:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444387.179108:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327a7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.179126:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327a7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444387.179134:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783444387.179136:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cd800 from 116 10000000:01000000:2.0:1783444387.179138:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783444387.179177:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.179184:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.179193:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.179218:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.179282:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.179318:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab21600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.179339:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575313536 00000100:00100000:2.0:1783444387.179344:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575313536 00000100:00100000:2.0:1783444387.179380:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783444387.179388:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575313536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.179405:0:90997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444387.179419:0:90997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4c10200/0x42cb6883e38327b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38327ae expref: -99 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.179440:0:90997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c10200/0x42cb6883e38327b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38327ae expref: 13 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.179457:0:90997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4c10200/0x42cb6883e38327b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38327ae expref: 13 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.179466:0:90997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10200, rc 0) 00000100:00100000:2.0:1783444387.179502:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575313536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.179507:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783444387.179560:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.179571:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327b5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.179578:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38327b5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.179642:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.179869:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.179888:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab21600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.179905:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575313664 00000100:00100000:2.0:1783444387.179909:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575313664 00000100:00100000:2.0:1783444387.179957:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783444387.179967:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575313664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783444387.179981:0:90996:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783444387.179998:0:90996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783444387.180002:0:90996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1783444387.180006:0:90996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1783444387.180009:0:90996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1783444387.180022:0:90996:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:2.0:1783444387.180114:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575313664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.180122:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783444387.180159:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783444387.180259:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783444387.180268:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327b5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.180277:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327b5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444387.180285:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783444387.180289:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1783444387.180292:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783444387.180311:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.180364:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.180374:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.180391:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.180418:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.180447:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab21600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.180660:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575313792 00000100:00100000:3.0:1783444387.180666:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575313792 00000100:00100000:3.0:1783444387.180704:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783444387.180715:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575313792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.180938:0:90997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444387.181036:0:90997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1a000/0x42cb6883e38327c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38327bc expref: -99 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.181060:0:90997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1a000/0x42cb6883e38327c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38327bc expref: 14 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.181071:0:90997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1a000/0x42cb6883e38327c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38327bc expref: 14 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.181080:0:90997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1a000, rc 0) 00000100:00100000:3.0:1783444387.182321:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575313792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1604us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.182331:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783444387.186731:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444387.186764:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327c3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.186777:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38327c3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444387.186914:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.186990:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444387.187033:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.188014:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575313920 00000100:00100000:3.0:1783444387.188024:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575313920 00000100:00100000:3.0:1783444387.188077:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783444387.188088:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575313920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.188267:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575313920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.188275:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783444387.189241:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575313920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.189487:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.190043:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.190220:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575314048 00000100:00100000:0.0:1783444387.190222:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.190227:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575314048 00000100:00100000:3.0:1783444387.190327:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783444387.190344:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575314048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.192289:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575314048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1942us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.192301:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783444387.192414:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444387.193158:0:91048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1783444387.193328:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1783444387.193348:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783444387.193358:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327c3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.193369:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327c3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444387.193380:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1783444387.193382:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ef0cd800 from 1 10000000:01000000:0.0:1783444387.193385:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783444387.193546:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.193554:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.193563:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444387.193587:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.193652:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444387.193691:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.193740:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575314176 00000100:00100000:3.0:1783444387.193746:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575314176 00000100:00100000:3.0:1783444387.193817:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783444387.193828:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575314176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.193841:0:90996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444387.193855:0:90996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1a600/0x42cb6883e38327d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38327ca expref: -99 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.193879:0:90996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1a600/0x42cb6883e38327d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38327ca expref: 15 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.193891:0:90996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1a600/0x42cb6883e38327d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38327ca expref: 15 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.193900:0:90996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1a600, rc 0) 00000100:00100000:3.0:1783444387.193943:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575314176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.193950:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783444387.194204:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444387.194219:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327d1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.194228:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38327d1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444387.194245:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783444387.194249:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327d1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.194256:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327d1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444387.194264:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783444387.194265:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef0cd800 from 7 10000000:01000000:1.0:1783444387.194268:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783444387.194298:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.194304:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.194311:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444387.194324:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.194354:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444387.194570:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444387.196777:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575314304 00000100:00100000:0.0:1783444387.196804:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575314304 00000100:00100000:0.0:1783444387.196898:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783444387.196919:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575314304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444387.196936:0:90997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444387.196951:0:90997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751a00/0x42cb6883e38327df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38327d8 expref: -99 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.196976:0:90997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751a00/0x42cb6883e38327df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38327d8 expref: 16 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.196987:0:90997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751a00/0x42cb6883e38327df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38327d8 expref: 16 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.196995:0:90997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751a00, rc 0) 00000100:00100000:0.0:1783444387.197063:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575314304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.197070:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783444387.197093:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.197110:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327df expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.197126:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38327df expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.197202:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.197237:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.197306:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab21600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.197339:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575314432 00000100:00100000:3.0:1783444387.197345:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575314432 00000100:00100000:3.0:1783444387.197412:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783444387.197419:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575314432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.197557:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575314432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.197573:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783444387.197638:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.197673:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.197709:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.197725:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab21600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.197738:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575314560 00000100:00100000:2.0:1783444387.197742:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575314560 00000100:00100000:2.0:1783444387.197763:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783444387.197769:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575314560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.197864:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575314560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.197870:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783444387.197910:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444387.198725:0:91050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783444387.198906:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783444387.198930:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783444387.198939:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327df expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.198951:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327df expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444387.198960:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444387.198962:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 52 10000000:01000000:3.0:1783444387.198965:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444387.198993:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.199001:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.199011:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444387.199028:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.199067:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.199120:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280900 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.199156:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575314688 00000100:00100000:2.0:1783444387.199161:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575314688 00000100:00100000:2.0:1783444387.199224:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783444387.199233:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575314688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.199243:0:90997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444387.199261:0:90997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4c10400/0x42cb6883e38327ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38327e6 expref: -99 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.199282:0:90997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c10400/0x42cb6883e38327ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38327e6 expref: 17 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.199292:0:90997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4c10400/0x42cb6883e38327ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38327e6 expref: 17 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.199300:0:90997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10400, rc 0) 00000100:00100000:2.0:1783444387.199335:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575314688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.199342:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783444387.199395:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.199407:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327ed expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.199416:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38327ed expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444387.199471:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.199497:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.199511:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280900 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.199525:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575314816 00000100:00100000:3.0:1783444387.199528:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575314816 00000100:00100000:3.0:1783444387.199551:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783444387.199557:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575314816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.199665:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e690f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575314816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.199673:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783444387.199705:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.199729:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.199763:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.199777:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280900 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.199805:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575314944 00000100:00100000:3.0:1783444387.199808:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575314944 00000100:00100000:3.0:1783444387.199831:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783444387.199837:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575314944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.199910:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e690c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575314944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.199917:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783444387.199953:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575314944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444387.200531:0:91051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1783444387.200943:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1783444387.200974:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783444387.200982:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327ed expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.200992:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327ed expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444387.201000:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783444387.201003:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1783444387.201005:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783444387.201030:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.201038:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.201047:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444387.201076:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.201117:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444387.201187:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177540 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.201223:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575315072 00000100:00100000:3.0:1783444387.201228:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575315072 00000100:00100000:3.0:1783444387.201299:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783444387.201308:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575315072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.201319:0:90996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444387.201332:0:90996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1b400/0x42cb6883e38327fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38327f4 expref: -99 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.201352:0:90996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1b400/0x42cb6883e38327fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38327f4 expref: 18 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.201362:0:90996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1b400/0x42cb6883e38327fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38327f4 expref: 18 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.201371:0:90996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1b400, rc 0) 00000100:00100000:3.0:1783444387.201414:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e690f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575315072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.201421:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783444387.201483:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.201495:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327fb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.201503:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38327fb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.201557:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.201585:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.201702:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444387.201732:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575315200 00000100:00100000:1.0:1783444387.201737:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575315200 00000100:00100000:1.0:1783444387.201823:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783444387.201830:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575315200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.201959:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e690fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575315200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444387.201966:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783444387.202039:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.202068:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.202104:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.202125:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.202142:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575315328 00000100:00100000:2.0:1783444387.202146:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575315328 00000100:00100000:2.0:1783444387.202166:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783444387.202171:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575315328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.203131:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e690d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575315328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 956us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.203140:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783444387.203208:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783444387.204025:0:91052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783444387.204562:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783444387.204594:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783444387.204619:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327fb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.204631:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38327fb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444387.204641:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783444387.204644:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368f9acf800 from 7 10000000:01000000:3.0:1783444387.204664:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783444387.204695:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.204703:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.204714:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444387.204734:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.204784:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.204925:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d43def00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444387.204961:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575315456 00000100:00100000:1.0:1783444387.205024:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575315456 00000100:00100000:1.0:1783444387.205104:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783444387.205115:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575315456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444387.205128:0:90996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444387.205140:0:90996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5756200/0x42cb6883e3832809 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832802 expref: -99 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.205163:0:90996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5756200/0x42cb6883e3832809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832802 expref: 19 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.205174:0:90996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5756200/0x42cb6883e3832809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832802 expref: 19 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.205182:0:90996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756200, rc 0) 00000100:00100000:1.0:1783444387.205236:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e690e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575315456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444387.205258:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783444387.205334:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.205351:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832809 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.205362:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832809 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.205416:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.205446:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.205523:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08540 going to sleep for 11 seconds 00000100:00100000:1.0:1783444387.205568:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575315584 00000100:00100000:1.0:1783444387.205573:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575315584 00000100:00100000:1.0:1783444387.205620:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783444387.205627:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575315584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.205735:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e690dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575315584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444387.205742:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783444387.206773:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.206838:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.206888:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.206915:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08540 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.206930:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575315712 00000100:00100000:3.0:1783444387.206936:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575315712 00000100:00100000:3.0:1783444387.206984:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783444387.206992:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575315712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.207087:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3f08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575315712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.207095:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783444387.207204:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444387.212264:0:91055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783444387.212634:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783444387.212658:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783444387.212676:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832809 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.212687:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832809 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444387.212695:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444387.212703:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 52 10000000:01000000:3.0:1783444387.212705:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444387.212743:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.212749:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.212760:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444387.212783:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.212923:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.212970:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575315840 00000100:00100000:2.0:1783444387.212970:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280900 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.212978:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575315840 00000100:00100000:3.0:1783444387.213029:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783444387.213040:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575315840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.213057:0:91001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444387.213071:0:91001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1a800/0x42cb6883e3832817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832810 expref: -99 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.213099:0:91001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1a800/0x42cb6883e3832817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832810 expref: 20 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.213111:0:91001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1a800/0x42cb6883e3832817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832810 expref: 20 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.213121:0:91001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1a800, rc 0) 00000100:00100000:3.0:1783444387.213240:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575315840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.213247:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783444387.213329:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444387.213348:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832817 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.213357:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832817 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444387.213882:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.213912:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444387.213969:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.214642:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575315968 00000100:00100000:3.0:1783444387.214649:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575315968 00000100:00100000:3.0:1783444387.214696:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783444387.214705:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575315968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.214871:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575315968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.214879:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783444387.214944:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575315968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.214993:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.215037:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.215069:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444387.215110:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575316096 00000100:00100000:0.0:1783444387.215114:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575316096 00000100:00100000:0.0:1783444387.215151:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783444387.215158:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575316096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.215260:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575316096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.215267:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783444387.215338:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444387.217158:0:91057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1783444387.217453:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1783444387.217552:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444387.217564:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832817 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.217577:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832817 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444387.217587:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783444387.217590:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783444387.217594:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783444387.217636:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.217644:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.217655:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444387.217679:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.217742:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444387.217818:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.218447:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575316224 00000100:00100000:2.0:1783444387.218455:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575316224 00000100:00100000:2.0:1783444387.218575:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783444387.218587:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575316224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.218611:0:90996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444387.218627:0:90996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4c11200/0x42cb6883e3832825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383281e expref: -99 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.218652:0:90996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c11200/0x42cb6883e3832825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383281e expref: 21 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.218662:0:90996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4c11200/0x42cb6883e3832825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383281e expref: 21 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.218671:0:90996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11200, rc 0) 00000100:00100000:2.0:1783444387.218820:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575316224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 236us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.218829:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783444387.218940:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444387.218959:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832825 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.219028:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832825 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444387.219163:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.219208:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444387.219396:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.219427:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575316352 00000100:00100000:2.0:1783444387.219431:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575316352 00000100:00100000:2.0:1783444387.219551:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783444387.219560:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575316352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.219753:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575316352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444387.219761:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783444387.219863:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.219897:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.219937:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444387.219994:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444387.220111:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575316480 00000100:00100000:2.0:1783444387.220116:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575316480 00000100:00100000:2.0:1783444387.220145:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783444387.220153:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575316480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.222685:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575316480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2523us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.222702:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783444387.222909:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444387.223757:0:91059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783444387.224247:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783444387.224275:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783444387.224287:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832825 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.224306:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832825 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444387.224316:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783444387.224319:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef29c800 from 7 10000000:01000000:0.0:1783444387.224321:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783444387.224362:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.224371:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.224381:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444387.224405:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.224465:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444387.224511:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def480 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.224637:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575316608 00000100:00100000:3.0:1783444387.224645:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575316608 00000100:00100000:3.0:1783444387.224705:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783444387.224715:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575316608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.224730:0:91001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444387.224749:0:91001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1a400/0x42cb6883e3832833 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383282c expref: -99 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.224776:0:91001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1a400/0x42cb6883e3832833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383282c expref: 22 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.224816:0:91001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1a400/0x42cb6883e3832833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383282c expref: 22 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.224826:0:91001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1a400, rc 0) 00000100:00100000:3.0:1783444387.224865:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575316608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.224872:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783444387.224953:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444387.224968:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832833 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.224977:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832833 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444387.225033:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.225062:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444387.225088:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444387.225147:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575316736 00000100:00100000:0.0:1783444387.225152:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575316736 00000100:00100000:0.0:1783444387.225245:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783444387.225253:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575316736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.225370:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575316736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.225378:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783444387.225446:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.225484:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444387.225525:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444387.225540:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.225676:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575316864 00000100:00100000:3.0:1783444387.225681:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575316864 00000100:00100000:3.0:1783444387.225759:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783444387.225768:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575316864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.225874:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575316864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.225883:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783444387.226032:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444387.226772:0:91060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444387.226938:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444387.226972:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444387.226982:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832833 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.226999:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832833 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444387.227008:0:6503:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1783444387.227010:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9368c507b380 from 1 10000000:01000000:0.0:1783444387.227013:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783444387.227045:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.227053:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444387.227062:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444387.227079:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444387.227130:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444387.227179:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.227232:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575316992 00000100:00100000:3.0:1783444387.227244:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575316992 00000100:00100000:3.0:1783444387.227344:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783444387.227353:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575316992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444387.227366:0:90995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444387.227380:0:90995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6b1a200/0x42cb6883e3832841 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383283a expref: -99 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.227402:0:90995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6b1a200/0x42cb6883e3832841 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383283a expref: 23 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.227412:0:90995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6b1a200/0x42cb6883e3832841 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383283a expref: 23 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444387.227421:0:90995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6b1a200, rc 0) 00000100:00100000:3.0:1783444387.227465:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575316992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.227473:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783444387.227567:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575316992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.227584:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832841 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.227610:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832841 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444387.227631:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783444387.227635:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832841 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.227642:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832841 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444387.227648:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783444387.227650:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:2.0:1783444387.227653:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783444387.227668:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.227676:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.227689:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.227701:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575317120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.227732:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.227759:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa080c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444387.227838:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575317120 00000100:00100000:1.0:1783444387.227843:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575317120 00000100:00100000:1.0:1783444387.227884:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783444387.227892:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575317120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444387.227899:0:90996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444387.227908:0:90996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5757400/0x42cb6883e383284f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832848 expref: -99 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.227921:0:90996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5757400/0x42cb6883e383284f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832848 expref: 24 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.227930:0:90996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5757400/0x42cb6883e383284f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832848 expref: 24 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444387.227936:0:90996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757400, rc 0) 00000100:00100000:1.0:1783444387.227971:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575317120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444387.227976:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783444387.228049:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575317120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444387.228061:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383284f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.228069:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383284f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444387.228118:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575317248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444387.228140:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444387.228170:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa080c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444387.228209:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575317248 00000100:00100000:3.0:1783444387.228215:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575317248 00000100:00100000:3.0:1783444387.228248:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783444387.228255:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575317248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444387.228337:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575317248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (195us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444387.228344:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783444387.228434:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575317248:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783444387.228458:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783444387.228464:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383284f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.228471:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383284f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444387.804937:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444387.925654:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444387.925995:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444387.926015:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444387.926057:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444387.926087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444387.926133:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557793536 00000100:00100000:0.0:1783444387.926143:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557793536 00000100:00100000:0.0:1783444387.926196:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557793664 00000100:00100000:0.0:1783444387.926199:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557793664 00000100:00100000:0.0:1783444387.926224:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2418 00000100:00100000:0.0:1783444387.926235:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557793536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444387.927136:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557793536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 898us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.927146:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2418 00000100:00100000:0.0:1783444387.927169:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2419 00000100:00100000:0.0:1783444387.927179:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557793664:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444387.927212:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557793664:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.927218:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2419 00000100:00100000:0.0:1783444387.927247:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557793408 00000100:00100000:0.0:1783444387.927252:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557793408 00000100:00100000:0.0:1783444387.927284:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557793280 00000100:00100000:0.0:1783444387.927287:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557793280 00000100:00100000:3.0:1783444387.927539:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 994 00000100:00100000:3.0:1783444387.927561:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557793408:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444387.927603:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557793408:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 45us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.927619:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 994 00000100:00100000:3.0:1783444387.927643:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1266 00000100:00100000:3.0:1783444387.927647:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557793280:12345-192.168.204.20@tcp:38:kworker.0 00010000:00080000:3.0:1783444387.927672:0:66226:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '778015c5-4969-44f5-82a5-0f6eadd152d5' at ffff9367c32c8800, cookie 0x42cb6883e38326dc 00010000:00080000:3.0:1783444387.927689:0:66226:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp recovering/t111669149704 exp ffff9367c32c8800 cur 3378 last 1783444386 00010000:02000400:3.0:1783444387.927697:0:66226:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1783444387.927703:0:66226:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1783444387.927723:0:66226:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783444387.927890:0:66226:0:(import.c:65:import_set_state_nolock()) ffff9368eb785000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444387.927921:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557793280:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 272us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444387.927928:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1266 00000100:00080000:0.0:1783444387.928290:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444387.928295:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444387.928391:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444387.928565:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557793152 00000100:00100000:0.0:1783444387.928571:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557793152 00000100:00100000:0.0:1783444387.928612:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1783444387.928626:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1870073557793152:12345-192.168.204.20@tcp:250:kworker.0 00010000:00080000:0.0:1783444387.928644:0:90997:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fea1b1de-aca2-4501-86bf-fe28138c0593@192.168.204.20@tcp t0 exp 0000000000000000 cur 3378 last 0 00000020:00000080:0.0:1783444387.928671:0:90997:0:(genops.c:1406:class_connect()) connect: client fea1b1de-aca2-4501-86bf-fe28138c0593, cookie 0x42cb6883e3832856 00000100:00080000:0.0:1783444387.932860:0:90997:0:(import.c:65:import_set_state_nolock()) ffff936901f90000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444387.932942:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+5:2400:x1870073557793152:12345-192.168.204.20@tcp:250:kworker.0 Request processed in 4321us (6881us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444387.932955:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1783444387.934560:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444387.934605:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557784704 00000100:00100000:3.0:1783444387.934614:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557784704 00000100:00100000:3.0:1783444387.934666:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1267 00000100:00100000:3.0:1783444387.934676:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557784704:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00080000:3.0:1783444387.934705:0:71469:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 111669149704, current: 111669149704, replaying 00000100:00100000:3.0:1783444387.934724:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557784704:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 50us (183us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444387.934731:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1267 00010000:00080000:0.0:1783444387.935137:0:91023:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1783444388.637094:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575317376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444388.637172:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444388.637277:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575317376 00000100:00100000:0.0:1783444388.637286:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575317376 00000100:00100000:0.0:1783444388.637359:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:0.0:1783444388.637369:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575317376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444388.637411:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444388.637459:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575317376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444388.637467:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:0.0:1783444388.637520:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575317376:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783444388.637702:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444388.638520:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444388.638532:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575317504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444388.638579:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444388.638615:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575317504 00000100:00100000:0.0:1783444388.638621:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575317504 00000100:00100000:0.0:1783444388.638656:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1783444388.638664:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575317504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444388.638687:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444388.638720:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575317504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444388.638728:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00080000:0.0:1783444388.638742:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444388.638767:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575317504:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783444388.832108:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444389.834614:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444389.834804:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557793792 00000100:00100000:3.0:1783444389.834815:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557793792 00000100:00100000:3.0:1783444389.834880:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1783444389.834892:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+5:42401:x1870073557793792:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444389.834914:0:91001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444389.834935:0:91001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04600/0x42cb6883e383285d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bc2 expref: -99 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444389.834970:0:91001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04600/0x42cb6883e383285d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bc2 expref: 6 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444389.834983:0:91001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04600/0x42cb6883e383285d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bc2 expref: 6 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444389.834994:0:91001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04600, rc 0) 00000100:00100000:3.0:1783444389.835055:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557793792:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 166us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444389.835063:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1783444389.839942:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444389.840031:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557793920 00000100:00100000:1.0:1783444389.840042:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557793920 00000100:00100000:1.0:1783444389.840096:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1783444389.840105:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557793920:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783444389.840129:0:90997:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1783444389.840153:0:90997:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783444389.840157:0:90997:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783444389.840160:0:90997:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783444389.840163:0:90997:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783444389.840165:0:90997:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:1.0:1783444389.843090:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557793920:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 Request processed in 2975us (3145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444389.843109:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1783444389.845737:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444389.845816:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557794048 00000100:00100000:3.0:1783444389.845826:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557794048 00000100:00100000:3.0:1783444389.845913:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1783444389.845924:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c5cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+6:42401:x1870073557794048:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444389.845941:0:91001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444389.845959:0:91001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05200/0x42cb6883e3832864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bc9 expref: -99 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444389.845985:0:91001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05200/0x42cb6883e3832864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bc9 expref: 7 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444389.846010:0:91001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05200/0x42cb6883e3832864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bc9 expref: 7 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444389.846020:0:91001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05200, rc 0) 00000100:00100000:3.0:1783444389.846078:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c5cce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fea1b1de-aca2-4501-86bf-fe28138c0593+7:42401:x1870073557794048:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 156us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444389.846085:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1783444389.853871:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1783444389.854063:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444389.854112:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557794176 00000100:00100000:3.0:1783444389.854122:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557794176 00000100:00100000:3.0:1783444389.854341:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1783444389.854353:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c580cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+7:42401:x1870073557794176:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444389.856378:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c580cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557794176:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 2018us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444389.856391:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1783444389.866207:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444389.866490:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557794304 00000100:00100000:3.0:1783444389.866499:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557794304 00000100:00100000:3.0:1783444389.866570:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1783444389.866580:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557794304:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444389.866717:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557794304:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 139us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444389.866726:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1783444389.877279:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444389.878256:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557794432 00000100:00100000:0.0:1783444389.878267:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557794432 00000100:00100000:0.0:1783444389.878329:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:0.0:1783444389.878339:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+8:42401:x1870073557794432:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444389.878365:0:90997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444389.878384:0:90997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751c00/0x42cb6883e383286b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bd0 expref: -99 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444389.878413:0:90997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751c00/0x42cb6883e383286b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bd0 expref: 9 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444389.878423:0:90997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751c00/0x42cb6883e383286b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bd0 expref: 9 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444389.878433:0:90997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751c00, rc 0) 00000100:00100000:0.0:1783444389.878491:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557794432:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 153us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444389.878499:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1783444389.891738:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444389.892838:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557794560 00000100:00100000:1.0:1783444389.892848:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557794560 00000100:00100000:1.0:1783444389.892911:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:1.0:1783444389.892921:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557794560:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444389.893065:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557794560:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 144us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444389.893072:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:1.0:1783444389.898845:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444389.898881:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557794688 00000100:00100000:1.0:1783444389.898889:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557794688 00000100:00100000:1.0:1783444389.898934:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:1.0:1783444389.898944:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557794688:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444389.899082:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557794688:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 139us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444389.899090:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:1.0:1783444389.908780:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444389.908841:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557794816 00000100:00100000:1.0:1783444389.908852:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557794816 00000100:00100000:1.0:1783444389.908904:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1783444389.908914:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+9:42401:x1870073557794816:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444389.908942:0:90995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444389.908958:0:90995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5756400/0x42cb6883e3832872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bd7 expref: -99 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444389.908989:0:90995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5756400/0x42cb6883e3832872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bd7 expref: 10 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444389.909001:0:90995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5756400/0x42cb6883e3832872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bd7 expref: 10 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444389.909010:0:90995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756400, rc 0) 00000100:00100000:1.0:1783444389.909073:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557794816:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 159us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444389.909080:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1783444389.917331:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444389.917429:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557794944 00000100:00100000:0.0:1783444389.917439:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557794944 00000100:00100000:0.0:1783444389.917504:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:0.0:1783444389.917514:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557794944:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444389.917626:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:42401:x1870073557794944:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 113us (303us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444389.917635:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00010000:00010000:3.0:1783444390.880316:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783444391.187730:0:91274:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1783444391.708930:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444391.708937:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444391.708941:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444391.708948:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3377 00000100:00080000:0.0:1783444391.708953:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444391.708964:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444391.708982:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd170700 x1870073575317760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444391.709001:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444391.709005:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444391.709007:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444391.709010:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3377 00000100:00080000:0.0:1783444391.709012:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444391.709015:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444391.709023:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd170380 x1870073575318016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444391.709043:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444391.709046:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444391.709047:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444391.709050:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3377 00000100:00080000:0.0:1783444391.709052:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444391.709055:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444391.709064:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd170a80 x1870073575318272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444391.709083:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444391.709086:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444391.709087:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444391.709090:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3377 00000100:00080000:0.0:1783444391.709092:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444391.709099:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444391.709109:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973e680 x1870073575318656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444391.709129:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783444391.709132:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444391.709134:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368eb18b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444391.709138:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9368eb18b000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444391.709146:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e5500 x1870073575319168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444391.709365:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575317888:0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709423:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.709449:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575318784:0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709469:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.709491:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783444391.709496:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575317632:0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709530:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.709553:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575318528:0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709572:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.709593:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575318144:0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.709626:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575318912:0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709647:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.709659:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783444391.709663:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575318400:0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709686:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.709697:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575319040:0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709711:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.709735:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575318784 00000100:00100000:0.0:1783444391.709742:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575318784 00000100:00100000:0.0:1783444391.709782:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:0.0:1783444391.709812:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575318784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.709856:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575318784:12345-0@lo:400:kworker.0 Request processed in 67us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444391.709863:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:2.0:1783444391.710104:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575318528 00000100:00100000:2.0:1783444391.710113:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575318528 00000100:00100000:2.0:1783444391.710337:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575318912 00000100:00100000:2.0:1783444391.710341:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575318912 00000100:00100000:2.0:1783444391.710835:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575318400 00000100:00100000:2.0:1783444391.710838:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575318400 00000100:00100000:2.0:1783444391.710852:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575319040 00000100:00100000:2.0:1783444391.710854:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575319040 00000100:00100000:2.0:1783444391.710870:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:2.0:1783444391.710877:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575318528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444391.711227:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575319296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444391.711456:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575318528:12345-0@lo:400:kworker.0 Request processed in 579us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444391.711463:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:2.0:1783444391.711478:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:2.0:1783444391.711484:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575318912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444391.711521:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575318912:12345-0@lo:400:kworker.0 Request processed in 28us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444391.711528:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:2.0:1783444391.711537:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:2.0:1783444391.711543:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575318400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444391.711570:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575318400:12345-0@lo:400:kworker.0 Request processed in 27us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444391.711576:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:2.0:1783444391.711586:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:2.0:1783444391.711591:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575319040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444391.711611:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575319040:12345-0@lo:400:kworker.0 Request processed in 22us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444391.711617:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:3.0:1783444391.712144:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.712441:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575317632 00000100:00100000:0.0:1783444391.712448:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575317632 00000100:00100000:3.0:1783444391.712583:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575317760:0@lo:38:kworker.0 00000100:00100000:3.0:1783444391.712613:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444391.712634:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575318016:0@lo:38:kworker.0 00000100:00100000:3.0:1783444391.712655:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444391.712672:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575318272:0@lo:38:kworker.0 00000100:00100000:3.0:1783444391.712695:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444391.712708:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575318656:0@lo:38:kworker.0 00000100:00100000:3.0:1783444391.712724:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444391.712735:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575319168:0@lo:38:kworker.0 00000100:00100000:3.0:1783444391.712753:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444391.712804:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575317888 00000100:00100000:3.0:1783444391.712808:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575317888 00000100:00100000:3.0:1783444391.712829:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575318144 00000100:00100000:3.0:1783444391.712832:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575318144 00000100:00100000:3.0:1783444391.712843:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575317760 00000100:00100000:3.0:1783444391.712845:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575317760 00000100:00100000:3.0:1783444391.712852:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575318016 00000100:00100000:3.0:1783444391.712854:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575318016 00000100:00100000:3.0:1783444391.712860:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575318656 00000100:00100000:3.0:1783444391.712862:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575318656 00000100:00100000:3.0:1783444391.712869:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575319168 00000100:00100000:3.0:1783444391.712871:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575319168 00000100:00100000:0.0:1783444391.712970:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783444391.712978:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575317632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444391.713016:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575317632:12345-0@lo:400:kworker.0 Request processed in 39us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444391.713023:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1783444391.713652:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444391.713658:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444391.713661:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444391.713711:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575318400:0@lo:400:kworker.0 00000100:00100000:2.0:1783444391.713740:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575319040:0@lo:400:kworker.0 00000100:00100000:2.0:1783444391.713753:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575318912:0@lo:400:kworker.0 00000100:00100000:3.0:1783444391.714116:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1783444391.714131:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575317888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444391.714185:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575317888:12345-0@lo:400:kworker.0 Request processed in 58us (4761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444391.714857:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1783444391.714871:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575318144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444391.714996:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575319296 00000100:00100000:1.0:1783444391.715004:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575319296 00000100:00100000:1.0:1783444391.715038:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575318272 00000100:00100000:1.0:1783444391.715041:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575318272 00000100:00100000:1.0:1783444391.715051:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1783444391.715057:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575319296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444391.715083:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444391.715134:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575319296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444391.715141:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1783444391.715228:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:1.0:1783444391.715232:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fa172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575318272:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783444391.715334:0:29151:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9368ff5e5000, cookie 0x42cb6883e38326e3 00010000:00080000:1.0:1783444391.715339:0:29151:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9368ff5e5000 cur 3382 last 1783444386 00000004:00100000:1.0:1783444391.715413:0:29151:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783444391.715612:0:29151:0:(import.c:65:import_set_state_nolock()) ffff9368dd1e8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444391.715662:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fa172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575318272:12345-0@lo:38:kworker.0 Request processed in 428us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444391.715669:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1783444391.715919:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575318144:12345-0@lo:400:kworker.0 Request processed in 1052us (6304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444391.715926:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1783444391.715946:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1783444391.715950:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575317760:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444391.715965:0:66225:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3382 last 0 00000020:00000080:0.0:1783444391.716003:0:66225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42cb6883e3832879 00000004:00100000:0.0:1783444391.716011:0:66225:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444391.716029:0:66225:0:(import.c:65:import_set_state_nolock()) ffff936901f94000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444391.716054:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1870073575317760:12345-0@lo:38:kworker.0 Request processed in 102us (3440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444391.716060:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1783444391.716071:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1783444391.716075:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575318016:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444391.716087:0:66225:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3382 last 0 00000020:00000080:0.0:1783444391.716108:0:66225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42cb6883e3832880 00000004:00100000:0.0:1783444391.716114:0:66225:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444391.716126:0:66225:0:(import.c:65:import_set_state_nolock()) ffff936901f97000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444391.716149:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1870073575318016:12345-0@lo:38:kworker.0 Request processed in 73us (3493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444391.716339:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1783444391.716422:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1783444391.716427:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575318656:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444391.716441:0:66225:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3382 last 0 00000020:00000080:0.0:1783444391.716467:0:66225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x42cb6883e3832887 00000004:00100000:0.0:1783444391.716552:0:66225:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444391.716569:0:66225:0:(import.c:65:import_set_state_nolock()) ffff9367c5622800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444391.716600:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1870073575318656:12345-0@lo:38:kworker.0 Request processed in 172us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444391.716607:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1783444391.716620:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1783444391.716631:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575319168:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444391.716648:0:66225:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3382 last 0 00000020:00000080:0.0:1783444391.716668:0:66225:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42cb6883e383288e 00000004:00100000:0.0:1783444391.716674:0:66225:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444391.716686:0:66225:0:(import.c:65:import_set_state_nolock()) ffff9367c5627000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444391.716712:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575319168:12345-0@lo:38:kworker.0 Request processed in 80us (3957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444391.716718:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1783444391.718855:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1783444391.719032:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575319296:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1783444391.719073:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368dd170700 x1870073575317760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.719087:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00010000:00080000:0.0:1783444391.720708:0:91023:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783444391.720717:0:91023:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 111669149704 00000020:00080000:0.0:1783444391.720733:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.720737:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 111669149704, next_transno: 111669149704 00010000:00080000:0.0:1783444391.720741:0:91023:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (111669149704) 00000020:00080000:0.0:1783444391.720743:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.720758:0:91023:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557784704 t111669149704 from 192.168.204.20@tcp req@ffff9368e68e5500 x1870073557784704/t0(111669149704) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:8/0 lens 528/0 e 0 to 0 dl 1783444398 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000001:00100000:2.0:1783444391.723137:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783444391.725587:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1783444391.727742:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9368dd170700 x1870073575317760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444416 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.727756:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783444391.727761:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444391.727765:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1783444391.728025:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575318144:0@lo:400:kworker.0 00000100:00100000:3.0:1783444391.729548:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575317760:0@lo:38:kworker.0 00010000:00080000:3.0:1783444391.729590:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368dd170380 x1870073575318016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.729609:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000004:00080000:0.0:1783444391.732122:0:91023:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9489us 00000001:00100000:2.0:1783444391.732436:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783444391.739871:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575317632:0@lo:400:kworker.0 00000100:00100000:1.0:1783444391.739911:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575318528:0@lo:400:kworker.0 00000100:00100000:1.0:1783444391.739925:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575317888:0@lo:400:kworker.0 00000100:00100000:1.0:1783444391.739936:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575318784:0@lo:400:kworker.0 00000100:00080000:3.0:1783444391.740421:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9368dd170380 x1870073575318016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444416 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.740434:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783444391.740439:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444391.740444:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783444391.740449:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575318016:0@lo:38:kworker.0 00000100:00080000:3.0:1783444391.740486:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:3.0:1783444391.740499:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1783444391.740503:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1783444391.740524:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378635 gen 3 00000100:00080000:3.0:1783444391.740529:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368f8ca7800 from lustre-MDT0000_UUID committed 81604378635 last 0 00000100:00080000:3.0:1783444391.740532:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1783444391.746950:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575318272:0@lo:38:kworker.0 00010000:00080000:3.0:1783444391.746995:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368f973e680 x1870073575318656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.747027:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000100:00080000:3.0:1783444391.747897:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9368f973e680 x1870073575318656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444416 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.747907:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1783444391.747912:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444391.747916:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1783444391.747921:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575318656:0@lo:38:kworker.0 00010000:00080000:3.0:1783444391.747941:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c45e5500 x1870073575319168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.747953:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:3.0:1783444391.747959:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783444391.747964:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783444391.747966:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb18b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783444391.747970:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575319168:0@lo:38:kworker.0 00010000:00080000:3.0:1783444391.748020:0:91300:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1783444391.748024:0:91300:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1783444391.748028:0:91300:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1783444391.748436:0:91300:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1783444391.748494:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575319424:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783444391.748570:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444391.748619:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575319424 00000100:00100000:3.0:1783444391.748626:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575319424 00000100:00100000:3.0:1783444391.748670:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1783444391.748678:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575319424:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1783444391.748697:0:8431:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9369005b2a00 x1870073575319424/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:12/0 lens 224/0 e 0 to 0 dl 1783444402 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444391.748708:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575319424:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 32us (139us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444391.748714:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00010000:00010000:0.0:1783444391.780708:0:91023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.780733:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.780747:0:91023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.780760:0:91023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.780779:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.780807:0:91023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781201:0:91023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781742:0:91023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781748:0:91023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781755:0:91023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444391.781759:0:91023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781767:0:91023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781782:0:91023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7f86500) 00010000:00010000:0.0:1783444391.781785:0:91023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444391.781809:0:91023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781816:0:91023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e3832895 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444391.781834:0:91023:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000152a11e8 reply state 000000008b44a249 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781852:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.781859:0:91023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86800) 00010000:00010000:0.0:1783444391.781862:0:91023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444391.781865:0:91023:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783444391.781986:0:91023:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1783444391.782008:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.782011:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000020:00080000:0.0:1783444391.782015:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.782017:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000100:00100000:3.0:1783444391.788810:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444391.790959:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557785216 00000100:00100000:0.0:1783444391.790973:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557785216 00000100:00100000:0.0:1783444391.791050:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1272 00000100:00100000:0.0:1783444391.791061:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557785216:12345-192.168.204.20@tcp:36:rm.0 00010000:00080000:0.0:1783444391.791080:0:80475:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 111669149705, current: 111669149705, replaying 00000100:00100000:0.0:1783444391.791093:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557785216:12345-192.168.204.20@tcp:36:rm.0 Request processed in 36us (2310us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444391.791100:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1272 00000020:00080000:0.0:1783444391.791116:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.791120:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149705, next_transno: 111669149705 00010000:00080000:0.0:1783444391.791124:0:91023:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (111669149705) 00000020:00080000:0.0:1783444391.791127:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.791136:0:91023:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557785216 t111669149705 from 192.168.204.20@tcp req@ffff9369005b0700 x1870073557785216/t0(111669149705) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:12/0 lens 512/0 e 0 to 0 dl 1783444402 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783444391.791219:0:91023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791245:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791258:0:91023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791272:0:91023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791279:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791286:0:91023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791372:0:91023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791380:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791386:0:91023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791627:0:91023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791635:0:91023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791642:0:91023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791656:0:91023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444391.791660:0:91023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791669:0:91023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791683:0:91023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff9368e7f86c00) 00010000:00010000:0.0:1783444391.791686:0:91023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783444391.791690:0:91023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791696:0:91023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e38328b1 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791716:0:91023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791722:0:91023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791728:0:91023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791733:0:91023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444391.791736:0:91023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791742:0:91023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791759:0:91023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368e7f86500) 00010000:00010000:0.0:1783444391.791761:0:91023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444391.791764:0:91023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791770:0:91023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38328a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444391.791781:0:91023:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000111c5f8 reply state 00000000bfefbbbc transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791814:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.791820:0:91023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86800) 00010000:00010000:0.0:1783444391.791822:0:91023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444391.791825:0:91023:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783444391.791915:0:91023:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783444391.791929:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.791932:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000020:00080000:0.0:1783444391.791935:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.791937:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000100:00100000:3.0:1783444391.804406:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444391.808558:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557786624 00000100:00100000:1.0:1783444391.808576:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557786624 00000100:00100000:1.0:1783444391.808702:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1273 00000100:00100000:1.0:1783444391.808714:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557786624:12345-192.168.204.20@tcp:36:dd.0 00010000:00080000:1.0:1783444391.808747:0:66226:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 111669149706, current: 111669149708, replaying 00000100:00100000:1.0:1783444391.808766:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557786624:12345-192.168.204.20@tcp:36:dd.0 Request processed in 55us (4372us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444391.808781:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1273 00000020:00080000:0.0:1783444391.819151:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.819161:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149708, next_transno: 111669149706 00010000:00080000:0.0:1783444391.819169:0:91023:0:(ldlm_lib.c:2245:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 111669149706, ql: 1, comp: 1, conn: 2, next: 111669149708, next_update 0 last_committed: 111669149703) 00000020:00080000:0.0:1783444391.819174:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.819188:0:91023:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557786624 t111669149708 from 192.168.204.20@tcp req@ffff9369005b0380 x1870073557786624/t0(111669149708) o36->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:12/0 lens 488/0 e 0 to 0 dl 1783444402 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783444391.819590:0:91023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.819607:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.819618:0:91023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444391.819663:0:91023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149708 00000004:00010000:0.0:1783444391.819685:0:91023:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aac897a7 reply state 00000000d6e93480 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.819698:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.819706:0:91023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:0.0:1783444391.819709:0:91023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444391.819712:0:91023:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1783444391.819853:0:91023:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1783444391.819863:0:91023:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:0.0:1783444391.819875:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.819878:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000020:00080000:0.0:1783444391.819881:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444391.819883:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000100:00100000:1.0:1783444391.840982:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444391.847169:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557787008 00000100:00100000:3.0:1783444391.847185:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557787008 00000100:00100000:3.0:1783444391.849141:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1274 00000100:00100000:3.0:1783444391.849162:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2400:x1870073557787008:12345-192.168.204.20@tcp:101:dd.0 00010000:00080000:3.0:1783444391.849184:0:71469:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 111669149709, current: 111669149709, replaying 00000100:00100000:3.0:1783444391.849202:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2400:x1870073557787008:12345-192.168.204.20@tcp:101:dd.0 Request processed in 49us (8229us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444391.849209:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1274 00000020:00080000:1.0:1783444391.854984:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444391.854994:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149709, next_transno: 111669149709 00010000:00080000:1.0:1783444391.855001:0:91023:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (111669149709) 00000020:00080000:1.0:1783444391.855016:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444391.855031:0:91023:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557787008 t111669149709 from 192.168.204.20@tcp req@ffff9368e7c8c380 x1870073557787008/t0(111669149709) o101->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:12/0 lens 640/0 e 0 to 0 dl 1783444402 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1783444391.855067:0:91023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444391.855095:0:91023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e38328bf lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939b91 expref: -99 pid: 91023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.855155:0:91023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38328c6 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.855168:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38328c6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.855181:0:91023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38328c6 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444391.855388:0:91023:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xb1:0x0], count =625 00000004:00080000:1.0:1783444391.855393:0:91023:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xb1:0x0]+625 in llog 00000004:00080000:1.0:1783444391.855427:0:91023:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x322:0x0], index 0: 0 00000004:00080000:1.0:1783444391.855434:0:91023:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x323:0x0], index 1: 0 00010000:00010000:1.0:1783444391.856000:0:91023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38328c6 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b91 expref: 16 pid: 91023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.856012:0:91023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:1.0:1783444391.856016:0:91023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1783444391.856030:0:91023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e38328bf lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b91 expref: 16 pid: 91023 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.856044:0:91023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38328c6 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b91 expref: 15 pid: 91023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.856089:0:91023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:1.0:1783444391.856092:0:91023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1783444391.856095:0:91023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757000, rc 0) 00010000:00080000:1.0:1783444391.856160:0:91023:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1783444391.856177:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444391.856180:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000020:00080000:1.0:1783444391.856183:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444391.856185:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000100:00100000:2.0:1783444391.872730:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444391.872846:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557795072 00000100:00100000:1.0:1783444391.872855:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557795072 00000100:00100000:1.0:1783444391.872929:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 997 00000100:00100000:1.0:1783444391.872939:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+15:2400:x1870073557795072:12345-192.168.204.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783444391.872966:0:80475:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9368e69ace00 x1870073557795072/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:12/0 lens 224/0 e 0 to 0 dl 1783444402 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444391.872988:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+15:2400:x1870073557795072:12345-192.168.204.20@tcp:400:ldlm_lock_repla.0 Request processed in 52us (269us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444391.872995:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 997 00000020:00080000:2.0:1783444391.875098:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783444391.875105:0:91023:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149710 00010000:00080000:2.0:1783444391.875108:0:91023:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1783444391.875111:0:91023:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1783444391.875117:0:91023:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783444391.875120:0:91023:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1783444391.875238:0:91023:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:2.0:1783444391.887980:0:90990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00100000:2.0:1783444391.887992:0:90990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1783444391.888022:0:90990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149709 is committed 00000001:00080000:2.0:1783444391.888075:0:91023:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1783444391.888114:0:91023:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1783444391.888130:0:91023:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9369005b2a00 x1870073575319424/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:12/0 lens 224/0 e 0 to 0 dl 1783444402 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783444391.888262:0:91023:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.20@tcp: req@ffff9368e69ace00 x1870073557795072/t0(0) o400->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:12/0 lens 224/0 e 0 to 0 dl 1783444402 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783444391.888327:0:91023:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1783444391.891189:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1783444391.891205:0:3632:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9369005b2300 x1870073575319424/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444407 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.891216:0:3632:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9369005b2300 x1870073575319424/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444407 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444391.891249:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444391.891263:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1783444391.891270:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000de694111): req@ffff9368ff665180 x1870073575299200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444376 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444391.891290:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575319424:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783444391.891460:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444391.891471:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575319552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444391.891538:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444391.891578:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575319552 00000100:00100000:3.0:1783444391.891584:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575319552 00000100:00100000:3.0:1783444391.891643:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1783444391.891651:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575319552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444391.891680:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444391.891740:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575319552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444391.891747:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1783444391.891781:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575319552:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783444391.892226:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892246:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892266:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892273:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444391.892278:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892285:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892302:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86800) 00010000:00010000:0.0:1783444391.892304:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444391.892309:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892316:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750000/0x42cb6883e383289c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892330:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892335:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892340:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892345:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444391.892348:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892363:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892370:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368e7f86800) 00010000:00010000:0.0:1783444391.892372:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444391.892374:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892380:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38328aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892395:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892401:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892407:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892413:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444391.892416:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892423:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892430:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:0.0:1783444391.892433:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444391.892435:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.892448:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e38328b8 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444391.893047:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444391.895059:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575299200 00000100:00100000:3.0:1783444391.895071:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575299200 00000100:00100000:3.0:1783444391.895141:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1783444391.895151:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575299200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444391.895179:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444391.895262:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575299200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444391.895285:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1783444391.895338:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575299200:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783444391.933198:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1783444391.941739:0:91023:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac1c47eabe10 00100000:10000000:3.0:1783444391.941756:0:91023:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1783444391.952446:0:91011:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:0.0:1783444391.952495:0:91011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea494700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91011:1870073575319680:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783444391.952570:0:91011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444391.952604:0:91011:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f57000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444391.952698:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575319680 00000100:00100000:1.0:1783444391.952705:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575319680 00000004:00080000:2.0:1783444391.952742:0:91009:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:1.0:1783444391.952753:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5886 00000100:00100000:2.0:1783444391.952762:0:91009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91009:1870073575319808:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783444391.952762:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:91011:x1870073575319680:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783444391.952810:0:91009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1783444391.952814:0:26206:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -30 00002000:02000040:1.0:1783444391.952818:0:26206:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:833) 00000100:00100000:2.0:1783444391.952828:0:91009:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaab10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444391.952998:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575319808 00000100:00100000:3.0:1783444391.953002:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575319808 00000100:00100000:3.0:1783444391.953036:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5887 00000100:00100000:3.0:1783444391.953044:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:91009:x1870073575319808:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783444391.953059:0:26208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -31 00002000:02000040:3.0:1783444391.953063:0:26208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:833) 00002000:00010000:2.0:1783444391.984051:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.984068:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.984086:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x341:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.984090:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x341:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.984097:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.984113:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.984124:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.984131:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.984159:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444391.984339:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444391.984352:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.984360:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444391.984365:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.984374:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.984393:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.984400:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ab9f38b/0x42cb6883e38328cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.984430:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444391.984432:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444391.984434:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.985165:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.985172:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985183:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x340:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.985186:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x340:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.985190:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985199:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985589:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985597:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985623:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444391.985673:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.985678:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985686:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33f:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.985689:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.985693:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985719:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985727:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985734:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985760:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783444391.985828:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.985833:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985841:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33e:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.985844:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.985848:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985856:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985863:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985881:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985900:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1783444391.985913:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444391.985918:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985926:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.985930:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985939:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985955:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985963:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004caf8d10/0x42cb6883e38328d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.985979:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444391.985982:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986118:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.986123:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986132:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986143:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986150:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd6d8b9b/0x42cb6883e38328db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986163:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.986166:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986174:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.986177:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986185:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986193:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986277:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8c13928/0x42cb6883e38328e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986291:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.986293:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.986294:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.986344:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.986350:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986358:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33d:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.986362:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.986366:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986374:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986382:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986390:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986404:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444391.986578:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444391.986584:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.986591:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444391.986595:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.986614:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.986626:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.986634:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444391.986635:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444391.986637:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.986669:0:26206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a9e84a/0x42cb6883e38328e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986688:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444391.986704:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.986729:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.986734:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986742:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33c:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.986745:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.986748:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986756:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986763:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986769:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986840:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444391.986878:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.986883:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986891:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33b:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.986899:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.986903:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986912:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986920:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986929:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.986977:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783444391.987090:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.987096:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.987104:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33a:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.987108:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.987112:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.987119:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.987126:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.987140:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444391.991993:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444391.992993:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444391.993024:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x341:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444391.993029:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x341:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444391.993035:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444391.993053:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444391.993064:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444391.993072:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993172:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444391.993182:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993190:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444391.993195:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993215:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993235:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993243:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b9335c7/0x42cb6883e38328f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993279:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444391.993283:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993289:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444391.993293:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993301:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993311:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993318:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dac6fd5e/0x42cb6883e38328f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993330:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444391.993333:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993338:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444391.993342:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993361:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993372:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993379:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444391.993383:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993388:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444391.993391:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993397:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993406:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444391.993426:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444391.993427:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444391.993429:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444391.994992:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.995260:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783444391.995271:0:26206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38328fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444391.995515:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.995523:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995536:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x339:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.995540:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x339:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.995546:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995558:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995566:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995573:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995603:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444391.995642:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.995647:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995655:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x338:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.995658:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x338:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.995662:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995671:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995678:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995686:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995699:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444391.995706:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444391.995710:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995718:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.995728:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995737:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995753:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995760:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e383290c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995772:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.995775:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995781:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.995785:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995811:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995822:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995830:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8746b81/0x42cb6883e3832913 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995848:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.995850:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.995852:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.995890:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.995896:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995904:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x337:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.995908:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.995912:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995920:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995927:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995934:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.995945:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444391.995982:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.995986:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996426:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x336:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.996430:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x336:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.996435:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996444:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996452:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996458:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996566:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444391.996575:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444391.996579:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996586:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.996589:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996596:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996617:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996624:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b5cc4a5/0x42cb6883e383291a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996638:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.996641:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996648:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.996651:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996657:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996666:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996672:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062cef40d/0x42cb6883e3832921 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996682:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.996683:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.996690:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.996740:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.996745:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996752:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x335:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.996755:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.996759:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996767:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996775:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996783:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996817:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.996823:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.996827:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996834:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.996837:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996856:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996868:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996875:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb58147d/0x42cb6883e3832928 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996888:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.996890:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.996892:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.996934:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.996938:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996945:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x334:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.996948:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x334:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.996951:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996960:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996966:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996979:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.996991:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.996997:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.997072:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997079:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.997082:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997089:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997100:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997107:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000967d4352/0x42cb6883e383292f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997120:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.997122:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.997124:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.997167:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.997176:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997184:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x333:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.997186:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.997190:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997198:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997205:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997343:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997358:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.997364:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.997368:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997374:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.997378:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997385:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997401:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997408:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002efecdfa/0x42cb6883e3832936 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997549:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.997550:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.997552:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.997590:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.997595:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997603:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x332:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.997606:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.997610:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997619:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997627:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997634:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997656:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.997662:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.997665:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997672:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.997675:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997683:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997692:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997699:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca27da65/0x42cb6883e383293d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997710:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.997712:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.997713:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.997748:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.997753:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997760:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x331:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.997767:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x331:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.997772:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997781:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997805:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997812:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997822:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.997828:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.997831:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997837:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.997840:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997847:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997856:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997873:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eafccfb/0x42cb6883e3832944 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997885:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.997887:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.997889:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.997923:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.997928:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997935:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x330:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.997938:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.997943:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997951:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997959:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997966:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997976:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.997986:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.997989:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.997996:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.998330:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998342:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998355:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998361:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb977553/0x42cb6883e383294b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998373:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.998375:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.998377:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.998545:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.998551:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998559:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32f:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.998563:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.998567:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998588:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998596:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998603:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998616:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.998622:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.998626:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998633:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.998636:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998644:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998654:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998661:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bae98db1/0x42cb6883e3832952 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998679:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.998681:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.998683:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.998718:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.998723:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998731:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32e:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.998735:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.998739:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998748:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998755:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998762:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998774:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.998780:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.998783:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998819:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.998823:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998830:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998839:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998847:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f592d88/0x42cb6883e3832959 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998860:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.998862:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444391.998864:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444391.998904:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444391.998910:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998918:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32d:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444391.998920:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444391.998925:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998933:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998948:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998955:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998967:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444391.998974:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444391.998978:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998984:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444391.998988:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444391.998994:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444391.999996:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.000004:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.000009:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.001068:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783444392.001082:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa97fe91/0x42cb6883e3832905 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444392.001680:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.001687:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001700:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x340:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.001703:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x340:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.001709:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001722:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001732:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001739:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001756:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.001763:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.001768:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001816:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.001821:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001831:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001847:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001855:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef2b3b0f/0x42cb6883e3832967 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.001869:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.001871:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.001872:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.002113:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.002121:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d93bfe/0x42cb6883e3832960 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.002138:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.002145:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.002147:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.002269:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.002277:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002284:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33f:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.002287:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.002291:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002299:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002313:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002320:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444392.002386:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.002392:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.002400:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32c:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.002404:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.002407:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002464:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444392.002614:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.002619:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002627:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33e:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.002630:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.002634:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002642:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002651:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.002658:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.002964:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.002972:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.002979:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012694:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444392.012710:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012725:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444392.012730:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012741:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012763:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012783:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002a0c538/0x42cb6883e383296e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012820:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444392.012824:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012831:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444392.012834:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012842:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012853:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012860:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444392.012864:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012870:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444392.012873:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012892:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012904:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.012914:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.012915:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.012917:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.022313:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783444392.022329:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dc2e292/0x42cb6883e383297c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.022649:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.022958:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.022966:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.022982:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33d:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.022986:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.022992:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023019:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023030:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023039:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023057:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.023065:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.023071:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023094:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.023099:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023108:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023129:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023137:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d3b19f/0x42cb6883e3832983 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023152:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.023154:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.023156:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.023197:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.023215:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023223:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33c:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.023226:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.023231:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023240:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023255:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023261:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023281:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444392.023321:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.023327:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023335:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33b:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.023338:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.023343:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023353:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023361:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023368:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023392:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444392.023400:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444392.023404:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023428:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.023432:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023441:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023453:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023461:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da66f5d/0x42cb6883e383298a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023480:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.023484:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023491:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.023494:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023525:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023536:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023543:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd281fb/0x42cb6883e3832991 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023556:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.023558:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.023560:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.023601:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.023606:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023614:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33a:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.023617:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.023622:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023630:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023639:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023651:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023665:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.023672:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.023677:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023684:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.023687:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023696:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023707:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023714:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f454f871/0x42cb6883e3832998 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023727:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.023728:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.023730:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.023765:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.023775:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023782:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x339:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.023785:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x339:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.023809:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023819:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023826:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023832:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023844:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.023851:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.023855:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023861:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.023864:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023872:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023889:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023896:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baae635b/0x42cb6883e383299f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023908:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.023910:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.023912:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.023950:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.023956:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023964:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x338:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.023967:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x338:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.023972:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023981:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023989:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.023997:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024019:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.024027:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.024030:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024037:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.024040:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024048:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024059:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024067:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c1b002/0x42cb6883e38329a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024079:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024081:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024083:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.024122:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.024127:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024135:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x337:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.024144:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.024148:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024158:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024166:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024174:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024186:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.024193:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.024196:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024203:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.024207:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024214:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024223:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024241:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e38329ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024254:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024256:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024258:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.024301:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.024307:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024315:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x336:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.024318:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x336:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.024322:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024329:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024337:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024345:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024357:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.024370:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.024374:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024381:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.024384:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024391:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024401:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024408:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb574ec/0x42cb6883e38329b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024421:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024422:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024424:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.024459:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.024464:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024472:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x335:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.024475:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.024479:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024497:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024520:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024528:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024540:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.024547:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.024550:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024557:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.024560:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024569:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024579:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024588:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d203f8/0x42cb6883e38329bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024608:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024609:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024611:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.024651:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.024655:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024663:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x334:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.024667:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x334:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.024670:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024679:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024686:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024693:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024705:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.024711:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.024715:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024732:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.024736:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024743:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024754:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024761:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e38329c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024774:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024776:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024778:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.024836:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.024841:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024849:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x333:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.024852:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.024856:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024864:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024878:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024885:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024897:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.024903:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.024907:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024913:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.024916:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024924:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024935:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024942:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e38329c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.024954:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024961:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.024963:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.025004:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.025010:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025017:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x332:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.025021:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.025024:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025033:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025041:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025047:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025060:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.025066:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.025070:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025076:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.025079:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025098:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025109:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025115:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e38329d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025127:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.025129:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.025131:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.025174:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.025180:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025187:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x331:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.025191:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x331:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.025194:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025203:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025211:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025225:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025237:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.025244:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.025247:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025254:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.025257:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025264:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025274:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025281:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e38329d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025294:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.025296:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.025298:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.025337:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.025347:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025355:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x330:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.025358:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.025362:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025371:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025378:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025385:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025396:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.025403:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.025406:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025412:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.025415:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025422:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025438:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025444:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e38329de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.025456:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.025458:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.025459:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.025501:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444392.026597:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.026621:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783444392.026634:0:26206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c80d9a/0x42cb6883e3832975 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.026670:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444392.026779:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.026815:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.026847:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32b:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.026850:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.026856:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.026869:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.026878:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.026886:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.026906:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444392.026955:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.026961:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.026969:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32a:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.026972:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.026976:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.026983:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027131:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444392.027137:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027145:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444392.027149:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027157:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027172:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027180:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444ffe03/0x42cb6883e38329ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027200:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.027212:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.027214:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.027299:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027308:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027329:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444392.027373:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.027378:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027386:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x329:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.027389:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x329:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.027393:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027402:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027583:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444392.027589:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027597:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef262c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444392.027600:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027608:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027621:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027628:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000697f434c/0x42cb6883e38329f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.027641:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.027643:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.027645:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.027667:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027676:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027705:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444392.027745:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.027751:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027760:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x328:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.027763:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.027767:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027776:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027784:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027815:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027829:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444392.027837:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444392.027841:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027848:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368ef263a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444392.027857:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027865:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027876:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027884:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005146bcc1/0x42cb6883e38329fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027897:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444392.027901:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027907:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444392.027910:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027918:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027926:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027933:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002460bfea/0x42cb6883e3832a01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.027950:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.027952:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.027954:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444392.027992:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.027997:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.028089:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.028119:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x327:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.028123:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x327:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.028127:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.028137:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.028144:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.028150:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.028195:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444392.028245:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.028251:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.028268:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x326:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.028271:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.028276:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.028284:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.028291:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.028297:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.030030:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.030049:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32f:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.030053:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.030059:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.030072:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.030082:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.030089:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030441:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444392.030449:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030476:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444392.030482:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030492:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030520:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030528:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832a08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030563:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444392.030567:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030574:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444392.030576:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030583:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030593:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030607:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444392.030610:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030617:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444392.030620:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030628:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030639:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.030646:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.030648:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.030649:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.030818:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783444392.030825:0:26206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e3832a0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444392.030942:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.030948:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.030956:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x325:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.030959:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.030964:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.030982:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.030990:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.030996:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031024:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444392.031032:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444392.031037:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031045:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444392.031048:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031056:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031066:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031073:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b70f8e93/0x42cb6883e3832a16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031093:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.031094:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.031096:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444392.031140:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444392.031146:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031153:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x324:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:2.0:1783444392.031156:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x324:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444392.031160:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031168:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031176:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031183:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031197:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444392.031645:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444392.031650:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031671:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444392.031675:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031684:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031696:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031704:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3832a1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444392.031719:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.031721:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444392.031722:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783444392.031759:0:26206:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:2.0:1783444392.031871:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:91011:x1870073575319680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79106us (79296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444392.031881:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5886 00000100:00100000:2.0:1783444392.031939:0:91011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea494700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91011:1870073575319680:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783444392.031954:0:91011:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x341:0x0] from OST, last_created [0x2c0000401:0x341:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:2.0:1783444392.032289:0:91011:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91011:1870073575320064:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783444392.032323:0:91011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444392.032361:0:91011:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444392.032378:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575319936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444392.032402:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444392.033630:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575319936 00000100:00100000:2.0:1783444392.033642:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575319936 00000100:00100000:2.0:1783444392.033695:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:2.0:1783444392.033705:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575319936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444392.033732:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444392.033780:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575319936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444392.033801:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:2.0:1783444392.033844:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575319936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444392.033868:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575320064 00000100:00100000:2.0:1783444392.033872:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575320064 00000100:00100000:2.0:1783444392.033901:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5888 00000100:00100000:2.0:1783444392.033907:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:91011:x1870073575320064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783444392.033937:0:26199:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 834 00010000:00010000:0.0:1783444392.034964:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.041174:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783444392.041189:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd64dbb/0x42cb6883e38329e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444392.041357:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.041365:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041379:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32e:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.041383:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.041390:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041402:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041411:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041417:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041435:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.041445:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.041451:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041603:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.041609:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041619:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041636:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041644:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f86d01c/0x42cb6883e3832a24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041658:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.041660:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.041661:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.041708:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.041713:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041721:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32d:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.041725:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.041729:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041738:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041752:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041759:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041773:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.041781:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.041808:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041816:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.041820:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041827:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041839:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041847:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032d9fa25/0x42cb6883e3832a2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041860:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.041867:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.041869:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.041912:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.041918:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041926:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32c:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.041930:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.041934:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041942:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041951:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041957:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041972:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.041979:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.041983:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.041990:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.041994:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042279:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042291:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042299:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f774bdc4/0x42cb6883e3832a32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042314:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.042316:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.042317:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.042362:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.042366:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042375:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32b:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.042377:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.042381:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042389:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042396:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042409:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042424:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444392.042432:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.042436:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042442:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.042446:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042454:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.042589:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.042617:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042628:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003433468a/0x42cb6883e3832a39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042642:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.042644:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.042645:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.042687:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.042698:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042706:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32a:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.042709:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.042714:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042723:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042731:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.042739:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.044083:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444392.044174:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.044182:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.044198:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x329:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.044215:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x329:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.044221:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.044233:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.044250:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.044256:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444392.046406:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:91011:x1870073575320064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12492us (14076us total) trans 4294969455 rc 0/0 00000100:00100000:2.0:1783444392.046627:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5888 00000100:00100000:2.0:1783444392.046773:0:91011:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91011:1870073575320064:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783444392.046825:0:91011:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x341:0x0]-[0x2c0000401:0x361:0x0] 00010000:00010000:1.0:1783444392.048948:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444392.048972:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.048987:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444392.048992:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.049016:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.049040:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.049047:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000281a2b89/0x42cb6883e3832a40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.049090:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444392.049094:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.049101:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444392.049105:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.049113:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.049135:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.049144:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.049146:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.049148:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.054220:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783444392.054234:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfda51d5/0x42cb6883e3832a47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444392.054369:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.054377:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.054390:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x328:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.054394:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.054400:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.054430:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.054440:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.054460:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.061244:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444392.061260:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.061276:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444392.061281:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.061291:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.061316:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.062639:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.062644:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444392.062648:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.068820:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783444392.068833:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442ed625/0x42cb6883e3832a4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444392.068930:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.071755:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.071768:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071806:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x327:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.071811:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x327:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.071818:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071833:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071843:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071852:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071890:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444392.071933:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.071939:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071946:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x326:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.071949:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.071954:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071961:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071968:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071975:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.071991:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444392.071996:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444392.072006:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.072017:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444392.072028:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.072039:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444392.072042:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.072053:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072062:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x325:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:1.0:1783444392.072065:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072072:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.072078:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.072094:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e408eeb/0x42cb6883e3832a55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072099:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072111:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.072119:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444392.072120:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.072125:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072142:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444392.072143:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444392.072149:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072154:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444392.072157:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072160:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.072174:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072175:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444392.072182:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.072187:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b522588f/0x42cb6883e3832a5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072194:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.072215:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.072217:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.072219:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.072225:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.072554:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072573:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050a7c936/0x42cb6883e3832a63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072588:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.072590:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.072592:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444392.072641:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.072646:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072654:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x324:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.072657:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x324:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.072661:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072669:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072676:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072684:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.072706:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444392.072749:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444392.072754:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.073018:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444392.073023:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.073033:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444392.073036:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.073045:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.073058:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.073065:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045583d9b/0x42cb6883e3832a6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.073149:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.073151:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.073154:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444392.073195:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x323:0x0].0x0 since=3383s v=(0 0) 00010000:00010000:3.0:1783444392.073198:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x323:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444392.073272:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.073282:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.073291:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.073299:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444392.073320:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783444392.073353:0:26208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00000100:00100000:3.0:1783444392.074128:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:91009:x1870073575319808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 121079us (121312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444392.074141:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5887 00010000:00010000:1.0:1783444392.074276:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783444392.074278:0:91009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91009:1870073575319808:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783444392.074283:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444392.074296:0:91009:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x341:0x0] from OST, last_created [0x280000401:0x341:0x0]last_used is [0x280000401:0x322:0x0] 00010000:00010000:1.0:1783444392.074301:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444392.074307:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.074317:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.074334:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444392.074343:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002fd4943/0x42cb6883e3832a71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444392.074376:0:91009:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91009:1870073575320320:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1783444392.074469:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.074471:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444392.074473:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444392.075113:0:91009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444392.075151:0:91009:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444392.075169:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575320192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444392.075170:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575320320 00000100:00100000:1.0:1783444392.075179:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575320320 00000100:00100000:1.0:1783444392.075229:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5889 00000100:00100000:1.0:1783444392.075238:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:91009:x1870073575320320:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783444392.075276:0:26209:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 834 00000100:00100000:3.0:1783444392.075565:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444392.075608:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575320192 00000100:00100000:3.0:1783444392.075613:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575320192 00000100:00100000:3.0:1783444392.075644:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:3.0:1783444392.075653:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575320192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444392.075667:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 896 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444392.075715:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575320192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444392.075722:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:3.0:1783444392.075767:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575320192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444392.077946:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:91009:x1870073575320320:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2704us (2830us total) trans 4294969452 rc 0/0 00000100:00100000:1.0:1783444392.077958:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5889 00000100:00100000:3.0:1783444392.078196:0:91009:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91009:1870073575320320:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783444392.078213:0:91009:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x341:0x0]-[0x280000401:0x361:0x0] 00000020:00000004:3.0:1783444392.286359:0:91329:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783444392.286746:0:91329:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783444392.928011:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444393.040716:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444393.040758:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444393.040785:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444393.040824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444393.040850:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444393.040884:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557795456 00000100:00100000:3.0:1783444393.040893:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557795456 00000100:00100000:3.0:1783444393.040946:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557795328 00000100:00100000:3.0:1783444393.040949:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557795328 00000100:00100000:3.0:1783444393.040972:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 998 00000100:00100000:3.0:1783444393.040989:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557795456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444393.041075:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557795456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444393.041082:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 998 00000100:00100000:3.0:1783444393.041098:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 999 00000100:00100000:3.0:1783444393.041105:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557795328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444393.041127:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557795328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444393.041132:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 999 00000100:00100000:3.0:1783444393.041150:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557795712 00000100:00100000:3.0:1783444393.041153:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557795712 00000100:00100000:3.0:1783444393.041178:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557795584 00000100:00100000:3.0:1783444393.041192:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557795584 00000100:00100000:3.0:1783444393.041345:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2424 00000100:00100000:3.0:1783444393.041354:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557795712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444393.041378:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557795712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444393.041384:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2424 00000100:00100000:3.0:1783444393.041395:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2425 00000100:00100000:3.0:1783444393.041401:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557795584:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444393.041425:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557795584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444393.041431:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2425 00000100:00080000:3.0:1783444393.041454:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444393.041463:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444393.041466:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444393.041468:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444393.042308:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557795200 00000100:00100000:2.0:1783444393.042315:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557795200 00000100:00100000:2.0:1783444393.042367:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:2.0:1783444393.042376:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557795200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444393.042433:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557795200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 58us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444393.042440:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000020:00000004:1.0:1783444393.456647:0:91379:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444393.456916:0:91379:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783444393.759587:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575320448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444393.759657:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444393.761542:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575320448 00000100:00100000:2.0:1783444393.761551:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575320448 00000100:00100000:2.0:1783444393.761613:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:2.0:1783444393.761622:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575320448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444393.761645:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444393.761709:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575320448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444393.761716:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00080000:2.0:1783444393.761894:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444393.761914:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575320576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444393.761948:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444393.761984:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575320576 00000100:00100000:2.0:1783444393.761988:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575320576 00000100:00100000:2.0:1783444393.762016:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1783444393.762022:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575320576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444393.762034:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444393.762083:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575320576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444393.762089:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00080000:2.0:1783444393.762103:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444393.762134:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575320576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444393.762169:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575320448:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783444393.951095:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444394.974542:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444395.489374:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444395.489639:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557795840 00000100:00100000:1.0:1783444395.489651:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557795840 00000100:00100000:1.0:1783444395.489733:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1275 00000100:00100000:1.0:1783444395.489744:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+7:69858:x1870073557795840:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444395.489765:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444395.489819:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bde expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444395.489885:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444395.489897:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444395.489907:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444395.489963:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783444395.489967:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444395.490003:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444395.490037:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 9 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444395.490054:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 8 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444395.490080:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:1.0:1783444395.490083:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444395.490087:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757c00, rc 0) 00000100:00100000:1.0:1783444395.490155:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:69858:x1870073557795840:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 412us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444395.490163:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1275 00000100:00080000:2.0:1783444395.490358:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444395.495976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444395.496063:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557795968 00000100:00100000:3.0:1783444395.496073:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557795968 00000100:00100000:3.0:1783444395.496155:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1276 00000100:00100000:3.0:1783444395.496165:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:69858:x1870073557795968:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444395.496203:0:67017:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444395.496284:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:69858:x1870073557795968:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 120us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444395.496292:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1276 00000100:00100000:0.0:1783444395.498337:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444395.504137:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557796096 00000100:00100000:3.0:1783444395.504151:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557796096 00000100:00100000:3.0:1783444395.504256:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1277 00000100:00100000:3.0:1783444395.504269:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69858:x1870073557796096:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444395.504308:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1783444395.504391:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69858:x1870073557796096:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 124us (6060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444395.504408:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1277 00000100:00080000:2.0:1783444395.504966:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444395.513927:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444395.514031:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557796224 00000100:00100000:2.0:1783444395.514042:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557796224 00000100:00100000:2.0:1783444395.514115:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1920 00000100:00100000:2.0:1783444395.514126:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69858:x1870073557796224:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444395.514160:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444395.514232:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:69858:x1870073557796224:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444395.514240:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1920 00000100:00080000:0.0:1783444395.514308:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444395.535354:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444395.535601:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557796352 00000100:00100000:2.0:1783444395.535610:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557796352 00000100:00100000:2.0:1783444395.535683:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1921 00000100:00100000:2.0:1783444395.535693:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+7:69858:x1870073557796352:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444395.535728:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444395.535827:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+7:69858:x1870073557796352:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 134us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444395.535834:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1921 00000100:00080000:0.0:1783444395.535899:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783444395.996991:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444396.829480:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444396.829548:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575320832:0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.829626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444396.829675:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575320704:0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.829838:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444396.829943:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575320832 00000100:00100000:2.0:1783444396.829951:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575320832 00000100:00100000:2.0:1783444396.830005:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1783444396.830016:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575320832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.830073:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575320832:12345-0@lo:400:kworker.0 Request processed in 59us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444396.830081:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1783444396.830124:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575320832:0@lo:400:kworker.0 00000100:00080000:1.0:1783444396.830240:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444396.830538:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575320960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.830570:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444396.830762:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575320704 00000100:00100000:3.0:1783444396.830768:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575320704 00000100:00100000:3.0:1783444396.830873:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783444396.830882:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575320704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.830931:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575320960 00000100:00100000:1.0:1783444396.830935:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575320960 00000100:00100000:1.0:1783444396.830968:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1783444396.830975:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575320960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444396.831058:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c599d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575320704:12345-0@lo:400:kworker.0 Request processed in 177us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444396.831065:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783444396.832300:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575320960:12345-0@lo:400:kworker.0 Request processed in 1321us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444396.832312:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1783444396.832351:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575321216:0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.832389:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444396.832446:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575321728:0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.832481:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444396.832501:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575322240:0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.832524:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444396.832545:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783444396.832551:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575321344:0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.832576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444396.832611:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575321856:0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.832634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444396.832886:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444396.832896:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575322368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444396.832920:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444396.832947:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575321216 00000100:00100000:1.0:1783444396.832953:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575321216 00000100:00100000:1.0:1783444396.832991:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575321728 00000100:00100000:1.0:1783444396.832995:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575321728 00000100:00100000:1.0:1783444396.833011:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575322240 00000100:00100000:1.0:1783444396.833013:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575322240 00000100:00100000:1.0:1783444396.833029:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1783444396.833036:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575321216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.833078:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575321216:12345-0@lo:400:kworker.0 Request processed in 43us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444396.833084:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1783444396.833097:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1783444396.833102:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575321728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.833130:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575321728:12345-0@lo:400:kworker.0 Request processed in 27us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444396.833135:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1783444396.833154:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1783444396.833160:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575322240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.833189:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575322240:12345-0@lo:400:kworker.0 Request processed in 29us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444396.833194:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1783444396.833216:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575321344 00000100:00100000:1.0:1783444396.833220:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575321344 00000100:00100000:3.0:1783444396.833333:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575321856 00000100:00100000:3.0:1783444396.833339:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575321856 00000100:00100000:2.0:1783444396.833831:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575320960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.833857:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575321472:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.833886:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444396.833910:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575321984:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.833931:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444396.833950:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783444396.833957:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575321088:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.833978:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444396.833997:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575321600:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834018:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444396.834036:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575322112:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834056:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444396.834102:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575321472 00000100:00100000:2.0:1783444396.834106:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575321472 00000100:00100000:2.0:1783444396.834139:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575321984 00000100:00100000:2.0:1783444396.834142:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575321984 00000100:00100000:2.0:1783444396.834158:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575321600 00000100:00100000:2.0:1783444396.834160:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575321600 00000100:00100000:2.0:1783444396.834179:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575322112 00000100:00100000:2.0:1783444396.834181:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575322112 00000100:00100000:2.0:1783444396.834199:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:2.0:1783444396.834206:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575321472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834260:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575321472:12345-0@lo:400:kworker.0 Request processed in 53us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444396.834277:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:2.0:1783444396.834291:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:2.0:1783444396.834296:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575321984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834322:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575321984:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444396.834327:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:2.0:1783444396.834337:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:2.0:1783444396.834343:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575321600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834367:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575321600:12345-0@lo:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444396.834372:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:2.0:1783444396.834383:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:2.0:1783444396.834388:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575322112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834425:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575322112:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444396.834431:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00100000:2.0:1783444396.834468:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575321088 00000100:00100000:2.0:1783444396.834472:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575321088 00000100:00100000:2.0:1783444396.834500:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1783444396.834506:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575321088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834537:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575321088:12345-0@lo:400:kworker.0 Request processed in 32us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444396.834543:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1783444396.834575:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575320704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834624:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575321088:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834634:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575321600:0@lo:400:kworker.0 00000100:00100000:1.0:1783444396.834859:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575322368 00000100:00100000:1.0:1783444396.834864:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575322368 00000100:00100000:2.0:1783444396.834977:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575322112:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834988:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575321472:0@lo:400:kworker.0 00000100:00100000:2.0:1783444396.834998:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575321984:0@lo:400:kworker.0 00000100:00080000:0.0:1783444396.837520:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444396.837529:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444396.837532:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444396.837535:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444396.838511:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575321216:0@lo:400:kworker.0 00000100:00100000:0.0:1783444396.838526:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575321728:0@lo:400:kworker.0 00000100:00100000:0.0:1783444396.838547:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575322240:0@lo:400:kworker.0 00000100:00100000:0.0:1783444396.838879:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:0.0:1783444396.842649:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575321344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444396.842765:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575321344:12345-0@lo:400:kworker.0 Request processed in 3877us (10189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444396.842777:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:3.0:1783444396.845501:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:3.0:1783444396.845840:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575321856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444396.846017:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575321344:0@lo:400:kworker.0 00000100:00100000:3.0:1783444396.846877:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575321856:12345-0@lo:400:kworker.0 Request processed in 1045us (14239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444396.852248:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:1.0:1783444396.852275:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575322368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444396.852323:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444396.852404:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575322368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (19482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444396.852424:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1783444396.864287:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:3.0:1783444396.864409:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575322368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444396.864441:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575321856:0@lo:400:kworker.0 00010000:00010000:2.0:1783444397.026802:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444397.345637:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575322496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444397.345720:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444397.346118:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575322496 00000100:00100000:3.0:1783444397.346127:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575322496 00000100:00100000:3.0:1783444397.346177:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:3.0:1783444397.346187:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575322496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444397.346218:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444397.346268:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575322496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444397.346277:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:1.0:1783444397.346310:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575322624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444397.346341:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444397.346601:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575322624 00000100:00100000:3.0:1783444397.346606:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575322624 00000100:00100000:3.0:1783444397.346649:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:3.0:1783444397.346656:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575322624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444397.346682:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444397.346727:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575322624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444397.346734:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1783444397.346891:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575322496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444397.346912:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444397.346920:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575322752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444397.346946:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444397.346975:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575322752 00000100:00100000:2.0:1783444397.346979:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575322752 00000100:00100000:2.0:1783444397.347005:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:2.0:1783444397.347012:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575322752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444397.347028:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444397.347059:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575322752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444397.347066:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:1.0:1783444397.347162:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575322624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444397.347173:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575322752:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1783444397.863037:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969455 is committed 00000001:00080000:2.0:1783444397.864244:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969452 is committed 00010000:00010000:1.0:1783444398.049089:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444398.159862:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444398.159906:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444398.159926:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444398.159948:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444398.159978:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444398.160003:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557796480 00000100:00100000:3.0:1783444398.160012:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557796480 00000100:00100000:3.0:1783444398.160058:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:3.0:1783444398.160068:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557796480:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444398.160136:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557796480:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 69us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444398.160143:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:3.0:1783444398.160174:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557796608 00000100:00100000:3.0:1783444398.160178:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557796608 00000100:00100000:3.0:1783444398.160211:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557796736 00000100:00100000:3.0:1783444398.160214:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557796736 00000100:00100000:3.0:1783444398.160235:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1006 00000100:00100000:3.0:1783444398.160242:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2404:x1870073557796608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444398.160271:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2404:x1870073557796608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444398.160277:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1006 00000100:00100000:3.0:1783444398.160289:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1007 00000100:00100000:3.0:1783444398.160294:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557796736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444398.160329:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557796736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444398.160335:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1007 00000100:00100000:3.0:1783444398.160472:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557796992 00000100:00100000:3.0:1783444398.160477:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557796992 00000100:00100000:3.0:1783444398.160540:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557796864 00000100:00100000:3.0:1783444398.160544:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557796864 00000100:00100000:0.0:1783444398.160995:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2430 00000100:00100000:0.0:1783444398.161005:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2403:x1870073557796992:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444398.161036:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2403:x1870073557796992:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 34us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444398.161042:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2430 00000100:00100000:0.0:1783444398.161056:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2431 00000100:00100000:0.0:1783444398.161063:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557796864:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444398.161085:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557796864:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444398.161100:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2431 00000100:00080000:0.0:1783444398.162280:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444398.162287:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444398.162290:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444398.162293:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444398.877610:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444398.877631:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575322880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444398.877692:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444398.877730:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575322880 00000100:00100000:3.0:1783444398.877736:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575322880 00000100:00100000:3.0:1783444398.877783:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1783444398.877812:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575322880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444398.877831:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444398.877867:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575322880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444398.877873:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00080000:3.0:1783444398.877891:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444398.877921:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575322880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444398.888387:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575323008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444398.888475:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444398.888556:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575323008 00000100:00100000:1.0:1783444398.888563:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575323008 00000100:00100000:1.0:1783444398.888623:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:1.0:1783444398.888632:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575323008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444398.888654:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:0.0:1783444398.889019:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444398.895223:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575323008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6581us (6738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444398.895254:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1783444398.901610:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575323008:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783444399.077572:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444400.093283:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444401.119863:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444401.951234:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575323136:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.951411:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.951455:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575323648:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.951488:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.951506:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575324160:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.951526:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.951540:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575324672:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.951561:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.951583:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783444401.951589:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575323520:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.951609:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.951632:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575324032:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.951654:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.951675:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575324544:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.951695:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.951721:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575323264:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.951745:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.951760:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575323776:0@lo:400:kworker.0 00000100:00100000:3.0:1783444401.952365:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575324032 00000100:00100000:3.0:1783444401.952374:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575324032 00000100:00100000:3.0:1783444401.952428:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575324544 00000100:00100000:0.0:1783444401.952435:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444401.952441:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575324544 00000100:00100000:0.0:1783444401.952465:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575324288:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.952492:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.952514:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783444401.952520:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575323392:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.952552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.952571:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575323904:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.952591:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.952608:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575324416:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.952629:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444401.952659:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575323136 00000100:00100000:3.0:1783444401.952662:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575323904 00000100:00100000:0.0:1783444401.952664:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575323136 00000100:00100000:3.0:1783444401.952669:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575323904 00000100:00100000:0.0:1783444401.952703:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783444401.952704:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575324416 00000100:00100000:3.0:1783444401.952708:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575324416 00000100:00100000:0.0:1783444401.952714:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575323136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444401.952735:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:3.0:1783444401.952745:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575324032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.952776:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575323136:12345-0@lo:400:kworker.0 Request processed in 64us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.952785:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783444401.952844:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575323648 00000100:00100000:0.0:1783444401.952848:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575323648 00000100:00100000:0.0:1783444401.952867:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575324160 00000100:00100000:0.0:1783444401.952869:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575324160 00000100:00100000:0.0:1783444401.952880:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575324672 00000100:00100000:0.0:1783444401.952882:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575324672 00000100:00100000:0.0:1783444401.952892:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575323520 00000100:00100000:0.0:1783444401.952895:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575323520 00000100:00100000:0.0:1783444401.952904:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575323264 00000100:00100000:0.0:1783444401.952906:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575323264 00000100:00100000:0.0:1783444401.952915:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575323392 00000100:00100000:0.0:1783444401.952923:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575323392 00000100:00100000:0.0:1783444401.952939:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1783444401.952944:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575323648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444401.953138:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444401.953148:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575324800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444401.953925:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:2.0:1783444401.953939:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575324544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.956653:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575323648:12345-0@lo:400:kworker.0 Request processed in 3698us (5154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.956668:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1783444401.956766:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1783444401.956778:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575324160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.956899:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575324160:12345-0@lo:400:kworker.0 Request processed in 125us (5370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.956905:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1783444401.956918:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1783444401.956924:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575324672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.956964:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575324672:12345-0@lo:400:kworker.0 Request processed in 40us (5403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.956971:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1783444401.956984:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1783444401.956991:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575323520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957020:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575323520:12345-0@lo:400:kworker.0 Request processed in 30us (5409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.957025:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1783444401.957037:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1783444401.957043:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575323264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957070:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575323264:12345-0@lo:400:kworker.0 Request processed in 28us (5325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.957091:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1783444401.957104:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1783444401.957112:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575323392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957143:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575323392:12345-0@lo:400:kworker.0 Request processed in 32us (4590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.957149:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00080000:0.0:1783444401.957193:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444401.957198:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444401.957202:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444401.957205:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444401.957220:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575323776 00000100:00100000:0.0:1783444401.957228:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575323776 00000100:00100000:0.0:1783444401.957269:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575324288 00000100:00100000:0.0:1783444401.957272:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575324288 00000100:00100000:0.0:1783444401.957403:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:0.0:1783444401.957416:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575323776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957453:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575323776:12345-0@lo:400:kworker.0 Request processed in 40us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.957460:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:0.0:1783444401.957473:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1783444401.957478:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575324288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957507:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575324288:12345-0@lo:400:kworker.0 Request processed in 29us (5015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.957513:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1783444401.957545:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:0.0:1783444401.957553:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575323904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957597:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575323904:12345-0@lo:400:kworker.0 Request processed in 45us (5005us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.957603:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00100000:0.0:1783444401.957618:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435 00000100:00100000:0.0:1783444401.957625:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575324416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957655:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575324416:12345-0@lo:400:kworker.0 Request processed in 31us (5025us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.957660:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435 00000100:00100000:0.0:1783444401.957711:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575323520:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957725:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575324032:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957736:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575323136:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957746:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575323648:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957754:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575324160:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957764:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575324672:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957962:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575323392:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957974:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575323904:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.957983:0:3633:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969452 gen 2 00000100:00100000:0.0:1783444401.957996:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575324416:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.958006:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575323264:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.958015:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575323776:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.958037:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575324288:0@lo:400:kworker.0 00000100:00100000:1.0:1783444401.958126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444401.958146:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575324544:12345-0@lo:400:kworker.0 Request processed in 4211us (6448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444401.958157:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1783444401.959196:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 2 00000100:00100000:1.0:1783444401.959216:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575324544:0@lo:400:kworker.0 00000100:00100000:0.0:1783444401.961505:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575324800 00000100:00100000:0.0:1783444401.961521:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575324800 00000100:00100000:0.0:1783444401.961596:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:0.0:1783444401.961607:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575324800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444401.961651:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:0.0:1783444401.961730:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575324800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (3603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444401.961738:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:3.0:1783444401.961769:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575324032:12345-0@lo:400:kworker.0 Request processed in 9024us (10111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444401.961780:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:1.0:1783444401.961877:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575324800:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1783444402.088677:0:91574:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:1.0:1783444402.140996:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444402.466751:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575324928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444402.466876:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444402.466936:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575324928 00000100:00100000:0.0:1783444402.466943:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575324928 00000100:00100000:0.0:1783444402.466993:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1783444402.467002:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575324928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783444402.467042:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444835328 avail 1298595840 00000100:00100000:0.0:1783444402.467090:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575324928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444402.467097:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1783444402.467148:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575324928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444402.468452:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444402.468466:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575325056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444402.468512:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444402.468630:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575325056 00000100:00100000:3.0:1783444402.468636:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575325056 00000100:00100000:3.0:1783444402.468675:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:3.0:1783444402.468683:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575325056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444402.468707:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444402.468749:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575325056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444402.468757:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:1.0:1783444402.468828:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575325184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444402.468860:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444402.468897:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575325056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444402.469377:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575325184 00000100:00100000:3.0:1783444402.469382:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575325184 00000100:00100000:3.0:1783444402.469417:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1783444402.469425:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575325184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444402.469444:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444402.469486:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575325184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444402.469493:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1783444402.469535:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575325184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783444403.165272:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444403.285697:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444403.285750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444403.287733:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557797120 00000100:00100000:2.0:1783444403.287756:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557797120 00000100:00100000:2.0:1783444403.287901:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:2.0:1783444403.287915:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557797120:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444403.288016:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557797120:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 104us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444403.288024:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:0.0:1783444403.288936:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557797248 00000100:00100000:0.0:1783444403.288944:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557797248 00000100:00100000:0.0:1783444403.289013:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1014 00000100:00100000:0.0:1783444403.289024:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2403:x1870073557797248:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444403.289095:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2403:x1870073557797248:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (3409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444403.289115:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1014 00000100:00080000:2.0:1783444403.292023:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444403.306714:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444403.306755:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444403.307180:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557797504 00000100:00100000:2.0:1783444403.307191:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557797504 00000100:00100000:2.0:1783444403.307276:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2436 00000100:00100000:2.0:1783444403.307288:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557797504:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444403.307382:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557797504:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444403.307390:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2436 00000100:00100000:0.0:1783444403.308926:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557797376 00000100:00100000:0.0:1783444403.308938:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557797376 00000100:00100000:0.0:1783444403.309004:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1015 00000100:00100000:0.0:1783444403.309013:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557797376:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444403.309401:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557797376:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 387us (2697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444403.309409:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1015 00000100:00080000:3.0:1783444403.310196:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444403.310204:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444403.314912:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444403.315068:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557797632 00000100:00100000:2.0:1783444403.315089:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557797632 00000100:00100000:2.0:1783444403.315168:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2437 00000100:00100000:2.0:1783444403.315181:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557797632:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444403.315273:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557797632:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 95us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444403.315314:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2437 00000100:00080000:3.0:1783444403.316174:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444403.997666:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575325312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444403.997744:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444403.997842:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575325440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444403.998185:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575325312 00000100:00100000:3.0:1783444403.998194:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575325312 00000100:00100000:1.0:1783444403.998252:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444403.998305:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575325440 00000100:00100000:1.0:1783444403.998309:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575325440 00000100:00100000:3.0:1783444403.998412:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1783444403.998422:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575325312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444403.998451:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444403.998503:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575325312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444403.998511:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:0.0:1783444403.998549:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575325312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444403.998698:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:1.0:1783444403.998706:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575325440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444403.998723:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444403.998775:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575325440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444403.998783:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:0.0:1783444403.998835:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575325440:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783444403.998888:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444403.998892:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783444404.192459:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783444404.532342:0:91622:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1783444405.214570:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444406.258586:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444406.560129:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444406.560915:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557797760 00000100:00100000:0.0:1783444406.560926:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557797760 00000100:00100000:0.0:1783444406.561020:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1278 00000100:00100000:0.0:1783444406.561031:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70326:x1870073557797760:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1783444406.561077:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444835328 avail 1298595840 00000100:00100000:0.0:1783444406.561144:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70326:x1870073557797760:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 115us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444406.561152:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1278 00000100:00080000:3.0:1783444406.561492:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444406.570544:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444406.571182:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557797888 00000100:00100000:0.0:1783444406.571202:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557797888 00000100:00100000:0.0:1783444406.571288:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1279 00000100:00100000:0.0:1783444406.571299:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:70326:x1870073557797888:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1783444406.571351:0:66226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:0.0:1783444406.571432:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+6:70326:x1870073557797888:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 133us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444406.571440:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1279 00000100:00080000:3.0:1783444406.571513:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444406.575682:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444406.576023:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557798016 00000100:00100000:0.0:1783444406.576037:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557798016 00000100:00100000:0.0:1783444406.576142:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1930 00000100:00100000:0.0:1783444406.576156:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:70326:x1870073557798016:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1783444406.576212:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444406.576314:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+6:70326:x1870073557798016:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 160us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444406.576323:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1930 00000100:00080000:3.0:1783444406.576918:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444406.580242:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444406.580357:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557798144 00000100:00100000:1.0:1783444406.580367:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557798144 00000100:00100000:1.0:1783444406.580442:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1931 00000100:00100000:1.0:1783444406.580452:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+7:70326:x1870073557798144:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:1.0:1783444406.580485:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444406.580562:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:778015c5-4969-44f5-82a5-0f6eadd152d5+7:70326:x1870073557798144:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444406.580576:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1931 00000100:00080000:3.0:1783444406.581813:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444406.659526:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444406.660004:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557798400 00000100:00100000:1.0:1783444406.660016:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557798400 00000100:00100000:1.0:1783444406.660088:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1280 00000100:00100000:1.0:1783444406.660100:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70343:x1870073557798400:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444406.660124:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444406.660148:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3832a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939be5 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660256:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660272:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660284:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660317:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660326:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660333:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660426:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660434:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660441:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660448:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444406.660453:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660461:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660473:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:1.0:1783444406.660477:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444406.660481:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660488:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832a8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660506:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660512:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660518:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660524:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444406.660527:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660534:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660542:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9367cd15cd00) 00010000:00010000:1.0:1783444406.660544:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444406.660547:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660553:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832a94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660584:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3832a86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939be5 expref: 9 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660594:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:1.0:1783444406.660596:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444406.660607:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3832a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939be5 expref: 9 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.660618:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757a00, rc 0) 00000100:00100000:1.0:1783444406.666905:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70343:x1870073557798400:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3090us (3671us total) trans 0 rc 301/301 00000100:00100000:1.0:1783444406.666921:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1280 00000100:00100000:2.0:1783444406.684920:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444406.686169:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557798528 00000100:00100000:0.0:1783444406.686194:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557798528 00000100:00100000:0.0:1783444406.686332:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1281 00000100:00100000:0.0:1783444406.686343:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70343:x1870073557798528:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1783444406.686426:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686443:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686455:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686471:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686496:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686502:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686588:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686597:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686620:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444406.686667:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1783444406.686672:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444406.686682:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686697:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686704:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686711:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686719:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686736:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444406.686741:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686750:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686763:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:0.0:1783444406.686766:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444406.686771:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686778:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686848:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686856:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686862:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686869:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444406.686872:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686879:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686896:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9368d4c9a800) 00010000:00010000:0.0:1783444406.686899:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444406.686902:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686907:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832aa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686922:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686929:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686935:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686940:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444406.686943:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686949:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686956:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:0.0:1783444406.686958:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444406.686961:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.686966:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832aa9 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444406.689412:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70343:x1870073557798528:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1837us (3269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444406.689438:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1281 00000100:00100000:3.0:1783444406.787484:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444406.794353:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557798784 00000100:00100000:0.0:1783444406.794373:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557798784 00000100:00100000:0.0:1783444406.794475:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1282 00000100:00100000:0.0:1783444406.794488:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70347:x1870073557798784:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444406.794517:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444406.794544:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bec expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.794661:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.794676:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.794696:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.794713:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.794729:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.794737:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795085:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795094:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795100:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795107:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795112:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444406.795117:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795125:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795139:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:0.0:1783444406.795142:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444406.795147:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795154:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795168:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795175:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795187:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795193:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444406.795345:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795353:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795361:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9368d4c9a800) 00010000:00010000:0.0:1783444406.795364:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444406.795366:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795372:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832abe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795412:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ab0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bec expref: 9 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795424:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:0.0:1783444406.795426:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783444406.795430:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bec expref: 9 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.795440:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751200, rc 0) 00000100:00100000:0.0:1783444406.795509:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70347:x1870073557798784:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1023us (8037us total) trans 0 rc 301/301 00000100:00100000:0.0:1783444406.795525:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1282 00000100:00100000:3.0:1783444406.806220:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444406.806348:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557798912 00000100:00100000:0.0:1783444406.806359:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557798912 00000100:00100000:0.0:1783444406.806433:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1283 00000100:00100000:0.0:1783444406.806446:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70347:x1870073557798912:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1783444406.806547:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.806568:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.806582:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.806609:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.806618:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.806625:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807023:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807034:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807041:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444406.807100:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1783444406.807105:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444406.807119:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807137:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807144:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807150:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807156:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807163:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444406.807168:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807177:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807192:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:0.0:1783444406.807196:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444406.807202:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807209:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807248:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807256:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807262:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807268:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444406.807271:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807278:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807286:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9368d4c9a800) 00010000:00010000:0.0:1783444406.807288:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444406.807292:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807298:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832acc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807310:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807317:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807323:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807335:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444406.807338:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807345:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807353:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:0.0:1783444406.807355:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444406.807358:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444406.807364:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832ad3 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444406.807466:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70347:x1870073557798912:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1020us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444406.807475:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1283 00000100:00100000:2.0:1783444406.907057:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444406.907171:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557799168 00000100:00100000:1.0:1783444406.907184:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557799168 00000100:00100000:1.0:1783444406.907262:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1284 00000100:00100000:1.0:1783444406.907273:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70355:x1870073557799168:12345-192.168.204.20@tcp:101:md5sum.0 00010000:00010000:1.0:1783444406.907296:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444406.907317:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3832ada lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bf3 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.907409:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.907428:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.907441:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.907455:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.907463:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.907470:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909082:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3832aef lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909102:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3832aef lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909113:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3832aef lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444406.909128:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1783444406.909283:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909292:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909299:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909305:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909310:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444406.909314:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909322:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909334:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:1.0:1783444406.909337:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444406.909357:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909363:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3832ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909378:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909385:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909391:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909395:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444406.909397:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909402:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909410:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9367cd15cd00) 00010000:00010000:1.0:1783444406.909413:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444406.909416:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909422:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3832ae8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909485:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3832ada lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bf3 expref: 11 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909525:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3832aef lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bf3 expref: 10 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444406.909533:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:1.0:1783444406.909536:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444406.909538:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10000, rc 0) 00000100:00100000:1.0:1783444406.909621:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:70355:x1870073557799168:12345-192.168.204.20@tcp:101:md5sum.0 Request processed in 2348us (2574us total) trans 115964116993 rc 0/0 00000100:00100000:1.0:1783444406.909631:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1284 00000100:00100000:3.0:1783444406.945013:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444406.946496:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557799296 00000100:00100000:2.0:1783444406.946514:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557799296 00002000:00100000:2.0:1783444406.946587:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff9367c5801880 x1870073557799296/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:27/0 lens 488/0 e 0 to 0 dl 1783444417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783444406.946612:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5801880 with x1870073557799296 ext(0->32767) 00002000:00010000:2.0:1783444406.946629:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9367c5801880 00000100:00100000:2.0:1783444406.946677:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1005 00000100:00100000:2.0:1783444406.946697:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557799296:12345-192.168.204.20@tcp:3:md5sum.0 00000100:00100000:2.0:1783444406.963317:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557799296:12345-192.168.204.20@tcp:3:md5sum.0 Request processed in 16619us (18309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444406.963333:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1005 00002000:00100000:2.0:1783444406.963346:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff9367c5801880 x1870073557799296/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:27/0 lens 488/440 e 0 to 0 dl 1783444417 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783444406.963356:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5801880 with x1870073557799296 ext(0->32767) 00002000:00010000:2.0:1783444406.963362:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9367c5801880 00000100:00100000:3.0:1783444406.993367:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444406.993496:0:24882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557799424 00000100:00100000:1.0:1783444406.993506:0:24882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557799424 00002000:00100000:1.0:1783444406.993555:0:24882:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff9367c5803b80 x1870073557799424/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:27/0 lens 488/0 e 0 to 0 dl 1783444417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444406.993567:0:24882:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5803b80 with x1870073557799424 ext(32768->1048575) 00002000:00010000:1.0:1783444406.993573:0:24882:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9367c5803b80 00000100:00100000:1.0:1783444406.993617:0:24882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1006 00000100:00100000:1.0:1783444406.993636:0:24882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2402:x1870073557799424:12345-192.168.204.20@tcp:3:md5sum.0 00000100:00100000:3.0:1783444406.995006:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444406.995324:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557799552 00000100:00100000:1.0:1783444406.995333:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557799552 00002000:00100000:1.0:1783444406.995368:0:25160:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff9368e68f7100 x1870073557799552/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:27/0 lens 488/0 e 0 to 0 dl 1783444417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444406.995380:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68f7100 with x1870073557799552 ext(1048576->2097151) 00002000:00010000:1.0:1783444406.995384:0:25160:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68f7100 00000100:00100000:1.0:1783444406.995415:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1007 00000100:00100000:1.0:1783444406.995433:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557799552:12345-192.168.204.20@tcp:3:md5sum.0 00000100:00100000:3.0:1783444406.998047:0:24882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2402:x1870073557799424:12345-192.168.204.20@tcp:3:md5sum.0 Request processed in 4387us (4663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444406.998064:0:24882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1006 00002000:00100000:3.0:1783444406.998077:0:24882:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff9367c5803b80 x1870073557799424/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:27/0 lens 488/440 e 0 to 0 dl 1783444417 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444406.998089:0:24882:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5803b80 with x1870073557799424 ext(32768->1048575) 00002000:00010000:3.0:1783444406.998095:0:24882:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9367c5803b80 00000100:00100000:3.0:1783444407.069073:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444407.069100:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575325568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444407.069174:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444407.069485:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575325568 00000100:00100000:2.0:1783444407.069493:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575325568 00000100:00100000:2.0:1783444407.069566:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1783444407.069576:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575325568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444407.069619:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1783444407.069678:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575325568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444407.069686:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1783444407.069762:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575325568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444407.070319:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575325952:0@lo:400:kworker.0 00000100:00100000:0.0:1783444407.070357:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444407.070378:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575326464:0@lo:400:kworker.0 00000100:00100000:0.0:1783444407.070402:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444407.070420:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575326976:0@lo:400:kworker.0 00000100:00100000:0.0:1783444407.070439:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444407.070455:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783444407.070461:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575325824:0@lo:400:kworker.0 00000100:00100000:0.0:1783444407.070482:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444407.070510:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575326336:0@lo:400:kworker.0 00000100:00100000:0.0:1783444407.070529:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444407.070545:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575326848:0@lo:400:kworker.0 00000100:00100000:0.0:1783444407.070567:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444407.070592:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575325952 00000100:00100000:0.0:1783444407.070597:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575325952 00000100:00100000:0.0:1783444407.070639:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575325824 00000100:00100000:0.0:1783444407.070642:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575325824 00000100:00100000:0.0:1783444407.070665:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1783444407.070673:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575325952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444407.071714:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575326336 00000100:00100000:1.0:1783444407.071731:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575326336 00000100:00100000:1.0:1783444407.071770:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1783444407.071778:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575326336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444407.071852:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575326336:12345-0@lo:400:kworker.0 Request processed in 74us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444407.071860:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1783444407.071889:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575326464 00000100:00100000:1.0:1783444407.071893:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575326464 00000100:00100000:1.0:1783444407.071921:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575326976 00000100:00100000:1.0:1783444407.071924:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575326976 00000100:00100000:1.0:1783444407.071940:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575326848 00000100:00100000:1.0:1783444407.071943:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575326848 00000100:00100000:1.0:1783444407.071964:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1783444407.071970:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575326464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444407.071999:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575326464:12345-0@lo:400:kworker.0 Request processed in 30us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444407.072004:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1783444407.072015:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1783444407.072020:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575326976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444407.072577:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575326976:12345-0@lo:400:kworker.0 Request processed in 556us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444407.072584:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1783444407.072610:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:1.0:1783444407.072618:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575326848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444407.072681:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575326848:12345-0@lo:400:kworker.0 Request processed in 64us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444407.072699:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00100000:2.0:1783444407.073876:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575325696:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.073942:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444407.073997:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575326208:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074036:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444407.074058:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575326720:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074079:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444407.074103:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783444407.074110:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575326080:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074130:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444407.074140:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575326592:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074162:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444407.074191:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575327104:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444407.074259:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575326592 00000100:00100000:2.0:1783444407.074265:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575326592 00000100:00100000:2.0:1783444407.074305:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441 00000100:00100000:2.0:1783444407.074313:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575326592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074361:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575326592:12345-0@lo:400:kworker.0 Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444407.074378:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441 00000100:00100000:2.0:1783444407.074426:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575326592:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074454:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575326208 00000100:00100000:2.0:1783444407.074457:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575326208 00000100:00100000:2.0:1783444407.074481:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575326720 00000100:00100000:2.0:1783444407.074483:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575326720 00000100:00100000:2.0:1783444407.074494:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575326080 00000100:00100000:2.0:1783444407.074496:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575326080 00000100:00100000:2.0:1783444407.074508:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575327104 00000100:00100000:2.0:1783444407.074510:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575327104 00000100:00100000:2.0:1783444407.074521:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1783444407.074527:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575325824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074563:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575325824:12345-0@lo:400:kworker.0 Request processed in 36us (4080us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444407.074569:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1783444407.074581:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1783444407.074586:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575326208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074632:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575326208:12345-0@lo:400:kworker.0 Request processed in 45us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444407.074638:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1783444407.074662:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575326208:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074679:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1783444407.074685:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575326720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074727:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575326720:12345-0@lo:400:kworker.0 Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444407.074735:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1783444407.074764:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575326720:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074780:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1783444407.074830:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575326080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074863:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575326080:12345-0@lo:400:kworker.0 Request processed in 77us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444407.074869:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1783444407.074892:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575326080:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074909:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1783444407.074916:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575327104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.074947:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575327104:12345-0@lo:400:kworker.0 Request processed in 31us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444407.074953:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1783444407.074975:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575327104:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.075043:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575325824:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.075057:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575326336:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.075069:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575326848:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.075082:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575326464:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.075093:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575326976:0@lo:400:kworker.0 00000100:00080000:2.0:1783444407.075127:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444407.075131:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444407.075135:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444407.075137:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444407.075288:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575325952:12345-0@lo:400:kworker.0 Request processed in 4615us (4929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444407.075296:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1783444407.077768:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575325696 00000100:00100000:3.0:1783444407.077783:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575325696 00000100:00100000:3.0:1783444407.077862:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783444407.077872:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f988f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575325696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444407.077954:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f988f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575325696:12345-0@lo:400:kworker.0 Request processed in 83us (4011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444407.077961:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783444407.078021:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575325696:0@lo:400:kworker.0 00000100:00100000:2.0:1783444407.079844:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575325952:0@lo:400:kworker.0 00000100:00100000:3.0:1783444407.080066:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2401:x1870073557799552:12345-192.168.204.20@tcp:3:md5sum.0 Request processed in 84631us (85063us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1783444407.080078:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1007 00002000:00100000:3.0:1783444407.080091:0:25160:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff9368e68f7100 x1870073557799552/t0(0) o3->778015c5-4969-44f5-82a5-0f6eadd152d5@192.168.204.20@tcp:27/0 lens 488/440 e 0 to 0 dl 1783444417 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444407.080103:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68f7100 with x1870073557799552 ext(1048576->2097151) 00002000:00010000:3.0:1783444407.080116:0:25160:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68f7100 00000100:00100000:1.0:1783444407.111231:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444407.111384:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557799808 00000100:00100000:2.0:1783444407.111394:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557799808 00000100:00100000:2.0:1783444407.111450:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 230 00000100:00100000:2.0:1783444407.111460:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:70355:x1870073557799808:12345-192.168.204.20@tcp:35:md5sum.0 00000100:00100000:2.0:1783444407.111822:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+11:70355:x1870073557799808:12345-192.168.204.20@tcp:35:md5sum.0 Request processed in 328us (574us total) trans 115964116994 rc 0/0 00000100:00100000:2.0:1783444407.111831:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 230 00010000:00010000:1.0:1783444407.265349:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444407.581345:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444407.581367:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575327232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444407.581441:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444407.581551:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575327232 00000100:00100000:1.0:1783444407.581559:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575327232 00000100:00100000:1.0:1783444407.581612:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:1.0:1783444407.581622:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575327232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444407.581658:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444407.581705:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575327232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444407.581711:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1783444407.581785:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575327360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444407.581836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444407.581862:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444407.581868:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575327488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444407.581894:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444407.581921:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575327488 00000100:00100000:3.0:1783444407.581924:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575327488 00000100:00100000:3.0:1783444407.581953:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:3.0:1783444407.581961:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575327488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444407.581986:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444835328 avail 1298595840 00000100:00100000:3.0:1783444407.582019:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575327488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444407.582026:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:3.0:1783444407.582064:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575327488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444407.582334:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575327360 00000100:00100000:1.0:1783444407.582339:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575327360 00000100:00100000:1.0:1783444407.582372:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1783444407.582379:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575327360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444407.582391:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444407.582429:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575327360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444407.582436:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1783444407.582462:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575327360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444407.582546:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575327232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783444408.286621:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444408.403376:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444408.403417:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557800064 00000100:00100000:0.0:1783444408.403427:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557800064 00000100:00100000:0.0:1783444408.403503:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1022 00000100:00100000:0.0:1783444408.403513:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2403:x1870073557800064:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444408.403613:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2403:x1870073557800064:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444408.403620:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1022 00000100:00080000:0.0:1783444408.403642:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444408.405063:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444408.411551:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557800320 00000100:00100000:3.0:1783444408.411567:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557800320 00000100:00100000:3.0:1783444408.412041:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2442 00000100:00100000:3.0:1783444408.412054:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557800320:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444408.412127:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557800320:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (7071us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444408.412134:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2442 00000100:00080000:2.0:1783444408.424665:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444408.427831:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444408.427880:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444408.427917:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444408.427922:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557800192 00000100:00100000:2.0:1783444408.427934:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557800192 00000100:00100000:1.0:1783444408.427960:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557799936 00000100:00100000:1.0:1783444408.427965:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557799936 00000100:00100000:2.0:1783444408.428007:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1023 00000100:00100000:2.0:1783444408.428019:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557800192:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444408.428099:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2403:x1870073557800192:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444408.428106:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1023 00000100:00080000:2.0:1783444408.428130:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444408.430381:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:1.0:1783444408.430391:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557799936:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444408.430465:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557799936:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (2646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444408.430472:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:1.0:1783444408.430516:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557800448 00000100:00100000:1.0:1783444408.430522:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557800448 00000100:00100000:1.0:1783444408.430563:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2443 00000100:00100000:1.0:1783444408.430569:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2403:x1870073557800448:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444408.432042:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2403:x1870073557800448:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 1019us (3670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444408.432056:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2443 00000100:00080000:1.0:1783444408.432088:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444409.126810:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575327744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444409.126887:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444409.126961:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575327744 00000100:00100000:3.0:1783444409.126983:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575327744 00000100:00100000:3.0:1783444409.127041:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1783444409.127052:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575327744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444409.127085:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444409.127132:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575327744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444409.127139:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00080000:3.0:1783444409.127160:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444409.127209:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575327744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444409.134337:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444409.134368:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575327616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444409.134442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444409.134506:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575327616 00000100:00100000:2.0:1783444409.134514:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575327616 00000100:00100000:2.0:1783444409.134574:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1783444409.134584:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575327616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444409.134621:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444409.134668:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575327616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444409.134694:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00080000:2.0:1783444409.134718:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444409.134763:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575327616:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783444409.309067:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444410.333053:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444411.359333:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444412.189518:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575327872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444412.189612:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.189894:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575327872 00000100:00100000:3.0:1783444412.189903:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575327872 00000100:00100000:3.0:1783444412.189958:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1783444412.189967:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575327872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444412.190003:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:1.0:1783444412.190091:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575328000:0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.190140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444412.190176:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444412.190183:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575328128:0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.190208:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444412.194260:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575328512:0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444412.194401:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575329024:0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194425:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444412.194466:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783444412.194476:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575328640:0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194505:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444412.194528:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575329152:0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194551:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444412.194590:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575328128 00000100:00100000:1.0:1783444412.194599:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575328128 00000100:00100000:1.0:1783444412.194658:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575328512 00000100:00100000:1.0:1783444412.194662:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575328512 00000100:00100000:1.0:1783444412.194680:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575329024 00000100:00100000:1.0:1783444412.194682:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575329024 00000100:00100000:1.0:1783444412.194700:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1783444412.194708:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575328128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194763:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575328128:12345-0@lo:400:kworker.0 Request processed in 55us (4553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444412.194770:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1783444412.194810:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1783444412.194817:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575328512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194844:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575328512:12345-0@lo:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444412.194850:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1783444412.194862:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1783444412.194867:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575329024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194893:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575329024:12345-0@lo:400:kworker.0 Request processed in 26us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444412.194899:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1783444412.194948:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575328512:0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194970:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575329024:0@lo:400:kworker.0 00000100:00100000:1.0:1783444412.194980:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575328128:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195208:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575327872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5239us (5594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.195218:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1783444412.195237:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575328640 00000100:00100000:3.0:1783444412.195241:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575328640 00000100:00100000:3.0:1783444412.195276:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:3.0:1783444412.195283:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575328640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195321:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575328640:12345-0@lo:400:kworker.0 Request processed in 40us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.195327:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:3.0:1783444412.195348:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575328256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195375:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.195405:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575328768:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195428:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.195445:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575329280:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195466:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.195487:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783444412.195494:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575328384:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195513:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.195529:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575328896:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195549:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.195567:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575329408:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195587:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.195613:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575328000 00000100:00100000:3.0:1783444412.195617:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575328000 00000100:00100000:3.0:1783444412.195645:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783444412.195652:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575328000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195685:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575328000:12345-0@lo:400:kworker.0 Request processed in 34us (5543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.195690:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783444412.195724:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575329152 00000100:00100000:3.0:1783444412.195727:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575329152 00000100:00100000:3.0:1783444412.195757:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575328768 00000100:00100000:3.0:1783444412.195760:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575328768 00000100:00100000:3.0:1783444412.195780:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575329280 00000100:00100000:3.0:1783444412.195782:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575329280 00000100:00100000:3.0:1783444412.195832:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575328896 00000100:00100000:3.0:1783444412.195836:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575328896 00000100:00100000:3.0:1783444412.195856:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:3.0:1783444412.195863:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575329152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195903:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575329152:12345-0@lo:400:kworker.0 Request processed in 41us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.195909:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:3.0:1783444412.195920:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:3.0:1783444412.195925:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575328768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195952:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575328768:12345-0@lo:400:kworker.0 Request processed in 28us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.195957:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:3.0:1783444412.195966:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:3.0:1783444412.195972:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575329280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.195995:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575329280:12345-0@lo:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.196001:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:3.0:1783444412.196011:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447 00000100:00100000:3.0:1783444412.196017:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575328896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196040:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575328896:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.196046:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447 00000100:00100000:3.0:1783444412.196080:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575328640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196091:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575329152:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196099:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575328000:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196137:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575328256 00000100:00100000:3.0:1783444412.196141:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575328256 00000100:00100000:3.0:1783444412.196168:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575328384 00000100:00100000:3.0:1783444412.196176:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575328384 00000100:00100000:3.0:1783444412.196195:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575329408 00000100:00100000:3.0:1783444412.196197:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575329408 00000100:00100000:3.0:1783444412.196208:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1783444412.196213:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575328256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196242:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575328256:12345-0@lo:400:kworker.0 Request processed in 29us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.196248:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1783444412.196257:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1783444412.196262:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575328384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196284:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575328384:12345-0@lo:400:kworker.0 Request processed in 22us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.196288:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1783444412.196298:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1783444412.196304:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575329408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196327:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575329408:12345-0@lo:400:kworker.0 Request processed in 24us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.196332:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1783444412.196382:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575328384:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196391:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575328896:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196399:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575329408:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196407:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575328256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196415:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575328768:0@lo:400:kworker.0 00000100:00100000:3.0:1783444412.196423:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575329280:0@lo:400:kworker.0 00000100:00100000:2.0:1783444412.196611:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575327872:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783444412.196634:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444412.196638:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444412.196641:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444412.196643:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783444412.381185:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444412.701146:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575329536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444412.701215:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.701281:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575329536 00000100:00100000:3.0:1783444412.701290:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575329536 00000100:00100000:3.0:1783444412.701338:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1783444412.701347:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575329536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444412.701379:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444412.701422:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575329536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.701429:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1783444412.701476:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575329536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444412.702517:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575329664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444412.702874:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575329792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444412.702923:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.702964:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575329792 00000100:00100000:3.0:1783444412.702971:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575329792 00000100:00100000:3.0:1783444412.703005:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:3.0:1783444412.703013:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575329792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444412.703037:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444412.703077:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575329792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.703083:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:3.0:1783444412.703135:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575329792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444412.703451:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444412.707001:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575329664 00000100:00100000:3.0:1783444412.707016:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575329664 00000100:00100000:3.0:1783444412.707353:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:3.0:1783444412.707375:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575329664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444412.707416:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444835328 avail 1298595840 00000001:00080000:2.0:1783444412.707434:0:90990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00000100:00100000:3.0:1783444412.707505:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575329664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (4053us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444412.707512:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:2.0:1783444412.707573:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575329664:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783444413.405630:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444413.518909:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444413.519149:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444413.519196:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444413.519231:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444413.519312:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557800960 00000100:00100000:2.0:1783444413.519327:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557800960 00000100:00100000:2.0:1783444413.519424:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2448 00000100:00100000:2.0:1783444413.519437:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557800960:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444413.519533:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557800960:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 99us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444413.519541:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2448 00000100:00080000:2.0:1783444413.519563:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444413.519729:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557800576 00000100:00100000:2.0:1783444413.519747:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557800576 00000100:00100000:2.0:1783444413.519778:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:2.0:1783444413.519786:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557800576:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444413.519845:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2404:x1870073557800576:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 60us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444413.519852:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1783444413.524875:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557800704 00000100:00100000:1.0:1783444413.524901:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557800704 00000100:00100000:3.0:1783444413.524967:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444413.525001:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557800832 00000100:00100000:1.0:1783444413.525006:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557800832 00000100:00100000:1.0:1783444413.525044:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1030 00000100:00100000:1.0:1783444413.525060:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2404:x1870073557800704:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444413.525067:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1031 00000100:00100000:3.0:1783444413.525087:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557800832:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444413.525106:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557801088 00000100:00100000:2.0:1783444413.525122:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557801088 00000100:00100000:3.0:1783444413.525193:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2404:x1870073557800832:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 111us (5959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444413.525201:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2449 00000100:00100000:3.0:1783444413.525217:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1031 00000100:00100000:2.0:1783444413.525227:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557801088:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1783444413.525307:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444413.525316:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444413.525318:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2404:x1870073557801088:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 98us (355us total) trans 0 rc 0/0 00000100:00080000:3.0:1783444413.525320:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444413.525333:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2449 00000100:00100000:1.0:1783444413.525614:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2404:x1870073557800704:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 556us (9073us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444413.525623:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1030 00000100:00100000:2.0:1783444414.237054:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575329920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444414.237149:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.237769:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575329920 00000100:00100000:3.0:1783444414.237778:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575329920 00000100:00100000:2.0:1783444414.237868:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444414.237878:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:2.0:1783444414.237878:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575330048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444414.237890:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575329920:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783444414.237890:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444414.237913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1783444414.237922:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444414.237986:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575329920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.237993:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:3.0:1783444414.238032:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575330048 00000100:00100000:3.0:1783444414.238036:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575330048 00000100:00080000:0.0:1783444414.238072:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444414.238105:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1783444414.238115:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575330048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444414.238130:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444414.238139:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575329920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444414.238165:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575330048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.238173:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:0.0:1783444414.238209:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575330048:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1783444414.336638:0:91817:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 13:13:34 (1783444414) 00010000:00010000:1.0:1783444414.428984:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444414.478767:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444414.479162:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557801344 00000100:00100000:3.0:1783444414.479173:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557801344 00000100:00100000:3.0:1783444414.479249:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1285 00000100:00100000:3.0:1783444414.479259:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+6:70925:x1870073557801344:12345-192.168.204.20@tcp:36:mkdir.0 00000100:00100000:3.0:1783444414.479378:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID:80475:1870073575330176:0@lo:900:mdt00_005.0 00000100:00100000:3.0:1783444414.479438:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.479475:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.479629:0:66693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575330176 00000100:00100000:0.0:1783444414.479634:0:66693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575330176 00000100:00100000:0.0:1783444414.479672:0:66693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783444414.479680:0:66693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ad0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:lustre-MDT0000-lwp-MDT0001_UUID+5:80475:x1870073575330176:12345-0@lo:900:mdt00_005.0 00000100:00100000:0.0:1783444414.479733:0:66693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ad0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:lustre-MDT0000-lwp-MDT0001_UUID+5:80475:x1870073575330176:12345-0@lo:900:mdt00_005.0 Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.479740:0:66693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783444414.480071:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID:80475:1870073575330176:0@lo:900:mdt00_005.0 00000100:00100000:3.0:1783444414.480144:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575330304:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783444414.480178:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.480283:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444414.480328:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575330304 00000100:00100000:1.0:1783444414.480333:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575330304 00000100:00100000:1.0:1783444414.480370:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1783444414.480378:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:80475:x1870073575330304:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444414.480484:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:80475:x1870073575330304:12345-0@lo:1000:mdt00_005.0 Request processed in 106us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444414.480491:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:3.0:1783444414.480537:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575330304:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783444414.480586:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575330432:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783444414.480608:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.480631:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.480676:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575330432 00000100:00100000:0.0:1783444414.480681:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575330432 00000100:00100000:0.0:1783444414.480744:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:0.0:1783444414.480752:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:80475:x1870073575330432:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.481359:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:80475:x1870073575330432:12345-0@lo:1000:mdt00_005.0 Request processed in 606us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.481367:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:3.0:1783444414.481432:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575330432:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783444414.481491:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575330560:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783444414.481516:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.481570:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444414.481611:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575330560 00000100:00100000:1.0:1783444414.481616:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575330560 00000100:00100000:1.0:1783444414.481680:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:1.0:1783444414.481688:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:80475:x1870073575330560:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444414.481770:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:80475:x1870073575330560:12345-0@lo:1000:mdt00_005.0 Request processed in 82us (252us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783444414.481810:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:0.0:1783444414.481877:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575330560:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1783444414.481950:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.481961:0:80475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.481971:0:80475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444414.481995:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575330688:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1783444414.482018:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444414.482041:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7512900 going to sleep for 11 seconds 00000100:00100000:1.0:1783444414.482102:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575330688 00000100:00100000:1.0:1783444414.482106:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575330688 00000100:00100000:1.0:1783444414.482135:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:1.0:1783444414.482142:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:80475:x1870073575330688:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783444414.482151:0:23687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444414.482166:0:23687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832afd expref: -99 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.482190:0:23687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 8 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.482201:0:23687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832afd expref: 7 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.482253:0:23687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 8 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.482267:0:23687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 8 pid: 80475 timeout: 3505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444414.482279:0:23687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23687:1870073575330816:192.168.204.20@tcp:104: 00000100:00100000:1.0:1783444414.482339:0:23687:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016e840 going to sleep for 11 seconds 00000100:00100000:1.0:1783444414.487128:0:23687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23687:1870073575330816:192.168.204.20@tcp:104: 00010000:00010000:1.0:1783444414.487166:0:23687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832afd expref: 7 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.487203:0:23687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:1.0:1783444414.487207:0:23687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444414.487211:0:23687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832afd expref: 7 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.487221:0:23687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10800, rc 0) 00000100:00100000:1.0:1783444414.487286:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:80475:x1870073575330688:12345-0@lo:101:mdt00_005.0 Request processed in 5143us (5265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444414.487294:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1783444414.487499:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444414.487546:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557801472 00000100:00100000:1.0:1783444414.487553:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557801472 00010000:00010000:1.0:1783444414.487805:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 9 pid: 80475 timeout: 3505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444414.487838:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2550 00000100:00100000:1.0:1783444414.487849:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+9:2404:x1870073557801472:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444414.487877:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444414.487884:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 9 pid: 80475 timeout: 3505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.487898:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 9 pid: 80475 timeout: 3505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.487922:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757c00/0x42cb6883e3832a7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bde expref: 9 pid: 80475 timeout: 3505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.487960:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:1.0:1783444414.487965:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832afd expref: 6 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.487975:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x42cb6883e3832afd expref: 6 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.487984:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x42cb6883e3832afd expref: 6 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.488017:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832afd expref: 6 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444414.488031:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6491:1870073575330944:0@lo:105: 00000100:00100000:1.0:1783444414.488068:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444414.488116:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016e840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444414.488198:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575330688:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783444414.488216:0:80475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.488227:0:80475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444414.490056:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575330944 00000100:00100000:0.0:1783444414.490071:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575330944 00000100:00100000:0.0:1783444414.490151:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1783444414.490161:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6491:x1870073575330944:12345-0@lo:105: 00010000:00010000:0.0:1783444414.490175:0:6489:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.490187:0:6489:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.490196:0:6489:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.490206:0:6489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.490214:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.490228:0:6489:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.490259:0:6489:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9367c4750000) 00000100:00100000:0.0:1783444414.490354:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6491:x1870073575330944:12345-0@lo:105: Request processed in 194us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.490361:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:3.0:1783444414.490658:0:80475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.490669:0:80475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444414.490698:0:80475:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783444414.490744:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.490752:0:80475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.490903:0:80475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444414.490927:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331072:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1783444414.490970:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.491008:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.491176:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575331072 00000100:00100000:0.0:1783444414.491182:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575331072 00000100:00100000:0.0:1783444414.491221:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:0.0:1783444414.491228:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:80475:x1870073575331072:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1783444414.491244:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444414.491261:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3832b12 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832b0b expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.491284:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3832b12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832b0b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.491298:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3832b12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832b0b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.491307:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9368d4c9a000) 00010000:00010000:0.0:1783444414.491310:0:8431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444414.491313:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750800, rc 0) 00000100:00100000:0.0:1783444414.491351:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331072:12345-0@lo:101:mdt00_005.0 Request processed in 123us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.491356:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:3.0:1783444414.491690:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331072:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783444414.491705:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.491718:0:80475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444414.491734:0:80475:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1783444414.491838:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331200:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783444414.491869:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.491891:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444414.492173:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6491:1870073575330944:0@lo:105: 00010000:00010000:1.0:1783444414.492186:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444414.492215:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575331200 00000100:00100000:0.0:1783444414.492222:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575331200 00000100:00100000:1.0:1783444414.492237:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2404:x1870073557801472:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4388us (4737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444414.492248:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2550 00000100:00100000:0.0:1783444414.492251:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:0.0:1783444414.492256:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331200:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.492334:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331200:12345-0@lo:1000:mdt00_005.0 Request processed in 77us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.492352:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1783444414.492424:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331200:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444414.492466:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331328:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444414.492490:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444414.492521:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.492610:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575331328 00000100:00100000:0.0:1783444414.492614:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575331328 00000100:00100000:0.0:1783444414.492644:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:0.0:1783444414.492651:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331328:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.492723:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331328:12345-0@lo:1000:mdt00_005.0 Request processed in 72us (231us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444414.492730:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:0.0:1783444414.492753:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331328:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.492847:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331456:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.492870:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444414.492882:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7512d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.492954:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575331456 00000100:00100000:0.0:1783444414.492957:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575331456 00000100:00100000:0.0:1783444414.492977:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:0.0:1783444414.492982:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331456:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.493024:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331456:12345-0@lo:1000:mdt00_005.0 Request processed in 42us (153us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444414.493030:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:0.0:1783444414.493052:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331456:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.493114:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331584:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.493135:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444414.493152:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7512d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.493162:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575331584 00000100:00100000:0.0:1783444414.493165:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575331584 00000100:00100000:0.0:1783444414.493188:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1783444414.493193:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331584:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.493233:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331584:12345-0@lo:1000:mdt00_005.0 Request processed in 39us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.493238:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1783444414.493260:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331584:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.493293:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331712:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.493311:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444414.493322:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7512d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.493331:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575331712 00000100:00100000:0.0:1783444414.493333:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575331712 00000100:00100000:0.0:1783444414.493352:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:0.0:1783444414.493357:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331712:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.494993:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331712:12345-0@lo:1000:mdt00_005.0 Request processed in 1628us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.495008:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:0.0:1783444414.495064:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331712:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.495750:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331840:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.495826:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444414.495852:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7512d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444414.495881:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575331840 00000100:00100000:2.0:1783444414.495889:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575331840 00000100:00100000:2.0:1783444414.495932:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:2.0:1783444414.495941:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331840:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783444414.496024:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331840:12345-0@lo:1000:mdt00_005.0 Request processed in 84us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444414.496060:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:0.0:1783444414.496239:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331840:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444414.496346:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331968:0@lo:700:mdt00_005.0 00000100:00100000:0.0:1783444414.496375:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444414.496400:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7512840 going to sleep for 11 seconds 00000100:00100000:2.0:1783444414.496455:0:66241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575331968 00000100:00100000:2.0:1783444414.496459:0:66241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575331968 00000100:00100000:2.0:1783444414.497232:0:66241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783444414.497243:0:66241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331968:12345-0@lo:700:mdt00_005.0 00000100:00100000:2.0:1783444414.497300:0:66241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+8:80475:x1870073575331968:12345-0@lo:700:mdt00_005.0 Request processed in 60us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444414.497307:0:66241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783444414.497386:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575331968:0@lo:700:mdt00_005.0 00000040:00080000:1.0:1783444414.497500:0:80475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783444414.497518:0:80475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].29, 64 off34624 00000004:00080000:1.0:1783444414.497525:0:80475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9368d016ed80 with version 5 00000040:00080000:1.0:1783444414.497595:0:80475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783444414.497605:0:80475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].30, 64 off34688 00000004:00080000:1.0:1783444414.497609:0:80475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9368d016ec00 with version 6 00000040:00080000:1.0:1783444414.498982:0:80475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783444414.498999:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 5 rpc_version 5 00000040:00080000:1.0:1783444414.499022:0:80475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400013a0:0x3:0x0].15, 64 off33728 00000020:00100000:3.0:1783444414.499034:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783444414.499056:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367c509a300 x1870073575332224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444414.499088:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575332224:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783444414.499137:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.499171:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.499330:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575332224 00000100:00100000:0.0:1783444414.499341:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575332224 00000100:00100000:0.0:1783444414.499389:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:0.0:1783444414.499397:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575332224:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:1.0:1783444414.500957:0:80475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].1, 1000 off33768 00000040:00080000:1.0:1783444414.501119:0:80475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].1, 1152 off33920 00000004:00080000:1.0:1783444414.501129:0:80475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9367c75123c0 with version 7 00000001:00080000:2.0:1783444414.510210:0:90990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00000100:00100000:0.0:1783444414.517901:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575332224:12345-0@lo:1000:osp_up0-1.0 Request processed in 18496us (18754us total) trans 115964116995 rc 0/0 00000100:00100000:0.0:1783444414.517917:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000004:00080000:3.0:1783444414.518732:0:75656:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:3.0:1783444414.518739:0:75656:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000100:00100000:3.0:1783444414.518934:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575332224:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1783444414.518968:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 6 rpc_version 6 00000020:00100000:3.0:1783444414.519000:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783444414.519009:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367c509a300 x1870073575332480/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444414.519031:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575332480:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783444414.519224:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.519259:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444414.519330:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575332480 00000100:00100000:2.0:1783444414.519338:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575332480 00000100:00100000:2.0:1783444414.519397:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:2.0:1783444414.519407:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575332480:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1783444414.527381:0:90990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116996 is committed 00000100:00100000:2.0:1783444414.527646:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575332480:12345-0@lo:1000:osp_up0-1.0 Request processed in 8235us (8416us total) trans 115964116996 rc 0/0 00000100:00100000:2.0:1783444414.527657:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000004:00080000:3.0:1783444414.527783:0:75656:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116996 committed transno 115964116996 00000100:00100000:3.0:1783444414.527823:0:75656:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116996 gen 3 00000100:00100000:3.0:1783444414.527843:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575332480:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1783444414.527869:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 7 rpc_version 7 00000020:00100000:3.0:1783444414.527902:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783444414.527910:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367c509a300 x1870073575332736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444414.527930:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575332736:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783444414.527972:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.527995:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d840 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.528221:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575332736 00000100:00100000:0.0:1783444414.528228:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575332736 00000100:00100000:0.0:1783444414.528278:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:0.0:1783444414.528288:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575332736:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783444414.534365:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75656:x1870073575332736:12345-0@lo:1000:osp_up0-1.0 Request processed in 6068us (6382us total) trans 115964116997 rc 0/0 00000100:00100000:1.0:1783444414.534379:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1783444414.534875:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575332736:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783444414.535462:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.535479:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.535493:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444414.535513:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006379f730 reply state 000000008bec44c6 transno 77309411435 ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.535525:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.535546:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:1.0:1783444414.535549:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444414.535553:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783444414.535564:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00080000:1.0:1783444414.535575:0:80475:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1783444414.535585:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.535593:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.535599:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.535617:0:80475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1783444414.535622:0:80475:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1783444414.535627:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.535633:0:80475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.536105:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444414.536114:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.536123:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc184ceb0) 00010000:00010000:0.0:1783444414.536129:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444414.536136:0:6494:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.536172:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.536179:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444414.536207:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.536215:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c4750000/0x42cb6883e3832afd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832b04 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.536239:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444414.536241:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444414.536242:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444414.536257:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444414.536278:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575332864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444414.536335:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444414.536469:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575332864 00000100:00100000:0.0:1783444414.536476:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575332864 00000100:00100000:1.0:1783444414.536514:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70925:x1870073557801344:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 57254us (57754us total) trans 77309411435 rc 0/0 00000100:00100000:1.0:1783444414.536523:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1285 00000100:00100000:0.0:1783444414.536523:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1783444414.536531:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3633:x1870073575332864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444414.536543:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444414.536561:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3832b04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832afd expref: 9 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.536639:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cb00) 00010000:00010000:0.0:1783444414.536648:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444414.536688:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3633:x1870073575332864:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.536694:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1783444414.536746:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575332864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444414.561827:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444414.563233:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557801600 00000100:00100000:2.0:1783444414.563246:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557801600 00000100:00100000:2.0:1783444414.563321:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1286 00000100:00100000:2.0:1783444414.563333:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70933:x1870073557801600:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444414.563355:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444414.563384:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3832b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939bfa expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.563456:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3832b27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.563490:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3832b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.563503:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3832b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444414.563549:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444414.563553:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444414.563593:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3832b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.563618:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71c00/0x42cb6883e3832b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bfa expref: 10 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.563638:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3832b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bfa expref: 9 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.563646:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff936901ef2a00) 00010000:00010000:2.0:1783444414.563649:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444414.563652:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70600, rc 0) 00000100:00100000:2.0:1783444414.563723:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+9:70933:x1870073557801600:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 392us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444414.563730:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1286 00000100:00100000:0.0:1783444414.566782:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444414.567025:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557801728 00000100:00100000:3.0:1783444414.567165:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557801728 00000100:00100000:3.0:1783444414.567228:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1287 00000100:00100000:3.0:1783444414.567239:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+9:70933:x1870073557801728:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444414.567259:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444414.567282:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3832b2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c01 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.567347:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.567378:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.567391:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.567404:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.567413:0:66223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3832b12 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832b0b expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.567421:0:66223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.567455:0:66223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3832b12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832b0b expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444414.567472:0:66223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575332992:0@lo:104: 00000100:00100000:3.0:1783444414.567520:0:66223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.567566:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d840 going to sleep for 11 seconds 00000100:00100000:0.0:1783444414.568261:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575332992 00000100:00100000:0.0:1783444414.568269:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575332992 00000100:00100000:0.0:1783444414.568356:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1783444414.568366:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66223:x1870073575332992:12345-0@lo:104: 00010000:00010000:0.0:1783444414.568380:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.568448:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783444414.568461:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66223:x1870073575332992:12345-0@lo:104: Request processed in 98us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.568468:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:1.0:1783444414.568492:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444414.568504:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.568513:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04c00 already unused, calling callback (ffffffffc184ceb0) 00010000:00010000:1.0:1783444414.568518:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444414.568527:0:10323:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444414.568533:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575332992:0@lo:104: 00010000:00010000:3.0:1783444414.568553:0:66223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.568567:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.568573:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444414.568609:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.568617:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04c00/0x42cb6883e3832b0b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832b12 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.568637:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.568639:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.568641:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444414.568967:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575333120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444414.569001:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444414.569091:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575333120 00000100:00100000:1.0:1783444414.569096:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575333120 00010000:00010000:1.0:1783444414.569115:0:19646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3832b12 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x42cb6883e3832b0b expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444414.569145:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:1.0:1783444414.569151:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3635:x1870073575333120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444414.569169:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1783444414.571707:0:90990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116997 is committed 00010000:00010000:3.0:1783444414.571894:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3832b12 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832b0b expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.571933:0:19646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9368d4c9a000) 00010000:00010000:3.0:1783444414.571939:0:19646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.571948:0:19646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.571956:0:19646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.571985:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444414.572071:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575333120:12345-0@lo:103:ldlm_bl.0 Request processed in 2919us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.572090:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1783444414.572153:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575333120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444414.572181:0:66223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572189:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444414.572315:0:66223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66223:1870073575333248:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783444414.572352:0:66223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444414.572375:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d180 going to sleep for 11 seconds 00000100:00100000:3.0:1783444414.572395:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575333248 00000100:00100000:3.0:1783444414.572401:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575333248 00000100:00100000:3.0:1783444414.572438:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1783444414.572446:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66223:x1870073575333248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783444414.572525:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66223:x1870073575333248:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.572532:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1783444414.572576:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66223:1870073575333248:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783444414.572619:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832b43 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572630:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832b43 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572639:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832b43 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444414.572658:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832b43 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572671:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572678:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572684:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572689:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572695:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444414.572699:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572715:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572724:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff936901ef2a00) 00010000:00010000:3.0:1783444414.572727:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444414.572731:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572736:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832b35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572746:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572752:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572757:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572762:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444414.572765:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572771:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572778:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9368d4c9a000) 00010000:00010000:3.0:1783444414.572781:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444414.572784:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572818:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04800/0x42cb6883e3832b3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572854:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3832b2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c01 expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572867:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832b43 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c01 expref: 10 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.572874:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368f575fb00) 00010000:00010000:3.0:1783444414.572876:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783444414.572878:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05800, rc 0) 00000100:00100000:3.0:1783444414.572930:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+10:70933:x1870073557801728:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 5693us (6172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.572936:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1287 00000100:00100000:0.0:1783444414.586747:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444414.586862:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557801856 00000100:00100000:2.0:1783444414.586871:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557801856 00000100:00100000:2.0:1783444414.586937:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1288 00000100:00100000:2.0:1783444414.586948:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:70933:x1870073557801856:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444414.586973:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444414.587005:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71c00/0x42cb6883e3832b4a lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c08 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.587134:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70e00/0x42cb6883e3832b51 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.587148:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70e00/0x42cb6883e3832b51 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.587160:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70e00/0x42cb6883e3832b51 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444414.587211:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783444414.587215:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783444414.587250:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71c00/0x42cb6883e3832b4a lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c08 expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.587268:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70e00/0x42cb6883e3832b51 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c08 expref: 9 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.587275:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:2.0:1783444414.587278:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1783444414.587282:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70e00, rc 0) 00000100:00100000:2.0:1783444414.587388:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+9:70933:x1870073557801856:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 440us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444414.587396:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1288 00000100:00100000:1.0:1783444414.598114:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444414.598218:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557801984 00000100:00100000:3.0:1783444414.598226:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557801984 00000100:00100000:3.0:1783444414.598278:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1289 00000100:00100000:3.0:1783444414.598289:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+9:70933:x1870073557801984:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444414.598312:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444414.598334:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832b58 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c0f expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598405:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598419:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598442:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598457:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598463:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598469:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598517:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598524:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598528:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598534:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598539:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444414.598544:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598552:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598563:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:3.0:1783444414.598574:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444414.598579:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598585:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832b5f lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598598:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598602:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598608:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598612:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444414.598614:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598620:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598627:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9368f575f400) 00010000:00010000:3.0:1783444414.598630:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444414.598632:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598637:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05000/0x42cb6883e3832b66 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598673:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832b58 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c0f expref: 10 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598690:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:3.0:1783444414.598692:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444414.598696:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832b58 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c0f expref: 10 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.598706:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04a00, rc 0) 00000100:00100000:3.0:1783444414.598777:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+9:70933:x1870073557801984:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 489us (673us total) trans 0 rc 301/301 00000100:00100000:3.0:1783444414.598785:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1289 00000100:00100000:0.0:1783444414.602446:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444414.602663:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557802112 00000100:00100000:1.0:1783444414.602673:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557802112 00000100:00100000:1.0:1783444414.602772:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1290 00000100:00100000:1.0:1783444414.602783:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:70933:x1870073557802112:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444414.602837:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444414.602858:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11e00/0x42cb6883e3832b6d lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c16 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.602924:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.602938:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.602949:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.602963:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.602970:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.602976:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603016:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603295:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603304:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603310:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603315:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444414.603319:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603328:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603340:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:1.0:1783444414.603343:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444414.603348:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603354:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832b74 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603366:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603372:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603378:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603390:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444414.603393:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603399:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603408:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9367cd15c500) 00010000:00010000:1.0:1783444414.603410:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444414.603413:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603420:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832b7b lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603453:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11e00/0x42cb6883e3832b6d lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c16 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603462:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:1.0:1783444414.603464:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444414.603467:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11e00/0x42cb6883e3832b6d lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c16 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.603477:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11e00, rc 0) 00000100:00100000:1.0:1783444414.603595:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:778015c5-4969-44f5-82a5-0f6eadd152d5+9:70933:x1870073557802112:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 812us (1157us total) trans 0 rc 301/301 00000100:00100000:1.0:1783444414.603602:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1290 00000100:00100000:1.0:1783444414.608111:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444414.608295:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557802240 00000100:00100000:0.0:1783444414.608306:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557802240 00000100:00100000:0.0:1783444414.608405:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1291 00000100:00100000:0.0:1783444414.608416:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+9:70933:x1870073557802240:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444414.608436:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444414.608459:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c1d expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.608564:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751800/0x42cb6883e3832b89 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.608579:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751800/0x42cb6883e3832b89 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.608591:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751800/0x42cb6883e3832b89 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444414.608640:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783444414.608643:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444414.608658:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751800/0x42cb6883e3832b89 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.608680:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c1d expref: 11 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.608707:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751800/0x42cb6883e3832b89 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c1d expref: 10 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.608713:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:0.0:1783444414.608715:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783444414.608717:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751800, rc 0) 00000100:00100000:0.0:1783444414.608776:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:778015c5-4969-44f5-82a5-0f6eadd152d5+10:70933:x1870073557802240:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 363us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.608783:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1291 00000100:00100000:0.0:1783444414.612526:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444414.612596:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557802496 00000100:00100000:3.0:1783444414.612605:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557802496 00000100:00100000:3.0:1783444414.612667:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1292 00000100:00100000:3.0:1783444414.612677:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+10:70933:x1870073557802496:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444414.612698:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444414.612718:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832b90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c24 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444414.612859:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783444414.612962:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832b90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c24 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.612976:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f575f400) 00010000:00010000:3.0:1783444414.612979:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783444414.612984:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832b90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c24 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.613021:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04a00, rc 0) 00000100:00100000:3.0:1783444414.613097:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:70933:x1870073557802496:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 420us (579us total) trans 77309411436 rc 301/301 00000100:00100000:3.0:1783444414.613107:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1292 00000100:00100000:3.0:1783444414.618505:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444414.618593:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557802752 00000100:00100000:0.0:1783444414.618604:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557802752 00000100:00100000:0.0:1783444414.618661:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1293 00000100:00100000:0.0:1783444414.618672:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+11:70933:x1870073557802752:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1783444414.618740:0:66223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444414.618903:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751800/0x42cb6883e3832b89 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c1d expref: 11 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.618921:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:0.0:1783444414.618927:0:66223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444414.618992:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.619004:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.619014:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.619732:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.619744:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.619752:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621283:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621301:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621311:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444414.621326:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5b77d8d reply state 000000005f7a7638 transno 77309411437 ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621337:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621345:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15c500) 00010000:00010000:1.0:1783444414.621347:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444414.621351:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783444414.621357:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1783444414.621366:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621373:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621390:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621397:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621403:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444414.621408:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621417:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621429:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:1.0:1783444414.621431:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444414.621435:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621441:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832b9e lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444414.621454:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5b77d8d reply state 000000005f7a7638 transno 77309411437 ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621463:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.621469:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9368d4c9a400) 00010000:00010000:1.0:1783444414.621471:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444414.621473:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783444414.621825:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:70933:x1870073557802752:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 3149us (3329us total) trans 77309411437 rc 0/0 00000100:00100000:1.0:1783444414.621840:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1293 00000100:00100000:1.0:1783444414.625030:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444414.625116:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557803008 00000100:00100000:2.0:1783444414.625127:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557803008 00000100:00100000:2.0:1783444414.625189:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:2.0:1783444414.625201:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+12:70933:x1870073557803008:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1783444414.625478:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:778015c5-4969-44f5-82a5-0f6eadd152d5+13:70933:x1870073557803008:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 278us (452us total) trans 77309411438 rc 0/0 00000100:00100000:2.0:1783444414.625485:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:0.0:1783444414.677176:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444414.677232:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444414.677267:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444414.677479:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557803136 00000100:00100000:3.0:1783444414.677489:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557803136 00000100:00100000:3.0:1783444414.677547:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557803392 00000100:00100000:3.0:1783444414.677551:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557803392 00000100:00100000:3.0:1783444414.677570:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557803264 00000100:00100000:3.0:1783444414.677573:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557803264 00000100:00100000:3.0:1783444414.677595:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 728 00000100:00100000:3.0:1783444414.677605:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fea1b1de-aca2-4501-86bf-fe28138c0593+12:2403:x1870073557803136:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783444414.677619:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444414.677639:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05200/0x42cb6883e3832864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bc9 expref: 12 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.677658:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444414.677710:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fea1b1de-aca2-4501-86bf-fe28138c0593+11:2403:x1870073557803136:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 106us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.677717:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 728 00000100:00100000:3.0:1783444414.677736:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 729 00000100:00100000:3.0:1783444414.677742:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d4172050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fea1b1de-aca2-4501-86bf-fe28138c0593+10:2403:x1870073557803392:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783444414.677750:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444414.677759:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751c00/0x42cb6883e383286b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bd0 expref: 10 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.677782:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444414.677831:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d4172050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fea1b1de-aca2-4501-86bf-fe28138c0593+9:2403:x1870073557803392:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 88us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.677838:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 729 00000100:00100000:3.0:1783444414.677962:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 730 00000100:00100000:3.0:1783444414.677969:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fea1b1de-aca2-4501-86bf-fe28138c0593+8:2403:x1870073557803264:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783444414.677977:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444414.677988:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04600/0x42cb6883e383285d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bc2 expref: 8 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444414.677998:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444414.678016:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fea1b1de-aca2-4501-86bf-fe28138c0593+7:2403:x1870073557803264:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 47us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.678022:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 730 00000100:00100000:1.0:1783444414.681507:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444414.681590:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557803776 00000100:00100000:0.0:1783444414.681601:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557803776 00000100:00100000:0.0:1783444414.681663:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5890 00000100:00100000:0.0:1783444414.681672:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+7:2400:x1870073557803776:12345-192.168.204.20@tcp:9:umount.0 00000020:00000080:0.0:1783444414.681708:0:26206:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832490 00000020:00010000:0.0:1783444414.681717:0:26206:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9369006a2800: total 0 00000100:00080000:0.0:1783444414.681722:0:26206:0:(import.c:65:import_set_state_nolock()) ffff9367c4489000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783444414.681771:0:26206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:0.0:1783444414.681970:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:778015c5-4969-44f5-82a5-0f6eadd152d5+5:2400:x1870073557803776:12345-192.168.204.20@tcp:9:umount.0 Request processed in 297us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444414.681977:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5890 00000020:00010000:2.0:1783444414.682322:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9369006a2800: total 0 00010000:00010000:2.0:1783444414.682368:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9369006a2800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1783444414.682430:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3397423/0x42cb6883e38325d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b98 expref: 4 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.682466:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbf4e88c/0x42cb6883e38325e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ba6 expref: 3 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.682481:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9369006a2800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1783444414.682495:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444414.682497:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444414.682499:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444414.694753:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444414.695021:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557804032 00000100:00100000:2.0:1783444414.695046:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557804032 00000100:00100000:2.0:1783444414.695123:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5891 00000100:00100000:2.0:1783444414.695133:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+6:2400:x1870073557804032:12345-192.168.204.20@tcp:9:umount.0 00000020:00000080:2.0:1783444414.695171:0:26203:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832489 00000020:00010000:2.0:1783444414.695179:0:26203:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368ea5f1000: total 0 00000100:00080000:2.0:1783444414.695183:0:26203:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783444414.695236:0:26203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:2.0:1783444414.695412:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:778015c5-4969-44f5-82a5-0f6eadd152d5+4:2400:x1870073557804032:12345-192.168.204.20@tcp:9:umount.0 Request processed in 280us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444414.695421:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5891 00000020:00010000:1.0:1783444414.695580:0:10324:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368ea5f1000: total 0 00010000:00010000:1.0:1783444414.695632:0:10324:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368ea5f1000, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1783444414.695663:0:10324:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1783444414.695667:0:10324:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb atime from disk: 0 -> 1783444358 00002000:00010000:1.0:1783444414.695670:0:10324:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1783444414.695700:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071722605/0x42cb6883e38325d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b9f expref: 3 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.695736:0:10324:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368ea5f1000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783444414.695750:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.695753:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.695755:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444414.719006:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444414.719229:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557804544 00000100:00100000:3.0:1783444414.719238:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557804544 00000100:00100000:3.0:1783444414.719325:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1294 00000100:00100000:3.0:1783444414.719335:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+10:2400:x1870073557804544:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:3.0:1783444414.719375:0:71469:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38326dc 00000020:00010000:3.0:1783444414.719388:0:71469:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9367c32c8800: total 0 00000100:00080000:3.0:1783444414.719392:0:71469:0:(import.c:65:import_set_state_nolock()) ffff9368eb785000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444414.719431:0:71469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116997 00000100:00100000:3.0:1783444414.719856:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:778015c5-4969-44f5-82a5-0f6eadd152d5+8:2400:x1870073557804544:12345-192.168.204.20@tcp:39:umount.0 Request processed in 521us (857us total) trans 115964116998 rc 0/0 00000020:00010000:1.0:1783444414.720002:0:6494:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9367c32c8800: total 0 00010000:00010000:1.0:1783444414.720069:0:6494:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9367c32c8800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783444414.720111:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff936901ef2a00) 00010000:00010000:1.0:1783444414.720115:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444414.720123:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70600/0x42cb6883e3832b27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bfa expref: 8 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.720150:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:1.0:1783444414.720153:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1783444414.720157:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38328c6 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939b91 expref: 7 pid: 91023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.720190:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff9368e7f86600) 00010000:00010000:1.0:1783444414.720192:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444414.720196:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3832aef lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bf3 expref: 6 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.720210:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368f575fb00) 00010000:00010000:1.0:1783444414.720212:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444414.720216:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832b43 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c01 expref: 5 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.720231:0:6494:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9367c32c8800, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1783444414.720244:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.720246:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.720247:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444414.720491:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1294 00000100:00100000:1.0:1783444414.739965:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444414.740087:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557804800 00000100:00100000:3.0:1783444414.740097:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557804800 00000100:00100000:3.0:1783444414.740162:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1295 00000100:00100000:3.0:1783444414.740173:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+13:2400:x1870073557804800:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:3.0:1783444414.740215:0:67017:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e382cf01 00000020:00010000:3.0:1783444414.740229:0:67017:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9367c765d000: total 0 00000100:00080000:3.0:1783444414.740234:0:67017:0:(import.c:65:import_set_state_nolock()) ffff936901dbe000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444414.740281:0:67017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411438 00000100:00100000:3.0:1783444414.740448:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:778015c5-4969-44f5-82a5-0f6eadd152d5+11:2400:x1870073557804800:12345-192.168.204.20@tcp:39:umount.0 Request processed in 276us (492us total) trans 77309411439 rc 0/0 00000100:00100000:3.0:1783444414.740456:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1295 00000020:00010000:1.0:1783444414.740667:0:10323:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9367c765d000: total 0 00010000:00010000:1.0:1783444414.740672:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.740730:0:10323:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9367c765d000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783444414.740768:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.740779:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.740782:0:10323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:1.0:1783444414.740869:0:10323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783444414.740878:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70e00/0x42cb6883e3832b51 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c08 expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.740895:0:10323:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9367c765d000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783444414.740910:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.740912:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.740914:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444414.748155:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.748175:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.748184:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.748190:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444414.748194:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.748203:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.748221:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368dccae800) 00010000:00010000:2.0:1783444414.748224:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444414.748229:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444414.748235:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11a00/0x42cb6883e3832b19 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751476:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751510:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444414.751524:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751535:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751570:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9368d4c9a400) 00010000:00010000:0.0:1783444414.751574:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444414.751578:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751586:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10800/0x42cb6883e3832ba5 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751608:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751615:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751621:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751626:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444414.751629:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751635:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751642:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15c500) 00010000:00010000:0.0:1783444414.751644:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444414.751647:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444414.751653:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832bac lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444414.811005:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444414.811174:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557805056 00000100:00100000:3.0:1783444414.811184:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557805056 00000100:00100000:3.0:1783444414.811579:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:3.0:1783444414.811591:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+7:2400:x1870073557805056:12345-192.168.204.20@tcp:251:umount.0 00000020:00000080:3.0:1783444414.811644:0:90995:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832856 00000020:00010000:3.0:1783444414.811651:0:90995:0:(genops.c:1944:obd_stale_export_put()) Put export ffff936901f96800: total 0 00000100:00080000:3.0:1783444414.811657:0:90995:0:(import.c:65:import_set_state_nolock()) ffff936901f90000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783444414.811730:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fea1b1de-aca2-4501-86bf-fe28138c0593+3:2400:x1870073557805056:12345-192.168.204.20@tcp:251:umount.0 Request processed in 141us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444414.811737:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000020:00010000:1.0:1783444414.811814:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff936901f96800: total 0 00010000:00010000:1.0:1783444414.811884:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff936901f96800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783444414.811920:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5756400/0x42cb6883e3832872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939bd7 expref: 2 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444414.811936:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff936901f96800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783444414.811947:0:6493:0:(genops.c:906:class_export_put()) final put ffff936901f96800/fea1b1de-aca2-4501-86bf-fe28138c0593 00010000:00010000:1.0:1783444414.811958:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.811961:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444414.811962:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783444414.811972:0:86011:0:(genops.c:865:class_export_destroy()) destroying export ffff936901f96800/fea1b1de-aca2-4501-86bf-fe28138c0593 for MGS 00000020:00000080:1.0:1783444414.811998:0:86011:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff936901f90000 for MGS 00010000:00010000:3.0:1783444415.453134:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444416.011731:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444416.011830:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557805184 00000100:00100000:2.0:1783444416.011851:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557805184 00000100:00100000:2.0:1783444416.011940:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:2.0:1783444416.011956:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1870073557805184:12345-192.168.204.20@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783444416.012178:0:90997:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp t0 exp 0000000000000000 cur 3407 last 0 00000020:00000080:3.0:1783444416.012239:0:90997:0:(genops.c:1406:class_connect()) connect: client 28921b6e-3bc9-4a81-ae87-1992169ba754, cookie 0x42cb6883e3832bb3 00000100:00080000:3.0:1783444416.012468:0:90997:0:(import.c:65:import_set_state_nolock()) ffff9367c32cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444416.012727:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+5:2400:x1870073557805184:12345-192.168.204.20@tcp:250:mount.lustre.0 Request processed in 773us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444416.012769:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:1.0:1783444416.030397:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444416.030552:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557805312 00000100:00100000:0.0:1783444416.030567:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557805312 00000100:00100000:0.0:1783444416.030695:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:0.0:1783444416.030708:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+5:70958:x1870073557805312:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783444416.030734:0:91001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444416.030766:0:91001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751400/0x42cb6883e3832bba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c39 expref: -99 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444416.030863:0:91001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751400/0x42cb6883e3832bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c39 expref: 6 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444416.030878:0:91001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751400/0x42cb6883e3832bba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c39 expref: 6 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444416.030891:0:91001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751400, rc 0) 00000100:00100000:0.0:1783444416.030991:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70958:x1870073557805312:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 285us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444416.030999:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:2.0:1783444416.035748:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.035954:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557805440 00000100:00100000:3.0:1783444416.035972:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557805440 00000100:00100000:3.0:1783444416.036124:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:3.0:1783444416.036140:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70958:x1870073557805440:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783444416.036390:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70958:x1870073557805440:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 253us (658us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444416.036401:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:1.0:1783444416.044901:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.045277:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557805568 00000100:00100000:3.0:1783444416.045293:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557805568 00000100:00100000:3.0:1783444416.045437:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:3.0:1783444416.045450:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70958:x1870073557805568:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783444416.045490:0:90995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444416.045514:0:90995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05200/0x42cb6883e3832bc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c40 expref: -99 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444416.045559:0:90995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05200/0x42cb6883e3832bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c40 expref: 7 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444416.045574:0:90995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05200/0x42cb6883e3832bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c40 expref: 7 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444416.045591:0:90995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05200, rc 0) 00000100:00100000:3.0:1783444416.045684:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+7:70958:x1870073557805568:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 237us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444416.045693:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:0.0:1783444416.049448:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444416.049855:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557805696 00000100:00100000:1.0:1783444416.049869:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557805696 00000100:00100000:1.0:1783444416.049949:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:1.0:1783444416.049974:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+7:70958:x1870073557805696:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783444416.050246:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70958:x1870073557805696:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 285us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444416.050254:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:2.0:1783444416.058964:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444416.059261:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557805824 00000100:00100000:0.0:1783444416.059275:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557805824 00000100:00100000:0.0:1783444416.059389:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:0.0:1783444416.059402:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70958:x1870073557805824:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783444416.059618:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70958:x1870073557805824:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 218us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444416.059627:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:2.0:1783444416.068130:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.068324:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557805952 00000100:00100000:3.0:1783444416.068339:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557805952 00000100:00100000:3.0:1783444416.068413:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:3.0:1783444416.068425:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70976:x1870073557805952:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783444416.068755:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70976:x1870073557805952:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 331us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444416.068764:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:1.0:1783444416.123759:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.124209:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557806080 00000100:00100000:3.0:1783444416.124222:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557806080 00000100:00100000:3.0:1783444416.124291:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:3.0:1783444416.124302:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70976:x1870073557806080:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783444416.124764:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70976:x1870073557806080:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 461us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444416.124772:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:2.0:1783444416.138395:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.138887:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557806208 00000100:00100000:3.0:1783444416.138905:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557806208 00000100:00100000:3.0:1783444416.138973:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:3.0:1783444416.138982:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70976:x1870073557806208:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783444416.139238:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70976:x1870073557806208:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 255us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444416.139248:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:2.0:1783444416.155281:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444416.155832:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557806336 00000100:00100000:0.0:1783444416.155850:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557806336 00000100:00100000:0.0:1783444416.155926:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:0.0:1783444416.155937:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70958:x1870073557806336:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783444416.155960:0:91001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444416.155984:0:91001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4750600/0x42cb6883e3832bc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c71 expref: -99 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444416.156431:0:91001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4750600/0x42cb6883e3832bc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c71 expref: 9 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444416.156448:0:91001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4750600/0x42cb6883e3832bc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c71 expref: 9 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444416.156459:0:91001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750600, rc 0) 00000100:00100000:0.0:1783444416.156562:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70958:x1870073557806336:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 627us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444416.156571:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:0.0:1783444416.161878:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.161974:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557806464 00000100:00100000:3.0:1783444416.161991:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557806464 00000100:00100000:3.0:1783444416.162075:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:3.0:1783444416.162086:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70958:x1870073557806464:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783444416.162138:0:90996:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783444416.162169:0:90996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783444416.162174:0:90996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783444416.162177:0:90996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783444416.162181:0:90996:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783444416.162184:0:90996:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:0.0:1783444416.171643:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70958:x1870073557806464:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 9540us (9756us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444416.171663:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:1.0:1783444416.178502:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.179294:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557806592 00000100:00100000:3.0:1783444416.179313:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557806592 00000100:00100000:3.0:1783444416.179447:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:3.0:1783444416.179461:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70958:x1870073557806592:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783444416.179484:0:90995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444416.179510:0:90995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04600/0x42cb6883e3832bcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939c78 expref: -99 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444416.179563:0:90995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04600/0x42cb6883e3832bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c78 expref: 10 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444416.179578:0:90995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04600/0x42cb6883e3832bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c78 expref: 10 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444416.179590:0:90995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04600, rc 0) 00000100:00100000:3.0:1783444416.179665:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70958:x1870073557806592:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 207us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444416.179673:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:1.0:1783444416.187549:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.187684:0:90997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557806720 00000100:00100000:3.0:1783444416.187700:0:90997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557806720 00000100:00100000:3.0:1783444416.187768:0:90997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:3.0:1783444416.187779:0:90997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70958:x1870073557806720:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783444416.188439:0:90997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70958:x1870073557806720:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 659us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444416.188448:0:90997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:1.0:1783444416.196563:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444416.196845:0:91001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557806848 00000100:00100000:0.0:1783444416.196858:0:91001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557806848 00000100:00100000:0.0:1783444416.196971:0:91001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:0.0:1783444416.196983:0:91001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70958:x1870073557806848:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783444416.197267:0:91001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70958:x1870073557806848:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 284us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444416.197282:0:91001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:1.0:1783444416.200068:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444416.200401:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557806976 00000100:00100000:0.0:1783444416.200416:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557806976 00000100:00100000:0.0:1783444416.200478:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:0.0:1783444416.200488:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70983:x1870073557806976:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783444416.200721:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70983:x1870073557806976:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 232us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444416.200738:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:1.0:1783444416.210479:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.210569:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557807104 00000100:00100000:3.0:1783444416.210579:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557807104 00000100:00100000:3.0:1783444416.210639:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:3.0:1783444416.210650:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70983:x1870073557807104:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783444416.210871:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70983:x1870073557807104:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 222us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444416.210879:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:1.0:1783444416.227736:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444416.227894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.236958:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557807232 00000100:00100000:3.0:1783444416.236974:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557807232 00000100:00100000:3.0:1783444416.237143:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557807488 00000100:00100000:3.0:1783444416.237147:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557807488 00000100:00100000:2.0:1783444416.237269:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1296 00000100:00100000:2.0:1783444416.237279:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557807232:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783444416.237315:0:66223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp 0000000000000000 cur 3407 last 0 00000020:00000080:2.0:1783444416.237384:0:66223:0:(genops.c:1406:class_connect()) connect: client 08efc25c-17e5-4d29-97d2-f1505f195a06, cookie 0x42cb6883e3832bd6 00000004:00100000:2.0:1783444416.237412:0:66223:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783444416.239643:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9368dd209000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444416.239742:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557807232:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 2462us (12014us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444416.239754:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1296 00000100:00100000:2.0:1783444416.239802:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1297 00000100:00100000:2.0:1783444416.239810:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557807488:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783444416.239836:0:66223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp 0000000000000000 cur 3407 last 0 00000020:00000080:2.0:1783444416.239884:0:66223:0:(genops.c:1406:class_connect()) connect: client 08efc25c-17e5-4d29-97d2-f1505f195a06, cookie 0x42cb6883e3832bdd 00000004:00100000:2.0:1783444416.239909:0:66223:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783444416.239982:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9368dd209800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444416.241122:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557807488:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 196us (12112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444416.241136:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1297 00000100:00100000:1.0:1783444416.244428:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444416.244467:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444416.244551:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444416.244583:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557807360 00000100:00100000:1.0:1783444416.244594:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557807360 00000100:00100000:1.0:1783444416.244649:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557807744 00000100:00100000:1.0:1783444416.244652:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557807744 00000100:00100000:1.0:1783444416.244663:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557807616 00000100:00100000:1.0:1783444416.244665:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557807616 00000100:00100000:1.0:1783444416.244682:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1298 00000100:00100000:1.0:1783444416.244691:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:0:x1870073557807360:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783444416.244729:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444794368 avail 1298554880 00000100:00100000:1.0:1783444416.244832:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:0:x1870073557807360:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 141us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444416.244839:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1298 00000100:00100000:1.0:1783444416.244859:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1299 00000100:00100000:1.0:1783444416.244866:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:70958:x1870073557807744:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783444416.244877:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444794368 avail 1298554880 00000100:00100000:1.0:1783444416.244901:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:70958:x1870073557807744:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 36us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444416.244908:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1299 00000100:00100000:1.0:1783444416.244919:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1300 00000100:00100000:1.0:1783444416.244926:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:0:x1870073557807616:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783444416.244942:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:1.0:1783444416.244979:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:0:x1870073557807616:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 53us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444416.244997:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1300 00000100:00080000:1.0:1783444416.245021:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444416.245025:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444416.247431:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.250301:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557807872 00000100:00100000:3.0:1783444416.250317:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557807872 00000100:00100000:2.0:1783444416.256850:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1301 00000100:00100000:2.0:1783444416.256881:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:70958:x1870073557807872:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783444416.257072:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:70958:x1870073557807872:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 207us (9650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444416.257081:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1301 00000100:00100000:3.0:1783444416.269921:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.269967:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444416.270000:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444416.270164:0:66243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557808256 00000100:00100000:2.0:1783444416.270174:0:66243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557808256 00000100:00100000:2.0:1783444416.270246:0:66243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1783444416.270258:0:66243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:70958:x1870073557808256:12345-192.168.204.20@tcp:900:mount.lustre.0 00000100:00100000:2.0:1783444416.270336:0:66243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:70958:x1870073557808256:12345-192.168.204.20@tcp:900:mount.lustre.0 Request processed in 80us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444416.270344:0:66243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1783444416.270547:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557808000 00000100:00100000:0.0:1783444416.270553:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557808000 00000100:00100000:0.0:1783444416.270581:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557808128 00000100:00100000:0.0:1783444416.270583:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557808128 00000100:00100000:0.0:1783444416.270608:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5892 00000100:00100000:0.0:1783444416.270614:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2400:x1870073557808000:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783444416.270643:0:17653:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp 0000000000000000 cur 3407 last 0 00000020:00000080:0.0:1783444416.270671:0:17653:0:(genops.c:1406:class_connect()) connect: client 08efc25c-17e5-4d29-97d2-f1505f195a06, cookie 0x42cb6883e3832be4 00002000:00100000:0.0:1783444416.270682:0:17653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 08efc25c-17e5-4d29-97d2-f1505f195a06/ffff9367c17cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783444416.270703:0:17653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783444416.270814:0:17653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783444416.270846:0:17653:0:(import.c:65:import_set_state_nolock()) ffff9367c17cc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444416.270878:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557808000:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 263us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444416.270886:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5892 00000100:00100000:0.0:1783444416.270901:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5893 00000100:00100000:0.0:1783444416.270906:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2400:x1870073557808128:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783444416.270939:0:17653:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp 0000000000000000 cur 3407 last 0 00000020:00000080:0.0:1783444416.270957:0:17653:0:(genops.c:1406:class_connect()) connect: client 08efc25c-17e5-4d29-97d2-f1505f195a06, cookie 0x42cb6883e3832beb 00002000:00100000:0.0:1783444416.270963:0:17653:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 08efc25c-17e5-4d29-97d2-f1505f195a06/ffff9368c6bcc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783444416.270973:0:17653:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783444416.271025:0:17653:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783444416.271041:0:17653:0:(import.c:65:import_set_state_nolock()) ffff9368f98b7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444416.271080:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557808128:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 171us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444416.271088:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5893 00000100:00100000:3.0:1783444416.273029:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444416.273135:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557808384 00000100:00100000:2.0:1783444416.273145:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557808384 00000100:00100000:2.0:1783444416.273208:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:2.0:1783444416.273217:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:70958:x1870073557808384:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783444416.273302:0:66229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783444416.273400:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:70958:x1870073557808384:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 184us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444416.273408:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 232 00010000:00010000:1.0:1783444416.477303:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444417.310962:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575333632:0@lo:400:kworker.0 00000100:00100000:1.0:1783444417.310994:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575333760:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.311033:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575333376:0@lo:400:kworker.0 00000100:00100000:0.0:1783444417.311095:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444417.311191:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575333504:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.313612:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444417.313670:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c2c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575333888:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.313712:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444417.313743:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575334400:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.313766:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444417.313825:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575334912:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.313863:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444417.313919:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575333632 00000100:00100000:3.0:1783444417.313927:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575333632 00000100:00100000:3.0:1783444417.313981:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575333888 00000100:00100000:3.0:1783444417.313984:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575333888 00000100:00100000:3.0:1783444417.314004:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575334400 00000100:00100000:3.0:1783444417.314007:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575334400 00000100:00100000:3.0:1783444417.314019:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575334912 00000100:00100000:3.0:1783444417.314021:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575334912 00000100:00100000:3.0:1783444417.314047:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1783444417.314056:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575333632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.314118:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575333632:12345-0@lo:400:kworker.0 Request processed in 63us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.314195:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1783444417.314213:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1783444417.314228:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575333888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.314263:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575333888:12345-0@lo:400:kworker.0 Request processed in 36us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.314269:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1783444417.314281:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1783444417.314286:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575334400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.314314:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575334400:12345-0@lo:400:kworker.0 Request processed in 27us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.314320:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1783444417.314331:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1783444417.314337:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575334912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.314374:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575334912:12345-0@lo:400:kworker.0 Request processed in 37us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.314380:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1783444417.314422:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c2c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575333888:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.314433:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575334400:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.314441:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575334912:0@lo:400:kworker.0 00000100:00080000:3.0:1783444417.314537:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444417.314556:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575333376 00000100:00100000:3.0:1783444417.314560:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575333376 00000100:00100000:3.0:1783444417.314588:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783444417.314595:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575333376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.314630:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575333376:12345-0@lo:400:kworker.0 Request processed in 36us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.314636:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783444417.314670:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575333376:0@lo:400:kworker.0 00000100:00100000:1.0:1783444417.318620:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444417.318689:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575334272:0@lo:400:kworker.0 00000100:00100000:1.0:1783444417.318748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444417.318809:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575334272 00000100:00100000:1.0:1783444417.318817:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575334272 00000100:00100000:1.0:1783444417.318878:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1783444417.318888:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575334272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444417.318938:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575334272:12345-0@lo:400:kworker.0 Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444417.318945:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00080000:1.0:1783444417.318971:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444417.318999:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575334272:0@lo:400:kworker.0 00000100:00100000:1.0:1783444417.319007:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575334784:0@lo:400:kworker.0 00000100:00100000:1.0:1783444417.319042:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444417.319065:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575334784 00000100:00100000:1.0:1783444417.319068:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575334784 00000100:00100000:1.0:1783444417.319098:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:1.0:1783444417.319104:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575334784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444417.319133:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575334784:12345-0@lo:400:kworker.0 Request processed in 29us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444417.319154:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00080000:1.0:1783444417.319173:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444417.319191:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575334784:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.320435:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575333760 00000100:00100000:3.0:1783444417.320446:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575333760 00000100:00100000:3.0:1783444417.320526:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1783444417.320538:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575333760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.320604:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575333760:12345-0@lo:400:kworker.0 Request processed in 70us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.320611:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00080000:1.0:1783444417.320945:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444417.320991:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575333760:0@lo:400:kworker.0 00000100:00100000:0.0:1783444417.324944:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575333632:0@lo:400:kworker.0 00000100:00100000:0.0:1783444417.324969:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575334144:0@lo:400:kworker.0 00000100:00100000:0.0:1783444417.325060:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444417.325101:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f57c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575334656:0@lo:400:kworker.0 00000100:00100000:0.0:1783444417.325129:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444417.325198:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444417.325206:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e720d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575335040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444417.325237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444417.325319:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575335040 00000100:00100000:0.0:1783444417.325327:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575335040 00000100:00100000:0.0:1783444417.325387:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1783444417.325397:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575335040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444417.325445:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444417.325517:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575335040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444417.325526:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1783444417.325569:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e720d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575335040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444417.325700:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444417.325743:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c2c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575334016:0@lo:400:kworker.0 00000100:00100000:2.0:1783444417.325769:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444417.325813:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575334016 00000100:00100000:2.0:1783444417.325817:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575334016 00000100:00100000:2.0:1783444417.325852:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:2.0:1783444417.325868:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575334016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444417.325913:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575334016:12345-0@lo:400:kworker.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444417.325919:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:2.0:1783444417.325950:0:3633:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116997 gen 3 00000004:00080000:2.0:1783444417.325956:0:3633:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116997 committed transno 115964116997 00000100:00100000:2.0:1783444417.326018:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c2c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575334016:0@lo:400:kworker.0 00000100:00100000:2.0:1783444417.326036:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575334528:0@lo:400:kworker.0 00000100:00100000:2.0:1783444417.326061:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444417.326081:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575334528 00000100:00100000:2.0:1783444417.326085:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575334528 00000100:00100000:2.0:1783444417.326105:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1783444417.326111:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575334528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444417.326140:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575334528:12345-0@lo:400:kworker.0 Request processed in 29us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444417.326146:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1783444417.326170:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575334528:0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.326277:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575334144 00000100:00100000:3.0:1783444417.326283:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575334144 00000100:00100000:3.0:1783444417.326344:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575334656 00000100:00100000:3.0:1783444417.326355:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575334656 00000100:00100000:3.0:1783444417.326382:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:3.0:1783444417.326389:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575334144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.326433:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575334144:12345-0@lo:400:kworker.0 Request processed in 45us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.326440:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:3.0:1783444417.326455:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453 00000100:00100000:3.0:1783444417.326462:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575334656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444417.326491:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575334656:12345-0@lo:400:kworker.0 Request processed in 29us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.326497:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453 00000100:00080000:2.0:1783444417.326571:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444417.326631:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575333504 00000100:00100000:0.0:1783444417.326636:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575333504 00000100:00100000:0.0:1783444417.326688:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1783444417.326695:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575333504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444417.326736:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575333504:12345-0@lo:400:kworker.0 Request processed in 41us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444417.326743:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1783444417.326775:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575334144:0@lo:400:kworker.0 00000100:00100000:0.0:1783444417.326820:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f57c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575334656:0@lo:400:kworker.0 00000100:00080000:2.0:1783444417.326905:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444417.326925:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575333504:0@lo:400:kworker.0 00010000:00010000:1.0:1783444417.502206:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444417.821335:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444417.821370:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575335168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444417.821484:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444417.821880:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575335168 00000100:00100000:3.0:1783444417.821892:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575335168 00000100:00100000:3.0:1783444417.821989:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:3.0:1783444417.822002:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575335168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444417.822066:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444794368 avail 1298554880 00000100:00100000:3.0:1783444417.822145:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575335168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444417.822153:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:3.0:1783444417.822215:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575335168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444417.822828:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575335296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444417.822889:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444417.823771:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575335296 00000100:00100000:2.0:1783444417.823783:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575335296 00000100:00100000:2.0:1783444417.823897:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1783444417.823908:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575335296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444417.823935:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444417.824313:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575335296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 405us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444417.824322:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:0.0:1783444417.824528:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575335296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444417.825639:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575335424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444417.825711:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444417.826684:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575335424 00000100:00100000:1.0:1783444417.826698:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575335424 00000100:00100000:1.0:1783444417.826774:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:1.0:1783444417.826786:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575335424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444417.826850:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444417.826943:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575335424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444417.826953:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:3.0:1783444417.827605:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575335424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444418.215363:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444418.215746:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557808512 00000100:00100000:3.0:1783444418.215755:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557808512 00000100:00080000:2.0:1783444418.215936:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444418.217083:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1302 00000100:00100000:3.0:1783444418.217114:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71026:x1870073557808512:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444418.217135:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444418.217160:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3832bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ca9 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444418.217227:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832bf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444418.217241:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444418.217253:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444418.217300:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444418.217303:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444418.217319:0:71469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444418.217341:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f04a00/0x42cb6883e3832bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 8 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444418.217357:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 7 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444418.217365:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f575ff00) 00010000:00010000:3.0:1783444418.217368:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444418.217371:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05000, rc 0) 00000100:00100000:3.0:1783444418.217654:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71026:x1870073557808512:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 558us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444418.217674:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1302 00000100:00100000:0.0:1783444418.232062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444418.232159:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557808640 00000100:00100000:3.0:1783444418.232169:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557808640 00000100:00100000:3.0:1783444418.232243:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1303 00000100:00100000:3.0:1783444418.232253:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71026:x1870073557808640:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444418.232304:0:67017:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444794368 avail 1298554880 00000100:00100000:3.0:1783444418.232394:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71026:x1870073557808640:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 143us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444418.232893:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1303 00000100:00100000:1.0:1783444418.235733:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444418.235898:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557808768 00000100:00100000:0.0:1783444418.235908:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557808768 00000100:00100000:0.0:1783444418.235985:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1304 00000100:00100000:0.0:1783444418.235996:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71026:x1870073557808768:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1783444418.236047:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444418.236123:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71026:x1870073557808768:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 129us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444418.236145:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1304 00000100:00080000:1.0:1783444418.237060:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444418.243625:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444418.243842:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557808896 00000100:00100000:0.0:1783444418.243852:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557808896 00000100:00100000:0.0:1783444418.243930:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1942 00000100:00100000:0.0:1783444418.243941:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71026:x1870073557808896:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1783444418.243990:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444418.244276:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71026:x1870073557808896:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 336us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444418.244283:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1942 00000100:00080000:1.0:1783444418.246224:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444418.248563:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444418.248916:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809024 00000100:00100000:2.0:1783444418.248927:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809024 00000100:00100000:2.0:1783444418.249017:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1943 00000100:00100000:2.0:1783444418.249030:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71026:x1870073557809024:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444418.249067:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444418.249133:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71026:x1870073557809024:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 106us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444418.249141:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1943 00000100:00080000:1.0:1783444418.249182:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783444418.534705:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444419.359121:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444419.359147:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575335552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444419.359220:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444419.359322:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575335552 00000100:00100000:0.0:1783444419.359330:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575335552 00000100:00100000:0.0:1783444419.359399:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:0.0:1783444419.359409:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575335552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444419.359434:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444419.359490:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575335552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444419.359498:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00080000:1.0:1783444419.360093:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444419.360147:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575335552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444419.365733:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444419.365757:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575335680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444419.365845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444419.365888:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575335680 00000100:00100000:3.0:1783444419.365895:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575335680 00000100:00100000:3.0:1783444419.365947:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:3.0:1783444419.365957:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575335680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444419.365982:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444419.366040:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575335680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444419.366048:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00080000:3.0:1783444419.366075:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444419.366109:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e720ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575335680:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783444419.553131:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444419.779018:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444419.779056:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809152 00000100:00100000:0.0:1783444419.779065:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809152 00000100:00100000:0.0:1783444419.779125:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1305 00000100:00100000:0.0:1783444419.779137:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71060:x1870073557809152:12345-192.168.204.20@tcp:101:cp.0 00010000:00010000:0.0:1783444419.779157:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444419.779179:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cb0 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779254:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779269:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779280:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779294:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779301:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779308:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779362:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832c15 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779368:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832c15 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779629:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832c15 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444419.779665:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832c15 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779679:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779692:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779698:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779704:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779709:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444419.779714:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779724:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779736:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368f575ff00) 00010000:00010000:0.0:1783444419.779739:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444419.779743:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779749:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e3832c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779759:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779764:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779769:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779779:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444419.779782:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779847:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779856:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9368d4c9a400) 00010000:00010000:0.0:1783444419.779858:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444419.779861:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.779866:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750400/0x42cb6883e3832c0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.780040:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e3832c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cb0 expref: 9 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.780054:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832c15 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cb0 expref: 8 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.780061:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9368d4c9ab00) 00010000:00010000:0.0:1783444419.780063:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783444419.780066:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751800, rc 0) 00000100:00100000:0.0:1783444419.780170:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71060:x1870073557809152:12345-192.168.204.20@tcp:101:cp.0 Request processed in 1036us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444419.780177:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1305 00000100:00100000:1.0:1783444419.791083:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444419.791545:0:66244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809280 00000100:00100000:2.0:1783444419.791556:0:66244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809280 00000100:00100000:2.0:1783444419.791622:0:66244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1783444419.791634:0:66244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71060:x1870073557809280:12345-192.168.204.20@tcp:900:cp.0 00000100:00100000:2.0:1783444419.791721:0:66244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71060:x1870073557809280:12345-192.168.204.20@tcp:900:cp.0 Request processed in 89us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444419.791729:0:66244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1783444419.798599:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444419.798704:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809408 00000100:00100000:1.0:1783444419.798715:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809408 00000100:00100000:1.0:1783444419.798777:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1306 00000100:00100000:1.0:1783444419.798804:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71060:x1870073557809408:12345-192.168.204.20@tcp:101:cp.0 00010000:00010000:1.0:1783444419.798825:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444419.798849:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11600/0x42cb6883e3832c1c lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cb7 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.798913:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10000/0x42cb6883e3832c23 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.798927:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10000/0x42cb6883e3832c23 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.798940:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10000/0x42cb6883e3832c23 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444419.798999:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783444419.799003:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783444419.799052:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11600/0x42cb6883e3832c1c lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cb7 expref: 8 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.799067:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10000/0x42cb6883e3832c23 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cb7 expref: 7 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.799074:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c300) 00010000:00010000:1.0:1783444419.799077:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1783444419.799089:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10000, rc 0) 00000100:00100000:1.0:1783444419.799150:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71060:x1870073557809408:12345-192.168.204.20@tcp:101:cp.0 Request processed in 364us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444419.799158:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1306 00000100:00100000:1.0:1783444419.816197:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444419.816570:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809536 00000100:00100000:2.0:1783444419.816581:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809536 00000100:00100000:2.0:1783444419.816646:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1307 00000100:00100000:2.0:1783444419.816658:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71060:x1870073557809536:12345-192.168.204.20@tcp:101:cp.0 00010000:00010000:2.0:1783444419.816698:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444419.816722:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71800/0x42cb6883e3832c2a lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cbe expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444419.816830:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444419.816845:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444419.816856:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444419.816870:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444419.816877:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444419.816884:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.819740:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832c3f lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.821635:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832c3f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.821650:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832c3f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444419.821697:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1783444419.821701:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444419.821723:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832c3f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.821739:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.821745:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.821750:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.821757:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.821762:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444419.821766:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.821785:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822619:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c300) 00010000:00010000:1.0:1783444419.822622:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444419.822627:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822634:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3832c31 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822647:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822653:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822659:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822664:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444419.822667:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822672:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822679:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff936901ef2700) 00010000:00010000:1.0:1783444419.822682:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444419.822685:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822702:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70200/0x42cb6883e3832c38 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822748:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71800/0x42cb6883e3832c2a lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cbe expref: 9 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822764:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832c3f lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cbe expref: 8 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444419.822771:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:1.0:1783444419.822773:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783444419.822775:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11c00, rc 0) 00000100:00100000:1.0:1783444419.824034:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71060:x1870073557809536:12345-192.168.204.20@tcp:101:cp.0 Request processed in 7375us (7842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444419.824045:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1307 00000100:00100000:1.0:1783444419.830771:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444419.830845:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809664 00000100:00100000:3.0:1783444419.830857:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809664 00000100:00100000:3.0:1783444419.830927:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1308 00000100:00100000:3.0:1783444419.830937:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71060:x1870073557809664:12345-192.168.204.20@tcp:101:cp.0 00010000:00010000:3.0:1783444419.830960:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444419.831005:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832c46 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cc5 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831076:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831090:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831101:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831114:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831121:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831128:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831183:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831191:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831197:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831214:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831220:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444419.831224:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831232:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831244:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:3.0:1783444419.831247:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444419.831252:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831258:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04800/0x42cb6883e3832c4d lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831270:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831276:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831282:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831287:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444419.831290:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831305:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831313:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9368f575f800) 00010000:00010000:3.0:1783444419.831315:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444419.831318:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831324:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04000/0x42cb6883e3832c54 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831378:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832c46 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cc5 expref: 9 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831389:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:3.0:1783444419.831391:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444419.831394:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04a00/0x42cb6883e3832c46 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cc5 expref: 9 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444419.831401:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04a00, rc 0) 00000100:00100000:3.0:1783444419.831471:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71060:x1870073557809664:12345-192.168.204.20@tcp:101:cp.0 Request processed in 535us (709us total) trans 0 rc 301/301 00000100:00100000:3.0:1783444419.831477:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1308 00000100:00100000:3.0:1783444419.841999:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444419.842084:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809792 00000100:00100000:0.0:1783444419.842102:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809792 00000100:00100000:0.0:1783444419.842164:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1309 00000100:00100000:0.0:1783444419.842175:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71060:x1870073557809792:12345-192.168.204.20@tcp:101:cp.0 00010000:00010000:0.0:1783444419.842197:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444419.842218:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832c5b lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ccc expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842289:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842304:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842316:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842331:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842338:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842345:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842404:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842412:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842417:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842430:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842436:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444419.842441:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842448:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842461:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:0.0:1783444419.842465:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444419.842471:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842491:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750400/0x42cb6883e3832c62 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842502:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842508:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842513:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842518:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444419.842521:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842536:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842544:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9368d4c9a400) 00010000:00010000:0.0:1783444419.842546:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444419.842549:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842554:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4751200/0x42cb6883e3832c69 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842584:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832c5b lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ccc expref: 9 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842593:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:0.0:1783444419.842596:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444419.842599:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4750200/0x42cb6883e3832c5b lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ccc expref: 9 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444419.842608:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750200, rc 0) 00000100:00100000:0.0:1783444419.842662:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71060:x1870073557809792:12345-192.168.204.20@tcp:101:cp.0 Request processed in 489us (672us total) trans 0 rc 301/301 00000100:00100000:0.0:1783444419.842669:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1309 00000100:00100000:3.0:1783444419.853066:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444419.853159:0:66242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809920 00000100:00100000:0.0:1783444419.853169:0:66242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809920 00000100:00100000:0.0:1783444419.853225:0:66242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1783444419.853236:0:66242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71060:x1870073557809920:12345-192.168.204.20@tcp:700:cp.0 00000020:02000000:0.0:1783444419.853259:0:66242:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000001:00100000:1.0:1783444419.872420:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000001:00100000:1.0:1783444419.872433:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:1.0:1783444419.872442:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411439 is committed 00000020:00000080:1.0:1783444419.872454:0:75651:0:(genops.c:906:class_export_put()) final put ffff9367c765d000/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00080000:1.0:1783444419.872469:0:75651:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9367c7512d80 refcount 2 committed 0 result 0 batchid 73014444089 00000020:00080000:1.0:1783444419.872473:0:75651:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9367c1767f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9367c75123c0 00000020:00080000:1.0:1783444419.872476:0:75651:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].1 00000020:00080000:1.0:1783444419.872479:0:75651:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9367c1767a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9368f95b6e00 00000020:00080000:1.0:1783444419.872481:0:75651:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].1 00000020:00000080:1.0:1783444419.872525:0:86011:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c765d000/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-MDT0001 00000020:00000080:1.0:1783444419.872594:0:86011:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff936901dbe000 for lustre-MDT0001 00000020:00080000:3.0:1783444419.872973:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444089 committed batchid 68719476742 00000020:00080000:3.0:1783444419.873056:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 68719476742 00000100:00100000:0.0:1783444419.873532:0:66242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71060:x1870073557809920:12345-192.168.204.20@tcp:700:cp.0 Request processed in 20291us (20468us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444419.873545:0:66242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00010000:00010000:1.0:1783444420.576363:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783444420.897240:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000001:00100000:2.0:1783444420.897253:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:2.0:1783444420.897257:0:9499:0:(genops.c:906:class_export_put()) final put ffff9369006a2800/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:2.0:1783444420.897278:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9369006a2800/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-OST0001 00000020:00000080:2.0:1783444420.897320:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c4489000 for lustre-OST0001 00000001:00100000:3.0:1783444420.898453:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000001:00100000:3.0:1783444420.898472:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:3.0:1783444420.898476:0:8415:0:(genops.c:906:class_export_put()) final put ffff9368ea5f1000/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:3.0:1783444420.898494:0:46305:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea5f1000/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-OST0000 00000020:00000080:3.0:1783444420.898523:0:46305:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368f8ca6800 for lustre-OST0000 00000001:00100000:0.0:1783444420.898606:0:90990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000001:00100000:0.0:1783444420.898613:0:90990:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 778015c5-4969-44f5-82a5-0f6eadd152d5 00000001:00080000:0.0:1783444420.898620:0:90990:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116998 is committed 00000020:00000080:0.0:1783444420.898624:0:90990:0:(genops.c:906:class_export_put()) final put ffff9367c32c8800/778015c5-4969-44f5-82a5-0f6eadd152d5 00000020:00000080:0.0:1783444420.898638:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c32c8800/778015c5-4969-44f5-82a5-0f6eadd152d5 for lustre-MDT0000 00000020:00000080:0.0:1783444420.898674:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368eb785000 for lustre-MDT0000 00010000:00010000:2.0:1783444421.607985:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444421.718557:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444421.718595:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444421.718630:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444421.718684:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557810304 00000100:00100000:1.0:1783444421.718694:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557810304 00000100:00100000:1.0:1783444421.718757:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1038 00000100:00100000:1.0:1783444421.718767:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557810304:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444421.718862:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557810304:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444421.718870:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1038 00000100:00100000:1.0:1783444421.718898:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557810560 00000100:00100000:0.0:1783444421.719198:0:90995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557810048 00000100:00100000:0.0:1783444421.719204:0:90995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557810048 00000100:00100000:0.0:1783444421.719236:0:90995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:0.0:1783444421.719243:0:90995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557810048:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444421.719273:0:90995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557810048:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 31us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444421.719280:0:90995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00080000:0.0:1783444421.719332:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444421.720603:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557810560 00000100:00100000:1.0:1783444421.720746:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2454 00000100:00100000:1.0:1783444421.720756:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557810560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444421.720838:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557810560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 82us (2205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444421.720845:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2454 00000100:00080000:0.0:1783444421.721120:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444421.725647:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444421.725701:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444421.732910:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557810432 00000100:00100000:3.0:1783444421.732926:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557810432 00000100:00100000:3.0:1783444421.733035:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2455 00000100:00100000:3.0:1783444421.733048:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557810432:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444421.733134:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557810432:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 86us (7430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444421.733143:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2455 00000100:00080000:1.0:1783444421.733625:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444421.735412:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557810176 00000100:00100000:2.0:1783444421.735424:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557810176 00000100:00100000:2.0:1783444421.735522:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1039 00000100:00100000:2.0:1783444421.735532:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557810176:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444421.735601:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557810176:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 71us (9963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444421.735609:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1039 00000100:00080000:1.0:1783444421.735760:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444422.432328:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575335808:0@lo:400:kworker.0 00000100:00100000:1.0:1783444422.432405:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.432485:0:90996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575335808 00000100:00100000:2.0:1783444422.432493:0:90996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575335808 00000100:00100000:2.0:1783444422.432533:0:90996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783444422.432542:0:90996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575335808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444422.433114:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575336320:0@lo:400:kworker.0 00000100:00100000:1.0:1783444422.433146:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.434079:0:90996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575335808:12345-0@lo:400:kworker.0 Request processed in 1534us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.434090:0:90996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783444422.434155:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e720d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575335936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444422.434189:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.434243:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575335936 00000100:00100000:2.0:1783444422.434249:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575335936 00000100:00100000:2.0:1783444422.434281:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1783444422.434287:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575335936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444422.434319:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:2.0:1783444422.434353:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575335936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.434507:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1783444422.434549:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e720d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575335936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444422.434579:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575336064:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.434605:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.434638:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444422.434644:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575336192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.434664:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.434691:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575336320 00000100:00100000:2.0:1783444422.434694:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575336320 00000100:00100000:2.0:1783444422.434726:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575336064 00000100:00100000:2.0:1783444422.434728:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575336064 00000100:00100000:2.0:1783444422.434743:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575336192 00000100:00100000:2.0:1783444422.434745:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575336192 00000100:00100000:2.0:1783444422.434760:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1783444422.434766:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575336320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.434815:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575336320:12345-0@lo:400:kworker.0 Request processed in 49us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.434822:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1783444422.434832:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1783444422.434837:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575336064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.434994:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575336064:12345-0@lo:400:kworker.0 Request processed in 155us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.435001:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1783444422.435014:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1783444422.435020:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575336192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.435050:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575336192:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.435056:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:2.0:1783444422.435071:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444422.435075:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444422.435100:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575336192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.435119:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575336064:0@lo:400:kworker.0 00000100:00100000:1.0:1783444422.436146:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575335808:0@lo:400:kworker.0 00000100:00100000:1.0:1783444422.436173:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575336320:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.439508:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575336448:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.439574:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.439606:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575336960:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.439626:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.439648:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783444422.439654:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575336832:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.439678:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.439696:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575337344:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.439715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.439742:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575336832 00000100:00100000:2.0:1783444422.439749:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575336832 00000100:00100000:2.0:1783444422.439811:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:2.0:1783444422.439819:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575336832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440011:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575336832:12345-0@lo:400:kworker.0 Request processed in 192us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.440017:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:2.0:1783444422.440043:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575336448 00000100:00100000:2.0:1783444422.440046:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575336448 00000100:00100000:2.0:1783444422.440071:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575336960 00000100:00100000:2.0:1783444422.440073:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575336960 00000100:00100000:2.0:1783444422.440084:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575337344 00000100:00100000:2.0:1783444422.440086:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575337344 00000100:00100000:2.0:1783444422.440100:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1783444422.440105:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575336448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440133:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575336448:12345-0@lo:400:kworker.0 Request processed in 29us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.440144:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1783444422.440157:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1783444422.440161:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575336960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440185:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575336960:12345-0@lo:400:kworker.0 Request processed in 24us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.440190:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1783444422.440200:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1783444422.440204:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575337344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440239:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575337344:12345-0@lo:400:kworker.0 Request processed in 34us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.440245:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00080000:2.0:1783444422.440268:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444422.440273:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444422.440282:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575336576:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440308:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.440333:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575337088:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440354:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.440549:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783444422.440555:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575336704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440578:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.440598:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575337216:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440619:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.440644:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575337088 00000100:00100000:2.0:1783444422.440648:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575337088 00000100:00100000:2.0:1783444422.440674:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575336704 00000100:00100000:2.0:1783444422.440684:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575336704 00000100:00100000:2.0:1783444422.440704:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575337216 00000100:00100000:2.0:1783444422.440707:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575337216 00000100:00100000:2.0:1783444422.440725:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:2.0:1783444422.440731:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575337088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440768:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575337088:12345-0@lo:400:kworker.0 Request processed in 37us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.440774:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:2.0:1783444422.440786:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1783444422.440811:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575336704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.440838:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575336704:12345-0@lo:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.440844:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1783444422.440854:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:2.0:1783444422.441078:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575337216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.441110:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575337216:12345-0@lo:400:kworker.0 Request processed in 249us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.441115:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00080000:2.0:1783444422.441133:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444422.441136:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444422.441165:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575336704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.441176:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575337216:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.441184:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575337088:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.441212:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575336832:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.441234:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575337344:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.441252:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575336448:0@lo:400:kworker.0 00000100:00100000:2.0:1783444422.441261:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575336960:0@lo:400:kworker.0 00000100:00100000:0.0:1783444422.610689:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575336576 00000100:00100000:0.0:1783444422.610703:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575336576 00000100:00100000:0.0:1783444422.610855:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:0.0:1783444422.610875:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575336576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444422.611051:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575336576:12345-0@lo:400:kworker.0 Request processed in 179us (170742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444422.611059:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:2.0:1783444422.611320:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575336576:0@lo:400:kworker.0 00010000:00010000:0.0:1783444422.620979:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444422.942102:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444422.942126:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575337472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444422.942202:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.942256:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575337472 00000100:00100000:2.0:1783444422.942263:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575337472 00000100:00100000:2.0:1783444422.942315:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:2.0:1783444422.942324:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575337472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444422.942357:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444422.942404:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575337472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.942425:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:2.0:1783444422.942603:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575337472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444422.947678:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444422.947705:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575337600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444422.947780:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444422.948020:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575337600 00000100:00100000:1.0:1783444422.948030:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575337600 00000100:00100000:1.0:1783444422.948094:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:1.0:1783444422.948105:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575337600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444422.948138:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444422.948189:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575337600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444422.948195:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:1.0:1783444422.948241:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575337600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444422.949092:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444422.949104:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575337728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444422.949142:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444422.949178:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575337728 00000100:00100000:2.0:1783444422.949183:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575337728 00000100:00100000:2.0:1783444422.949214:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:2.0:1783444422.949221:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575337728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444422.949244:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444794368 avail 1298554880 00000100:00100000:2.0:1783444422.949279:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575337728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444422.949295:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:2.0:1783444422.949329:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575337728:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1783444423.281214:0:92011:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783444423.281267:0:92011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444423.281282:0:92011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444423.281289:0:92011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444423.281295:0:92011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444423.281314:0:92011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783444423.281320:0:92011:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783444423.281344:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783444423.281348:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783444423.281368:0:92011:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783444423.281393:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9368eb18b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783444423.281523:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e720c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575337856:0@lo:39:umount.0 00010000:00010000:1.0:1783444423.281625:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444423.281643:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.281650:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444423.281654:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.281663:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444423.281669:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444423.281685:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444423.281687:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783444423.281689:0:10324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783444423.281714:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.281721:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444423.281750:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.281757:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5757e00/0x42cb6883e383276f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832776 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.281767:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444423.281768:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444423.281770:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444423.281867:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444423.281879:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575337984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444423.281922:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444423.282070:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444423.282123:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575337984 00000100:00100000:3.0:1783444423.282130:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575337984 00000100:00100000:3.0:1783444423.282177:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1783444423.282187:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575337984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444423.282200:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444423.282216:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1b800/0x42cb6883e3832776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383276f expref: 24 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444423.282228:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444423.282272:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3636:x1870073575337984:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444423.282279:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1783444423.282553:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575337984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444423.282769:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575337856 00000100:00100000:0.0:1783444423.282774:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575337856 00000100:00100000:0.0:1783444423.283021:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1783444423.283029:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575337856:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783444423.283052:0:71469:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383288e 00000100:00080000:0.0:1783444423.283060:0:71469:0:(import.c:65:import_set_state_nolock()) ffff9367c5627000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783444423.283253:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3632:x1870073575337856:12345-0@lo:39:umount.0 Request processed in 224us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444423.283260:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000020:00000080:0.0:1783444423.283268:0:71469:0:(genops.c:906:class_export_put()) final put ffff9367c5625800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783444423.283291:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5625800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783444423.283331:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c5627000 for lustre-MDT0000 00000100:00080000:3.0:1783444423.283395:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb18b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783444423.283503:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e720c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575337856:0@lo:39:umount.0 00000100:00080000:0.0:1783444423.283539:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444423.283542:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783444423.283546:0:92011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783444423.283576:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.284658:0:92011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.284673:0:92011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.284681:0:92011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.284694:0:92011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.285049:0:92011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783444423.285058:0:92011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.285064:0:92011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.285070:0:92011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.285076:0:92011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.285349:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444423.285356:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.285363:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444423.285366:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.285385:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444423.285391:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444423.285396:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444423.285399:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1783444423.285425:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.285506:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783444423.285562:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575338112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444423.285616:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444423.285693:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575338112 00000100:00100000:3.0:1783444423.285701:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575338112 00000100:00100000:3.0:1783444423.285744:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:3.0:1783444423.285754:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3636:x1870073575338112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444423.285757:0:92011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444423.285766:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444423.285768:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444423.285772:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.285778:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10a00 already unused, calling callback (ffffffffc122fc20) 00010000:00010000:3.0:1783444423.285779:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5757200/0x42cb6883e3832696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383268f expref: 23 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444423.285781:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444423.285809:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444423.285960:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.285969:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c11400/0x42cb6883e383268f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832696 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.285980:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444423.285981:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444423.285983:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.286272:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444423.286281:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444423.286293:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783444423.286295:0:6493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1783444423.286298:0:6493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783444423.286315:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.286321:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444423.286336:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.286343:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c10a00/0x42cb6883e3832792 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832799 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.286352:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444423.286354:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1783444423.286354:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.286355:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444423.286365:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575338240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444423.286366:0:92011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.286373:0:92011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.286379:0:92011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.286385:0:92011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444423.286392:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444423.286397:0:92011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783444423.286440:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575338240 00000100:00100000:1.0:1783444423.286444:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575338240 00000100:00100000:1.0:1783444423.286473:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1783444423.286480:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3634:x1870073575338240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444423.286488:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444423.286504:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1b000/0x42cb6883e3832799 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832792 expref: 23 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.286513:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444423.286541:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3634:x1870073575338240:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444423.286548:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1783444423.286587:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575338240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444423.286606:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444423.286611:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.286618:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444423.286621:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.286628:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444423.286635:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444423.286640:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783444423.286643:0:10324:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1783444423.286657:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.286662:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444423.286672:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.286689:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5756600/0x42cb6883e3832761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832768 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444423.286689:0:92011:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783444423.286697:0:92011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.286698:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444423.286699:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444423.286701:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.286704:0:92011:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444423.286710:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575338368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444423.286711:0:92011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.286717:0:92011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.286728:0:92011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783444423.286732:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1783444423.286732:0:92011:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1783444423.286735:0:92011:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:1.0:1783444423.286757:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575338368 00000100:00100000:1.0:1783444423.286761:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575338368 00000020:01000004:0.0:1783444423.286764:0:92011:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783444423.286768:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1783444423.286772:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1783444423.286778:0:92011:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:1.0:1783444423.286782:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1783444423.286804:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3634:x1870073575338368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444423.286813:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444423.286824:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751e00/0x42cb6883e3832768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832761 expref: 22 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.286832:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444423.286859:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3634:x1870073575338368:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444423.286866:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00010000:00010000:1.0:1783444423.287157:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444423.287163:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.287170:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6b1b600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444423.287173:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.287191:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444423.287197:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444423.287202:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444423.287204:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783444423.287206:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783444423.287220:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.287226:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444423.287237:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.287243:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b600/0x42cb6883e383267a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832688 expref: -99 pid: 90989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.287252:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444423.287254:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444423.287256:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444423.287265:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575338496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444423.287292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444423.287326:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575338368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444423.287344:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575338496 00000100:00100000:1.0:1783444423.287347:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575338496 00000100:00100000:1.0:1783444423.287371:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1783444423.287385:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3635:x1870073575338496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444423.287394:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444423.287403:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5756e00/0x42cb6883e3832688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383267a expref: 21 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444423.287411:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444423.287438:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3635:x1870073575338496:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444423.287444:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1783444423.287469:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575338496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444423.287596:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3636:x1870073575338112:12345-0@lo:103:ldlm_bl.0 Request processed in 1842us (1978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444423.287612:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1783444423.287684:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575338112:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1783444423.290534:0:92011:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1783444423.291497:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1783444423.291509:0:92011:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368dd20b800 08efc25c-17e5-4d29-97d2-f1505f195a06 192.168.204.20@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444423.291516:0:92011:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff936901f92800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444423.291520:0:92011:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff936901f93000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444423.291524:0:92011:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff936901f96000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444423.291529:0:92011:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368ff5e5000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 115964116997 stale:0 00000020:00080000:0.0:1783444423.291534:0:92011:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9368dd0e8000) has exports, disconnecting them 00000020:00080000:0.0:1783444423.291539:0:92011:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.20@tcp (ffff9368dd20b800), last request at 1783444421 00000020:00000080:0.0:1783444423.291559:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832bd6 00000020:00010000:0.0:1783444423.291568:0:92011:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368dd20b800: total 0 00000100:00080000:0.0:1783444423.291572:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9368dd209000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444423.291599:0:92011:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368dd20b800): rc 0 00000020:00080000:0.0:1783444423.291602:0:92011:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff936901f92800), last request at 1783444391 00000020:00000080:0.0:1783444423.291604:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832887 00000100:00080000:0.0:1783444423.291608:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9367c5622800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1783444423.291622:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368dd20b800: total 0 00010000:00010000:0.0:1783444423.291664:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368dd20b800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1783444423.291700:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05000/0x42cb6883e3832bf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 3 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.291728:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e3832c15 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cb0 expref: 2 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.291741:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368dd20b800, canceled 2 locks, left on hash table 0. 00000020:00080000:1.0:1783444423.293001:0:92011:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff936901f92800): rc 0 00000020:00000080:1.0:1783444423.293005:0:92011:0:(genops.c:906:class_export_put()) final put ffff936901f92800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1783444423.293019:0:92011:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff936901f93000), last request at 1783444422 00000020:00000080:1.0:1783444423.293025:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832880 00000100:00080000:1.0:1783444423.293032:0:92011:0:(import.c:65:import_set_state_nolock()) ffff936901f97000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783444423.293053:0:86011:0:(genops.c:865:class_export_destroy()) destroying export ffff936901f92800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783444423.293103:0:86011:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c5622800 for lustre-MDT0000 00010000:00010000:1.0:1783444423.293115:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783444423.293123:0:92011:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff936901f93000): rc 0 00000020:00000080:1.0:1783444423.293125:0:92011:0:(genops.c:906:class_export_put()) final put ffff936901f93000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783444423.293131:0:92011:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff936901f96000), last request at 1783444422 00000020:00000080:1.0:1783444423.293135:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832879 00000100:00080000:1.0:1783444423.293143:0:92011:0:(import.c:65:import_set_state_nolock()) ffff936901f94000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783444423.293155:0:86011:0:(genops.c:865:class_export_destroy()) destroying export ffff936901f93000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783444423.293189:0:86011:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff936901f97000 for lustre-MDT0000 00010000:00010000:1.0:1783444423.293198:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783444423.293205:0:92011:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff936901f96000): rc 0 00000020:00000080:1.0:1783444423.293216:0:92011:0:(genops.c:906:class_export_put()) final put ffff936901f96000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1783444423.293224:0:92011:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368ff5e5000), last request at 1783444386 00000020:00000080:1.0:1783444423.293228:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38326e3 00000100:00080000:1.0:1783444423.293236:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9368dd1e8000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783444423.293248:0:86011:0:(genops.c:865:class_export_destroy()) destroying export ffff936901f96000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783444423.293266:0:86011:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff936901f94000 for lustre-MDT0000 00010000:00010000:1.0:1783444423.293272:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1783444423.293279:0:92011:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368ff5e5000): rc 0 00000020:00000080:1.0:1783444423.293281:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368ff5e5000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1783444423.293289:0:92011:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac1c41ccfae0 00000020:00000080:1.0:1783444423.293299:0:86011:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff5e5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783444423.293321:0:86011:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd1e8000 for lustre-MDT0000 00000100:00080000:1.0:1783444423.293339:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783444423.293342:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783444423.294210:0:92011:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783444423.294258:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9368ef12f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783444423.294457:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783444423.294461:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969452 gen 3 00000004:00080000:1.0:1783444423.294474:0:92011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783444423.294561:0:92011:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783444423.294570:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9367c5623000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783444423.294614:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783444423.294629:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 3 00000004:00080000:1.0:1783444423.294637:0:92011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783444423.294707:0:92011:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783444423.294736:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9368ff68c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783444423.294821:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368dd0e8000) has no exports 00010000:00010000:3.0:1783444423.296054:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444423.296075:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575338624:0@lo:39:umount.0 00000100:00100000:3.0:1783444423.296145:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444423.296325:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575338752:0@lo:9:umount.0 00000100:00100000:3.0:1783444423.296353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444423.296373:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575338880:0@lo:9:umount.0 00000100:00100000:3.0:1783444423.296394:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444423.296458:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575338752 00000100:00100000:3.0:1783444423.296465:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575338752 00000100:00100000:3.0:1783444423.296507:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575338880 00000100:00100000:3.0:1783444423.296510:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575338880 00000100:00100000:3.0:1783444423.296530:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5894 00000100:00100000:3.0:1783444423.296539:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575338752:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783444423.296566:0:26211:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832730 00000100:00080000:3.0:1783444423.296577:0:26211:0:(import.c:65:import_set_state_nolock()) ffff9367c5621000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444423.296614:0:26211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:3.0:1783444423.296841:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575338752:12345-0@lo:9:umount.0 Request processed in 220us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444423.296849:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5894 00000100:00100000:3.0:1783444423.297038:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:3.0:1783444423.297046:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575338880:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783444423.297059:0:26211:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383275a 00000100:00080000:3.0:1783444423.297064:0:26211:0:(import.c:65:import_set_state_nolock()) ffff9368c6bce800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444423.297089:0:26211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:3.0:1783444423.297165:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575338880:12345-0@lo:9:umount.0 Request processed in 119us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444423.297184:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00010000:00010000:3.0:1783444423.297211:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444423.297217:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783444423.297246:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c5623000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783444423.297257:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783444423.297260:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444423.297264:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575338752:0@lo:9:umount.0 00000100:00080000:3.0:1783444423.297275:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ff68c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783444423.297302:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783444423.297303:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444423.297306:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575338880:0@lo:9:umount.0 00000100:00100000:2.0:1783444423.297612:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575338624 00000100:00100000:2.0:1783444423.297637:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575338624 00000100:00100000:2.0:1783444423.297688:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:2.0:1783444423.297695:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575338624:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783444423.297712:0:23687:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383271b 00000100:00080000:2.0:1783444423.297717:0:23687:0:(import.c:65:import_set_state_nolock()) ffff9368dd1ef800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783444423.297729:0:23687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411439 00000100:00100000:2.0:1783444423.297887:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3632:x1870073575338624:12345-0@lo:39:umount.0 Request processed in 162us (1711us total) trans 77309411440 rc 0/0 00000100:00100000:2.0:1783444423.297894:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00010000:00010000:3.0:1783444423.298053:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783444423.298078:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef12f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783444423.298084:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575338624:0@lo:39:umount.0 00000020:00080000:1.0:1783444423.300016:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368dd0e8000) has no exports 00000020:00000080:0.0:1783444423.318172:0:6493:0:(genops.c:906:class_export_put()) final put ffff9368dd20b800/08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:0.0:1783444423.318203:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd20b800/08efc25c-17e5-4d29-97d2-f1505f195a06 for lustre-MDT0000 00000020:00000080:0.0:1783444423.318249:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd209000 for lustre-MDT0000 00010000:00010000:0.0:1783444423.318262:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.318264:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.318267:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783444423.379397:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38326f8 00000020:00000080:1.0:1783444423.379413:0:92011:0:(genops.c:906:class_export_put()) final put ffff9367c229c800/lustre-QMT0000_UUID 00000020:01000000:1.0:1783444423.379683:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783444423.379743:0:86011:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c229c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783444423.379846:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444423.379860:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783444423.379864:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9367c1e83380) has no exports 00000020:00000080:0.0:1783444423.380160:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38326f1 00000020:00000080:0.0:1783444423.380168:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368c92d0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444423.380185:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c92d0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444423.380234:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444423.380243:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783444423.380246:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368ff57e800/lustre-QMT0000_UUID 00000020:00000080:0.0:1783444423.380248:0:92011:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff57e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783444423.380267:0:92011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1783444423.380402:0:92011:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c75d2b40 - data ffff9368ffb74798/ffff9368c9fcc000 00000020:01000000:0.0:1783444423.380554:0:92011:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9368dccad1e0 - data ffff9368f61275e8/ffff9367c6aca400 00000100:00080000:2.0:1783444423.422950:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783444423.422958:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783444423.422972:0:92011:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9368e3ef9500 x1870073575338624/t77309411440(77309411440) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444433 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444423.422998:0:92011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783444423.454973:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783444423.454982:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969452 gen 4 00000004:00080000:2.0:1783444423.455008:0:92011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783444423.455027:0:92011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783444423.645820:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783444423.881648:0:91008:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783444423.881655:0:91008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:1.0:1783444423.881666:0:91008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:1.0:1783444423.884121:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783444423.884128:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 4 00000004:00080000:1.0:1783444423.884141:0:92011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783444423.884143:0:92011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783444423.886820:0:91010:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783444423.886827:0:91010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:2.0:1783444423.886839:0:91010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:0.0:1783444423.890034:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38326ab 00000020:00000080:0.0:1783444423.890048:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368c88cb000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444423.891038:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38326c0 00000020:00000080:0.0:1783444423.891045:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368ea5f2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783444423.891052:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783444423.891060:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444423.891071:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783444423.891075:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9368dd0ecd40) has no exports 00000004:01000000:0.0:1783444423.891226:0:92011:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783444423.891235:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832745 00000020:00000080:0.0:1783444423.891239:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368f8ca2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783444423.891243:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783444423.891247:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444423.891254:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783444423.891257:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9368dd0e99c0) has no exports 00000020:00000080:0.0:1783444423.891263:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383273e 00000020:00000080:0.0:1783444423.891267:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368ff68d000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783444423.894821:0:92011:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783444423.894830:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783444423.894834:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 5 00000004:00080000:0.0:1783444423.894842:0:92011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783444423.894844:0:92011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444423.895258:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444423.895274:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444423.895283:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832729 00000020:00000080:0.0:1783444423.895292:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368c88cb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783444423.895299:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783444423.895306:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444423.895326:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783444423.895329:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9367c2c63380) has no exports 00000020:00000080:0.0:1783444423.895345:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832722 00000020:00000080:0.0:1783444423.895838:0:92011:0:(genops.c:906:class_export_put()) final put ffff9367c229c000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783444423.897274:0:92011:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783444423.897280:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783444423.897283:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969452 gen 5 00000004:00080000:0.0:1783444423.897289:0:92011:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783444423.897291:0:92011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444423.897322:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444423.897343:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1783444423.897366:0:92011:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783444423.897372:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383270d 00000020:00000080:0.0:1783444423.897379:0:92011:0:(genops.c:906:class_export_put()) final put ffff9367c6ab4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783444423.897384:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1783444423.897390:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444423.897396:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783444423.897407:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9368e7123380) has no exports 00000020:00000080:0.0:1783444423.897413:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832706 00000020:00000080:0.0:1783444423.897416:0:92011:0:(genops.c:906:class_export_put()) final put ffff9367c6a4b800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783444423.903621:0:92011:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783444423.903630:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783444423.903634:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783444423.903642:0:92011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444423.903678:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444423.904017:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444423.904053:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444423.904058:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444423.904086:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38326c7 00000020:00000080:0.0:1783444423.904094:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368ea5f4800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783444423.904101:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783444423.904108:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444423.904126:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783444423.904129:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9368dd0eb380) has no exports 00000020:00000080:0.0:1783444423.904159:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444423.904163:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444423.904167:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e38326ce 00000020:00000080:0.0:1783444423.904172:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368ea5f7800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783444423.904178:0:92011:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368cb785000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783444423.904182:0:92011:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368cb785000 3 00000020:01000004:0.0:1783444423.904185:0:92011:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368cb785000 from lustre-MDT0000 00000020:00000080:0.0:1783444423.904205:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444423.904208:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783444423.904211:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368c88ca800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783444423.904214:0:92011:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88ca800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783444423.904223:0:92011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783444423.904300:0:92011:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783444423.904304:0:92011:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783444423.904307:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783444423.904310:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444423.904312:0:92011:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783444423.904321:0:92011:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9367c32c9000 28921b6e-3bc9-4a81-ae87-1992169ba754 192.168.204.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444423.904328:0:92011:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9368ff64d000 c89ab73b-dbb2-4305-b221-37cc64d61227 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444423.904332:0:92011:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff9367c3330000) has exports, disconnecting them 00000020:00080000:0.0:1783444423.904336:0:92011:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.20@tcp (ffff9367c32c9000), last request at 1783444416 00000020:00000080:0.0:1783444423.904361:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832bb3 00000020:00010000:0.0:1783444423.904365:0:92011:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9367c32c9000: total 10 00000100:00080000:0.0:1783444423.904369:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9367c32cc000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444423.904391:0:92011:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9367c32c9000): rc 0 00000020:00080000:0.0:1783444423.904394:0:92011:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9368ff64d000), last request at 1783444386 00000020:00000080:0.0:1783444423.904399:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832673 00000020:00010000:0.0:1783444423.904402:0:92011:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368ff64d000: total 10 00000100:00080000:0.0:1783444423.904404:0:92011:0:(import.c:65:import_set_state_nolock()) ffff9368ff649000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444423.904422:0:92011:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368ff64d000): rc 0 00000020:00080000:0.0:1783444423.904426:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9367c3330000) has no exports 00000020:00010000:0.0:1783444423.904451:0:10323:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9367c32c9000: total 10 00010000:00010000:0.0:1783444423.906716:0:10323:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9367c32c9000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1783444423.906770:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751400/0x42cb6883e3832bba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c39 expref: 5 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.906805:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04600/0x42cb6883e3832bcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c78 expref: 4 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.906818:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4750600/0x42cb6883e3832bc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c71 expref: 3 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.906829:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05200/0x42cb6883e3832bc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939c40 expref: 2 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.906839:0:10323:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9367c32c9000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1783444423.906874:0:10323:0:(genops.c:906:class_export_put()) final put ffff9367c32c9000/28921b6e-3bc9-4a81-ae87-1992169ba754 00000020:00010000:0.0:1783444423.906883:0:10323:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368ff64d000: total 11 00010000:00010000:0.0:1783444423.906887:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.906916:0:10323:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368ff64d000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783444423.906933:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c10200/0x42cb6883e38327b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38327ae expref: 14 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.906946:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1a400/0x42cb6883e3832833 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383282c expref: 13 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.906956:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1a000/0x42cb6883e38327c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38327bc expref: 12 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.906964:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c11200/0x42cb6883e3832825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383281e expref: 11 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.906990:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751a00/0x42cb6883e38327df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38327d8 expref: 10 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907000:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1a200/0x42cb6883e3832841 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383283a expref: 9 pid: 90995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907010:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1a600/0x42cb6883e38327d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38327ca expref: 8 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907022:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5757400/0x42cb6883e383284f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832848 expref: 7 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907032:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c10400/0x42cb6883e38327ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38327e6 expref: 6 pid: 90997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907042:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1b400/0x42cb6883e38327fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38327f4 expref: 5 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907051:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5756200/0x42cb6883e3832809 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832802 expref: 4 pid: 90996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907063:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6b1a800/0x42cb6883e3832817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832810 expref: 3 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907072:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4750e00/0x42cb6883e38327a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38327a0 expref: 2 pid: 91001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444423.907081:0:10323:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368ff64d000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1783444423.907096:0:10323:0:(genops.c:906:class_export_put()) final put ffff9368ff64d000/c89ab73b-dbb2-4305-b221-37cc64d61227 00010000:00010000:0.0:1783444423.907101:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.907108:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444423.907110:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444423.915049:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444423.927091:0:91001:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9368eab5d800:91001] 3 exiting: rc = 0 00000100:00100000:1.0:1783444423.927220:0:90997:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9367c59a0a00:90997] 2 exiting: rc = 0 00000100:00100000:0.0:1783444423.927391:0:90995:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9368c5085800:90995] 0 exiting: rc = 1 00000020:00000080:0.0:1783444423.927633:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1783444423.937208:0:90996:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9368c5084600:90996] 1 exiting: rc = 0 00000100:00100000:1.0:1783444423.937718:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.937729:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.937740:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.937748:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.937755:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.937766:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.937779:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.937786:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938050:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938056:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938061:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938067:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938072:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938078:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938083:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938088:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938094:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938099:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938103:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938109:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938115:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938133:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938138:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938143:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938148:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938154:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938158:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938164:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938169:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938175:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938182:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938188:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938193:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938198:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938203:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938207:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938211:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938216:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938221:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938226:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938231:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938239:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938244:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938249:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938257:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938263:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938267:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938272:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938278:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938282:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938287:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938292:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938296:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938302:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938308:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938314:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938327:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938345:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938569:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938577:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938585:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938590:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938595:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783444423.938602:0:92011:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783444423.966610:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea5f2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1783444423.966624:0:77261:0:(genops.c:906:class_export_put()) final put ffff9368dd11a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444423.966626:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd11a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783444423.966636:0:77261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444423.967190:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783444423.967197:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444423.967203:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff68c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783444423.967208:0:77261:0:(genops.c:906:class_export_put()) final put ffff9368c88ce000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444423.967211:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88ce000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783444423.967215:0:77261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444423.967261:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88cb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783444423.967269:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c229c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444423.967275:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c5623000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783444423.967280:0:77261:0:(genops.c:906:class_export_put()) final put ffff9367c6ab5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444423.967282:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c6ab5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783444423.967289:0:77261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444423.968035:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c6ab4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783444423.968044:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c6a4b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444423.968048:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef12f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783444423.968054:0:77261:0:(genops.c:906:class_export_put()) final put ffff9368c88cf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444423.968057:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88cf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783444423.968060:0:77261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444423.968101:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea5f4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783444423.968116:0:77261:0:(genops.c:906:class_export_put()) final put ffff9368dd11c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783444423.968118:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd11c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783444423.968121:0:77261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444423.968150:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea5f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444423.968154:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c32c9000/28921b6e-3bc9-4a81-ae87-1992169ba754 for MGS 00000020:00000080:0.0:1783444423.968183:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff64d000/c89ab73b-dbb2-4305-b221-37cc64d61227 for MGS 00000020:00000080:0.0:1783444423.968292:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c32cc000 for MGS 00000020:00000080:0.0:1783444423.968298:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff649000 for MGS 00000020:01000000:2.0:1783444423.972050:0:92011:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9368e3843780 - data ffff9368ff959000/ffff9367c478c400 00000020:01000000:2.0:1783444423.973316:0:92011:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c4c3d060 - data ffff9368ffb751b0/ffff9368dd0ad400 00000020:00000080:2.0:1783444423.975210:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383266c 00000020:00000080:2.0:1783444423.975222:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368cb786800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783444423.975238:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cb786800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1783444423.975249:0:92011:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368cb785000 from MGS, refs=2 00000020:01000004:2.0:1783444423.975252:0:92011:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368cb785000 2 00000020:01000004:2.0:1783444423.975255:0:92011:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368cb785000 from MGS 00000020:00000080:2.0:1783444423.975277:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444423.975285:0:92011:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783444423.975287:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368ef12d800/MGS 00000020:00000080:2.0:1783444423.975290:0:92011:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef12d800/MGS for MGS 00000020:01000000:2.0:1783444423.975295:0:92011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783444423.975663:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783444423.975668:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444423.975679:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783444423.976021:0:92011:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9368c9a14000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783444423.976029:0:92011:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9368e7120000) has exports, disconnecting them 00000020:00080000:2.0:1783444423.976035:0:92011:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9368c9a14000), last request at 1783444386 00000020:00000080:2.0:1783444423.976040:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832784 00000020:00080000:2.0:1783444423.976052:0:92011:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c9a14000): rc 0 00000020:00000080:2.0:1783444423.976056:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368c9a14000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783444423.976085:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a14000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783444423.981844:0:92011:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783444423.981852:0:92011:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444423.982002:0:92011:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783444423.982010:0:92011:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444423.982141:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444423.982153:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783444423.982160:0:92011:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368cb785000 1 00000020:00000080:0.0:1783444423.982166:0:92011:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383265e 00000020:00000080:0.0:1783444423.982174:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368ef12e000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783444423.982179:0:92011:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783444423.982183:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444423.982188:0:92011:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783444423.982191:0:92011:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9367c1e80000) has no exports 00000020:00000080:0.0:1783444423.986710:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368eb18b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783444423.986724:0:77261:0:(genops.c:906:class_export_put()) final put ffff9368c9a11000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783444423.986727:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a11000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783444423.986734:0:77261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783444423.989809:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef12e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783444424.044880:0:92011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444424.044903:0:92011:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783444424.044909:0:92011:0:(genops.c:906:class_export_put()) final put ffff9368cb780800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444424.044914:0:92011:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cb780800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783444424.044931:0:92011:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783444424.045061:0:92011:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9368cb781000 00000020:02000400:0.0:1783444424.045124:0:92011:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1783444424.477047:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444424.477072:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e720f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575339008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444424.477222:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444424.477274:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575339008 00000100:00100000:3.0:1783444424.477282:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575339008 00000100:00100000:3.0:1783444424.477336:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1783444424.477346:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575339008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444424.477375:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444424.477418:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575339008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444424.477426:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00080000:3.0:1783444424.477460:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444424.477502:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e720f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575339008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444424.479879:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444424.479915:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575339136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444424.479995:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444424.480154:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575339136 00000100:00100000:0.0:1783444424.480162:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575339136 00000100:00100000:0.0:1783444424.480218:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:0.0:1783444424.480227:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575339136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444424.480255:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444424.480297:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575339136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444424.480305:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:0.0:1783444424.480344:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575339136:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783444424.480405:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783444424.678639:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444425.699292:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783444426.023584:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783444426.023924:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411440 is committed 00000020:00000080:3.0:1783444426.023929:0:75651:0:(genops.c:906:class_export_put()) final put ffff9367c448b800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1783444426.023943:0:75651:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444089 batchid updated 00000020:00000080:3.0:1783444426.023972:0:46305:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c448b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00080000:0.0:1783444426.023991:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444089 00000020:00000080:3.0:1783444426.024020:0:46305:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368dd1ef800 for lustre-MDT0001 00000100:00100000:0.0:1783444426.024099:0:75671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7480 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:75671:1870073575339264:0@lo:1000:dist_txn-1.0 00000100:00100000:0.0:1783444426.024178:0:75671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444426.024212:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444426.025087:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575339264 00000100:00100000:3.0:1783444426.025095:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575339264 00000100:00100000:3.0:1783444426.025139:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:3.0:1783444426.025146:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:75671:x1870073575339264:12345-0@lo:1000:dist_txn-1.0 00000020:00080000:3.0:1783444426.025155:0:8431:0:(tgt_handler.c:807:tgt_request_handle()) operation 1000 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783444426.025463:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:75671:x1870073575339264:12345-0@lo:1000:dist_txn-1.0 Request processed in 315us (1283us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444426.025472:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:02020000:0.0:1783444426.025580:0:75671:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation out_update to node 0@lo failed: rc = -107 00000100:00080000:0.0:1783444426.025585:0:75671:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783444426.025591:0:75671:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783444426.025595:0:75671:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783444426.025600:0:75671:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444426.025604:0:75671:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3382 00000100:00080000:0.0:1783444426.025611:0:75671:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444426.025692:0:75671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f8fe4380 x1870073575339392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444426.025727:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444426.025755:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575339392:0@lo:38:dist_txn-1.0 00000100:00100000:3.0:1783444426.025784:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444426.030616:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575339392 00000100:00100000:2.0:1783444426.030630:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575339392 00000100:00100000:2.0:1783444426.030684:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:2.0:1783444426.030703:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575339392:12345-0@lo:38:dist_txn-1.0 00010000:00020000:2.0:1783444426.030727:0:23687:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444426.030857:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575339392:12345-0@lo:38:dist_txn-1.0 Request processed in 154us (5071us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444426.030873:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00080000:3.0:1783444426.054710:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444426.054724:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444426.054728:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575339392:0@lo:38:dist_txn-1.0 00010000:00010000:1.0:1783444426.729261:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444426.827028:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444426.827195:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557810816 00000100:00100000:2.0:1783444426.827206:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557810816 00000100:00100000:2.0:1783444426.827306:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1311 00000100:00100000:2.0:1783444426.827315:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1870073557810816:12345-192.168.204.20@tcp:400:kworker.0 00000020:00080000:2.0:1783444426.827324:0:66223:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.20@tcp 00000100:00100000:2.0:1783444426.827561:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1870073557810816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 244us (543us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783444426.827570:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1311 00000400:00000100:2.0:1783444426.832771:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557810688 offset 0 length 224: 4 00000100:00100000:2.0:1783444426.832887:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444426.832918:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444426.832946:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444426.832960:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557810944 00000100:00100000:0.0:1783444426.832970:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557810944 00000100:00100000:2.0:1783444426.832980:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00080000:2.0:1783444426.833021:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444426.833147:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557811200 00000100:00100000:3.0:1783444426.833152:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557811200 00000100:00100000:3.0:1783444426.833198:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557811072 00000100:00100000:3.0:1783444426.833201:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557811072 00000100:00100000:3.0:1783444426.833222:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2460 00000100:00100000:3.0:1783444426.833232:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557811200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444426.833320:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557811200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 89us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444426.833328:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2460 00000100:00100000:3.0:1783444426.833344:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2461 00000100:00100000:3.0:1783444426.833352:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557811072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444426.833375:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557811072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444426.833383:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2461 00000100:00080000:2.0:1783444426.834163:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444426.834169:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444426.835559:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557811328 00000100:00100000:0.0:1783444426.835583:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557811328 00000100:00100000:0.0:1783444426.835627:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1046 00000100:00100000:0.0:1783444426.835644:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557810944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444426.835686:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1312 00000100:00100000:1.0:1783444426.835692:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557811328:12345-192.168.204.20@tcp:38:ptlrpcd_01_01.0 00000100:00100000:0.0:1783444426.835711:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557810944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 76us (2825us total) trans 0 rc 0/0 00010000:00020000:1.0:1783444426.835714:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444426.835717:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1046 00000100:00100000:1.0:1783444426.835740:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557811328:12345-192.168.204.20@tcp:38:ptlrpcd_01_01.0 Request processed in 48us (2760us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444426.835747:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1312 00000100:00100000:3.0:1783444427.037409:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00080000:0.0:1783444427.549449:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444427.549456:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444427.549460:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444427.549470:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3417 00000100:00100000:3.0:1783444427.549473:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575339904:0@lo:400:kworker.0 00000100:00080000:0.0:1783444427.549478:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783444427.549486:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444427.549511:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f8fe5880 x1870073575340160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444427.549561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444427.549570:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575339520:0@lo:400:kworker.0 00000400:00000100:0.0:1783444427.549602:0:3634:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575339520 offset 0 length 224: 4 00000100:00100000:3.0:1783444427.549606:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f57c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575340544:0@lo:400:kworker.0 00000100:00100000:0.0:1783444427.549631:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575340032:0@lo:400:kworker.0 00000100:00100000:3.0:1783444427.549641:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444427.549666:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444427.549696:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575340160:0@lo:38:kworker.0 00000100:00100000:0.0:1783444427.549704:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575339904 00000100:00100000:0.0:1783444427.549711:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575339904 00000100:00100000:3.0:1783444427.549728:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444427.549757:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575340544 00000100:00100000:0.0:1783444427.549760:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575340544 00000100:00100000:3.0:1783444427.549767:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575340160 00000100:00100000:3.0:1783444427.549773:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575340160 00000100:00100000:0.0:1783444427.549776:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575340032 00000100:00100000:0.0:1783444427.549780:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575340032 00000100:00100000:0.0:1783444427.549843:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1783444427.549855:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:0.0:1783444427.549856:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575340032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444427.549866:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575340160:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444427.549887:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444427.549912:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575340032:12345-0@lo:400:kworker.0 Request processed in 60us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444427.549917:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575339776:0@lo:400:kworker.0 00000100:00100000:0.0:1783444427.549922:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1783444427.549935:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575340160:12345-0@lo:38:kworker.0 Request processed in 67us (205us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444427.549942:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1783444427.549946:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:0.0:1783444427.549952:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3633:x1870073575339904:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444427.549959:0:80475:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783444427.549971:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444427.549977:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575339776 00000100:00100000:3.0:1783444427.549988:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575339776 00000100:00100000:2.0:1783444427.549996:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575340416:0@lo:400:kworker.0 00000100:00100000:3.0:1783444427.550021:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1783444427.550027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444427.550031:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575339776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444427.550053:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783444427.550071:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575339648:0@lo:400:kworker.0 00000100:00100000:3.0:1783444427.550073:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575339776:12345-0@lo:400:kworker.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444427.550082:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1783444427.550095:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1783444427.550100:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1870073575340544:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783444427.550105:0:66226:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783444427.550117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444427.550135:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f8fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575340288:0@lo:400:kworker.0 00000100:00100000:3.0:1783444427.550139:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1870073575340544:12345-0@lo:400:kworker.0 Request processed in 36us (497us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444427.550147:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1783444427.550159:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575339648 00000100:00100000:3.0:1783444427.550163:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575339648 00000100:00100000:2.0:1783444427.550163:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444427.550182:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:3.0:1783444427.550188:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870073575339648:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783444427.550193:0:66226:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783444427.550206:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575339776:0@lo:400:kworker.0 00000100:00100000:3.0:1783444427.550223:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870073575339648:12345-0@lo:400:kworker.0 Request processed in 32us (105us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444427.550229:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00080000:2.0:1783444427.550239:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783444427.550243:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783444427.550247:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1783444427.550250:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575340416 00000100:00080000:2.0:1783444427.550252:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783444427.550255:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575340416 00000100:00080000:2.0:1783444427.550258:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3382 00000100:00100000:0.0:1783444427.550263:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3633:x1870073575339904:12345-0@lo:400:kworker.0 Request processed in 50us (442us total) trans 0 rc -107/-107 00000100:00080000:2.0:1783444427.550265:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444427.550277:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1783444427.550290:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368ff7ad180 x1870073575340672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444427.550304:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444427.550305:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575339648:0@lo:400:kworker.0 00000100:00080000:0.0:1783444427.550311:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444427.550335:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575340032:0@lo:400:kworker.0 00000100:00080000:0.0:1783444427.550420:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783444427.550423:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783444427.550426:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783444427.550429:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444427.550432:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3382 00000100:00080000:0.0:1783444427.550436:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444427.550450:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a90380 x1870073575340800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444427.550472:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f57c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575340544:0@lo:400:kworker.0 00000100:00080000:0.0:1783444427.550483:0:3633:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783444427.550486:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783444427.550488:0:3633:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783444427.550491:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444427.550494:0:3633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3382 00000100:00080000:0.0:1783444427.550497:0:3633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444427.550508:0:3633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a91c00 x1870073575340928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444427.550515:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575340288 00000100:00100000:0.0:1783444427.550518:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575339904:0@lo:400:kworker.0 00000100:00100000:3.0:1783444427.550521:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575340288 00000100:00100000:2.0:1783444427.552277:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575340672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1783444427.552339:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444427.552370:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575340800:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783444427.552389:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444427.552410:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575340928:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1783444427.552427:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783444427.552455:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444427.552460:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444427.552465:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575340160:0@lo:38:kworker.0 00000100:00100000:1.0:1783444427.554435:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:1.0:1783444427.554457:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575340416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444427.554552:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575340416:12345-0@lo:400:kworker.0 Request processed in 105us (4525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444427.554560:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:1.0:1783444427.554619:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575340416:0@lo:400:kworker.0 00000100:00100000:1.0:1783444427.554675:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575340672 00000100:00100000:1.0:1783444427.554693:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575340672 00000100:00100000:1.0:1783444427.554719:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575340800 00000100:00100000:1.0:1783444427.554722:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575340800 00000100:00100000:1.0:1783444427.554737:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575340928 00000100:00100000:1.0:1783444427.554740:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575340928 00000100:00100000:1.0:1783444427.554753:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1783444427.554758:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575340672:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1783444427.554780:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444427.554845:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575340672:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 71us (2491us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444427.554852:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1783444427.554868:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1783444427.554877:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575340800:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783444427.554887:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444427.554914:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575340800:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (2524us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444427.554921:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1783444427.554932:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1783444427.554937:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575340928:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1783444427.554946:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444427.554970:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575340928:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32us (2542us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444427.554978:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00080000:2.0:1783444427.555006:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444427.555013:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444427.555017:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575340672:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1783444427.555025:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444427.555029:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444427.555031:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575340800:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1783444427.555039:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444427.555042:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444427.555044:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575340928:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1783444427.564177:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444427.564258:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:3.0:1783444427.564274:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575340288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444427.565093:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575340288:12345-0@lo:400:kworker.0 Request processed in 822us (14926us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444427.565116:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000100:00100000:3.0:1783444427.565179:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575340288:0@lo:400:kworker.0 00010000:00010000:3.0:1783444427.741037:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444428.061143:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00010000:00010000:0.0:1783444428.767312:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444429.085185:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000001:00100000:0.0:1783444429.096310:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444429.096319:0:8415:0:(genops.c:906:class_export_put()) final put ffff9367c5621800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444429.096344:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5621800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783444429.096382:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c5621000 for lustre-OST0000 00000001:00100000:2.0:1783444429.099973:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444429.099984:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368c6bc8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783444429.100015:0:86112:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c6bc8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783444429.100075:0:86112:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c6bce800 for lustre-OST0001 00000100:00100000:3.0:1783444429.597370:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444429.597393:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575341056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444429.597464:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444429.597597:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575341056 00000100:00100000:2.0:1783444429.597608:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575341056 00000100:00100000:2.0:1783444429.597686:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:2.0:1783444429.597696:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575341056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444429.597725:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444429.597770:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575341056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444429.597777:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00080000:3.0:1783444429.598029:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444429.598079:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575341056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444429.599348:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575341184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444429.599394:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444429.599649:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575341184 00000100:00100000:3.0:1783444429.599655:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575341184 00000100:00100000:3.0:1783444429.599707:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1783444429.599715:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575341184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444429.599736:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783444429.599811:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444429.600677:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575341184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 960us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444429.600686:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1783444429.602109:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575341184:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444429.789002:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444430.109087:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00010000:00010000:1.0:1783444430.813372:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444431.134100:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00010000:00010000:3.0:1783444431.837042:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1783444431.948139:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557811456 offset 0 length 224: 4 00000100:00100000:3.0:1783444431.948197:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444431.948322:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444431.948363:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444431.948433:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557811712 00000100:00100000:1.0:1783444431.948447:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557811712 00000100:00100000:1.0:1783444431.948556:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1049 00000100:00100000:1.0:1783444431.948570:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557811712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444431.948670:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557811712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 103us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444431.948678:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1049 00000100:00080000:0.0:1783444431.949034:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444431.954234:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444431.954730:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557811584 00000100:00100000:1.0:1783444431.954755:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557811584 00000100:00100000:1.0:1783444431.954843:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1319 00000100:00100000:1.0:1783444431.954853:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557811584:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:1.0:1783444431.954898:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444431.954985:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557811584:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 131us (771us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444431.954994:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1319 00000100:00100000:2.0:1783444431.959415:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557811840 00000100:00100000:2.0:1783444431.959442:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557811840 00000100:00100000:1.0:1783444431.959981:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557811968 00000100:00100000:1.0:1783444431.959987:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557811968 00000100:00100000:1.0:1783444431.960034:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2464 00000100:00100000:1.0:1783444431.960047:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557811840:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444431.960166:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557811840:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 122us (11968us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444431.960175:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2464 00000100:00100000:3.0:1783444431.960576:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2465 00000100:00100000:3.0:1783444431.960608:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557811968:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444431.960647:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557811968:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 43us (12284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444431.960654:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2465 00000100:00080000:2.0:1783444431.962692:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444431.962714:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444432.157259:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00080000:0.0:1783444432.669263:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444432.669272:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444432.669278:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444432.669289:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3418 00000100:00080000:0.0:1783444432.669298:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783444432.669306:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444432.669319:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575341312:0@lo:400:kworker.0 00000100:00100000:0.0:1783444432.669363:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a90700 x1870073575341440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1783444432.669401:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575341312 offset 0 length 224: 4 00000100:00080000:0.0:1783444432.669424:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444432.669430:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444432.669432:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444432.669437:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3418 00000100:00080000:0.0:1783444432.669440:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783444432.669445:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444432.669460:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e6a90380 x1870073575341696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444432.669480:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444432.669484:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444432.669486:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444432.669490:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3418 00000100:00080000:0.0:1783444432.669493:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783444432.669498:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444432.669511:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368ff5fe680 x1870073575341952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444432.669517:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f57c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575341824:0@lo:400:kworker.0 00000100:00080000:0.0:1783444432.669549:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444432.669553:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444432.669555:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444432.669560:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3418 00000100:00080000:0.0:1783444432.669563:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783444432.669568:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444432.669571:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444432.669592:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c436bb80 x1870073575342336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444432.669603:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444432.669611:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575341568:0@lo:400:kworker.0 00000100:00100000:2.0:1783444432.669638:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444432.669672:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575341824 00000100:00100000:2.0:1783444432.669677:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575341568 00000100:00100000:0.0:1783444432.669680:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575341824 00000100:00100000:2.0:1783444432.669683:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575341568 00000100:00100000:1.0:1783444432.670079:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575342080:0@lo:400:kworker.0 00000100:00100000:2.0:1783444432.670555:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1783444432.670568:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575341568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444432.670637:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575341568:12345-0@lo:400:kworker.0 Request processed in 72us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444432.670646:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00080000:2.0:1783444432.670670:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444432.670719:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575341568:0@lo:400:kworker.0 00000100:00100000:2.0:1783444432.670761:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575342208:0@lo:400:kworker.0 00000100:00100000:2.0:1783444432.670808:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444432.670852:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575342208 00000100:00100000:2.0:1783444432.670857:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575342208 00000100:00100000:2.0:1783444432.670894:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:2.0:1783444432.670904:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575342208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444432.670939:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575342208:12345-0@lo:400:kworker.0 Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444432.670946:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00080000:2.0:1783444432.670972:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444432.671002:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575342208:0@lo:400:kworker.0 00000100:00100000:1.0:1783444432.671026:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444432.671091:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575342080 00000100:00100000:1.0:1783444432.671096:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575342080 00000100:00100000:1.0:1783444432.671140:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:1.0:1783444432.671147:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575342080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444432.671188:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575342080:12345-0@lo:400:kworker.0 Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444432.671195:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00080000:2.0:1783444432.671199:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444432.671518:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575341440:0@lo:38:kworker.0 00000100:00100000:3.0:1783444432.671563:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444432.671585:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e6a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575341696:0@lo:38:kworker.0 00000100:00100000:3.0:1783444432.671611:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444432.671628:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575341952:0@lo:38:kworker.0 00000100:00100000:3.0:1783444432.671653:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444432.671670:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575342336:0@lo:38:kworker.0 00000100:00100000:3.0:1783444432.671690:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444432.671725:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575341440 00000100:00100000:3.0:1783444432.671729:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575341440 00000100:00100000:3.0:1783444432.671769:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575341696 00000100:00100000:3.0:1783444432.671773:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575341696 00000100:00100000:3.0:1783444432.671785:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575342336 00000100:00100000:3.0:1783444432.671802:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575342336 00000100:00100000:3.0:1783444432.671816:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1783444432.671822:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575341440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444432.671855:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444432.671894:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575341440:12345-0@lo:38:kworker.0 Request processed in 70us (330us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444432.671901:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1783444432.671916:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1783444432.671930:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575341696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444432.671942:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444432.671979:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575341696:12345-0@lo:38:kworker.0 Request processed in 48us (367us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444432.671985:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1783444432.671998:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1783444432.672002:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575342336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444432.672010:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444432.672032:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575342336:12345-0@lo:38:kworker.0 Request processed in 29us (342us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444432.672038:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00080000:3.0:1783444432.672082:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444432.672087:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444432.672091:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575341440:0@lo:38:kworker.0 00000100:00080000:3.0:1783444432.672100:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444432.672103:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444432.672106:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575341696:0@lo:38:kworker.0 00000100:00080000:3.0:1783444432.672114:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444432.672117:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444432.672119:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575342336:0@lo:38:kworker.0 00000100:00100000:3.0:1783444432.672172:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575341952 00000100:00100000:3.0:1783444432.672176:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575341952 00000100:00100000:3.0:1783444432.672198:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:3.0:1783444432.672203:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575341952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444432.672233:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444432.672275:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575341952:12345-0@lo:38:kworker.0 Request processed in 71us (622us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444432.672281:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00080000:3.0:1783444432.672310:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444432.672314:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444432.672316:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575341952:0@lo:38:kworker.0 00000100:00100000:1.0:1783444432.672420:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575342080:0@lo:400:kworker.0 00000100:00100000:0.0:1783444432.677520:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1783444432.677546:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575341824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444432.677689:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575341824:12345-0@lo:400:kworker.0 Request processed in 154us (8120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444432.677697:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1783444432.678125:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f57c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575341824:0@lo:400:kworker.0 00010000:00010000:0.0:1783444432.861375:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444433.180957:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00010000:00010000:0.0:1783444433.885085:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444434.207374:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:2.0:1783444434.717216:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444434.717253:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575342464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444434.717325:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444434.717569:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575342464 00000100:00100000:0.0:1783444434.717577:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575342464 00000100:00100000:0.0:1783444434.717648:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1783444434.717657:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575342464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444434.717686:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444434.717759:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575342464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444434.717767:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1783444434.718120:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575342464:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783444434.718251:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444434.729306:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575342592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444434.729383:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444434.730116:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575342592 00000100:00100000:2.0:1783444434.730126:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575342592 00000100:00100000:2.0:1783444434.730217:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:2.0:1783444434.730227:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575342592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444434.730259:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444434.730319:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575342592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444434.730326:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1783444434.730527:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575342592:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783444434.730742:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783444434.909307:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444435.229192:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00010000:00010000:3.0:1783444435.934550:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444436.256695:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00010000:00010000:1.0:1783444437.004139:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444437.286759:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000400:00000100:1.0:1783444437.383049:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557812096 offset 0 length 224: 4 00000100:00100000:1.0:1783444437.383093:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444437.383121:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444437.383139:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444437.383180:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444437.385104:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557812224 00000100:00100000:3.0:1783444437.385117:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557812224 00000100:00100000:3.0:1783444437.385172:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557812352 00000100:00100000:3.0:1783444437.385176:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557812352 00000100:00100000:3.0:1783444437.385220:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1052 00000100:00100000:3.0:1783444437.385230:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2400:x1870073557812352:12345-192.168.204.20@tcp:38:kworker.0 00010000:02000400:3.0:1783444437.385259:0:67017:0:(ldlm_lib.c:951:target_handle_reconnect()) lustre-MDT0001: Client 08efc25c-17e5-4d29-97d2-f1505f195a06 (at 192.168.204.20@tcp) reconnecting 00000100:00100000:0.0:1783444437.385836:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557812480 00000100:00100000:0.0:1783444437.385842:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557812480 00000100:00100000:0.0:1783444437.385889:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557812608 00000100:00100000:0.0:1783444437.385892:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557812608 00000100:00100000:0.0:1783444437.385915:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2468 00000100:00100000:0.0:1783444437.385924:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557812480:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444437.386007:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557812480:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 83us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444437.386015:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2468 00000100:00100000:0.0:1783444437.386033:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2469 00000100:00100000:0.0:1783444437.386040:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557812608:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444437.386065:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557812608:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444437.386071:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2469 00000100:00100000:0.0:1783444437.386091:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1323 00000100:00100000:0.0:1783444437.386095:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557812224:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444437.386111:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444437.386133:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557812224:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 36us (3040us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444437.386139:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1323 00000100:00080000:0.0:1783444437.386187:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444437.386191:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444437.386193:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783444437.406476:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp ffff9368dd20c800 cur 3428 last 1783444437 00000004:00100000:3.0:1783444437.406511:0:67017:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.204.20@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1783444437.406549:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368dd209800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1783444437.406559:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368dd209800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444437.406653:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2400:x1870073557812352:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 21411us (23499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444437.406666:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1052 00000100:00100000:3.0:1783444437.425764:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444437.425818:0:66242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557809920 00000100:00100000:3.0:1783444437.425828:0:66242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557809920 00000100:00100000:3.0:1783444437.425889:0:66242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1783444437.425899:0:66242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71060:x1870073557809920:12345-192.168.204.20@tcp:700:cp.0 00000100:00080000:3.0:1783444437.425975:0:66242:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9368e69afb80 x1870073575342720/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444437.425986:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00080000:0.0:1783444437.788991:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444437.789000:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444437.789005:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444437.789014:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3423 00000100:00080000:0.0:1783444437.789020:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783444437.789027:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444437.789039:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444437.789052:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4368a80 x1870073575342976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444437.789058:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575342848:0@lo:400:kworker.0 00000100:00080000:0.0:1783444437.789106:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444437.789110:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444437.789112:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000400:00000100:2.0:1783444437.789113:0:3636:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575342848 offset 0 length 224: 4 00000100:00080000:0.0:1783444437.789116:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3423 00000100:00080000:0.0:1783444437.789118:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783444437.789122:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444437.789337:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575342976:0@lo:38:kworker.0 00000100:00100000:2.0:1783444437.789396:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575343104:0@lo:400:kworker.0 00000100:00100000:3.0:1783444437.789453:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444437.792163:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd159500 x1870073575343232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444437.792214:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444437.792218:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444437.792221:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444437.792226:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3423 00000100:00080000:0.0:1783444437.792231:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783444437.792238:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444437.792254:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3808380 x1870073575343488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444437.792287:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1783444437.792657:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575342976 00000100:00100000:2.0:1783444437.792666:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575342976 00000100:00100000:2.0:1783444437.792712:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1783444437.792720:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575342976:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444437.792743:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444437.793222:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575343360:0@lo:400:kworker.0 00000100:00100000:1.0:1783444437.793271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444437.793309:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444437.793316:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575343616:0@lo:400:kworker.0 00000100:00100000:3.0:1783444437.794022:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575343360 00000100:00100000:3.0:1783444437.794030:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575343360 00000100:00100000:3.0:1783444437.794084:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1783444437.794084:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444437.794092:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575343360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444437.794119:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575343616 00000100:00100000:1.0:1783444437.794123:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575343616 00000100:00100000:3.0:1783444437.794145:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575343360:12345-0@lo:400:kworker.0 Request processed in 53us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444437.794152:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1783444437.794154:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:1.0:1783444437.794159:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575343616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444437.794191:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575343616:12345-0@lo:400:kworker.0 Request processed in 31us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444437.794198:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00080000:0.0:1783444437.794942:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444437.794946:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444437.794951:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3423 00000100:00080000:0.0:1783444437.794955:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783444437.794960:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444437.794989:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e380b800 x1870073575343872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444437.795143:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575343744:0@lo:400:kworker.0 00000100:00100000:2.0:1783444437.798281:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575342976:12345-0@lo:38:kworker.0 Request processed in 5550us (8818us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444437.798311:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00080000:2.0:1783444437.798371:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444437.798378:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444437.798422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444437.798578:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575343104 00000100:00100000:3.0:1783444437.798587:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575343104 00000100:00100000:3.0:1783444437.798652:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1783444437.798662:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575343104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444437.798728:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575343104:12345-0@lo:400:kworker.0 Request processed in 68us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444437.798736:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1783444437.798814:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575343616:0@lo:400:kworker.0 00000100:00100000:3.0:1783444437.798834:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575343360:0@lo:400:kworker.0 00000100:00100000:3.0:1783444437.798978:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575343232:0@lo:38:kworker.0 00000100:00100000:3.0:1783444437.799014:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444437.799039:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575343488:0@lo:38:kworker.0 00000100:00100000:3.0:1783444437.799066:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444437.799084:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575343872:0@lo:38:kworker.0 00000100:00100000:3.0:1783444437.799106:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444437.799130:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444437.799135:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444437.799138:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575342976:0@lo:38:kworker.0 00000100:00100000:3.0:1783444437.799163:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575343488 00000100:00100000:3.0:1783444437.799167:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575343488 00000100:00100000:3.0:1783444437.799689:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1783444437.799697:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575343488:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444437.799719:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444437.799761:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575343488:12345-0@lo:38:kworker.0 Request processed in 63us (693us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444437.799768:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1783444437.800095:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575343232 00000100:00100000:3.0:1783444437.800100:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575343232 00000100:00100000:3.0:1783444437.800132:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575343872 00000100:00100000:3.0:1783444437.800136:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575343872 00000100:00100000:3.0:1783444437.800151:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1783444437.800156:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575343232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444437.800167:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444437.800249:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1783444437.800256:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575343872:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444437.800266:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444437.800300:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575343872:12345-0@lo:38:kworker.0 Request processed in 43us (1192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444437.800306:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1783444437.800340:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575343232:12345-0@lo:38:kworker.0 Request processed in 182us (1324us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444437.800347:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00080000:3.0:1783444437.800375:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444437.800379:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444437.800383:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575343232:0@lo:38:kworker.0 00000100:00080000:3.0:1783444437.800392:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444437.800395:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444437.800398:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575343488:0@lo:38:kworker.0 00000100:00080000:3.0:1783444437.800405:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444437.800408:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444437.800411:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575343872:0@lo:38:kworker.0 00000100:00080000:3.0:1783444437.800449:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444437.803972:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444437.804119:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575343744 00000100:00100000:1.0:1783444437.804128:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575343744 00000100:00100000:1.0:1783444437.804189:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:1.0:1783444437.804198:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575343744:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783444437.804202:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444437.804284:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575343744:12345-0@lo:400:kworker.0 Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444437.804292:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:3.0:1783444437.804454:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575343744:0@lo:400:kworker.0 00000100:00100000:2.0:1783444437.805156:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575343104:0@lo:400:kworker.0 00010000:00010000:0.0:1783444438.045757:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444438.300939:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444438.428910:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:0.0:1783444439.069191:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444439.330603:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:0.0:1783444439.461730:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00100000:3.0:1783444439.837032:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444439.837058:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575344000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444439.837129:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444439.837185:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575344000 00000100:00100000:3.0:1783444439.837193:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575344000 00000100:00100000:3.0:1783444439.837247:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:3.0:1783444439.837257:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575344000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444439.837286:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444439.837348:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575344000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444439.837355:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00080000:3.0:1783444439.837376:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444439.837411:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575344000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444439.837700:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444439.837712:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575344128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444439.837746:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444439.838266:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575344128 00000100:00100000:0.0:1783444439.838272:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575344128 00000100:00100000:0.0:1783444439.838329:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:0.0:1783444439.838341:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575344128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444439.838362:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444439.838406:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575344128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444439.838413:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:0.0:1783444439.838448:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575344128:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783444439.838535:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783444440.233392:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444440.353862:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444440.480383:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:2.0:1783444441.120613:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444441.164162:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444441.165726:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557813120 00000100:00100000:0.0:1783444441.165737:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557813120 00000400:00000100:2.0:1783444441.165881:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557812864 offset 0 length 224: 4 00000100:00100000:1.0:1783444441.165884:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1055 00000100:00100000:1.0:1783444441.165897:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2404:x1870073557813120:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444441.165916:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444441.165945:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444441.165966:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444441.165984:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557812992 00000100:00100000:2.0:1783444441.165988:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557812992 00000100:00100000:2.0:1783444441.166011:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1327 00000100:00100000:2.0:1783444441.166017:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557812992:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444441.166038:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444441.166084:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557812992:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 65us (169us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444441.166092:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1327 00000100:00080000:3.0:1783444441.166317:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444441.166330:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557813248 00000100:00100000:3.0:1783444441.166334:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557813248 00000100:00080000:2.0:1783444441.166398:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444441.166531:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557813376 00000100:00100000:3.0:1783444441.166535:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557813376 00000100:00080000:0.0:1783444441.166604:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444441.166718:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2404:x1870073557813120:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 821us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444441.166726:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1055 00000100:00100000:3.0:1783444441.166935:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5896 00000100:00100000:3.0:1783444441.167470:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2400:x1870073557813248:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:3.0:1783444441.167496:0:26202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832be4 00000100:00080000:3.0:1783444441.167504:0:26202:0:(import.c:65:import_set_state_nolock()) ffff9367c17cc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444441.167552:0:26202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:3.0:1783444441.167719:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+2:2400:x1870073557813248:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 776us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444441.167727:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5896 00000100:00100000:3.0:1783444441.167744:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5897 00000100:00100000:3.0:1783444441.167758:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2400:x1870073557813376:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:3.0:1783444441.167770:0:26202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832beb 00000100:00080000:3.0:1783444441.167775:0:26202:0:(import.c:65:import_set_state_nolock()) ffff9368f98b7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444441.167813:0:26202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:3.0:1783444441.167877:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+2:2400:x1870073557813376:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 120us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444441.167884:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5897 00010000:00010000:0.0:1783444441.167952:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444441.167959:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444441.373476:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:1.0:1783444441.503910:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:0.0:1783444442.144411:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444442.400311:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:1.0:1783444442.524998:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00080000:0.0:1783444442.918395:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444442.918402:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444442.918406:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444442.918414:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3428 00000100:00080000:0.0:1783444442.918419:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783444442.919612:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444442.919643:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3809f80 x1870073575344384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444442.919681:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444442.919686:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444442.919688:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444442.919692:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3428 00000100:00080000:0.0:1783444442.919696:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783444442.919699:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444442.919711:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e380a300 x1870073575344640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444442.919728:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444442.919731:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444442.919733:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444442.919736:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3428 00000100:00080000:0.0:1783444442.919738:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444442.919742:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444442.919754:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c56f6d80 x1870073575344896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444442.919774:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444442.919776:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444442.919778:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444442.919781:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3428 00000100:00080000:0.0:1783444442.919783:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1783444442.919990:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575345024:0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.920063:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444442.920178:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783444442.920187:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575344256:0@lo:400:kworker.0 00000400:00000100:2.0:1783444442.920210:0:3633:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575344256 offset 0 length 224: 4 00000100:00100000:2.0:1783444442.920236:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575345152:0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.920268:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444442.920515:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444442.920535:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c2c89880 x1870073575345280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444442.921152:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575345024 00000100:00100000:3.0:1783444442.921160:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575345024 00000100:00100000:3.0:1783444442.921210:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575345152 00000100:00100000:3.0:1783444442.921214:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575345152 00000100:00100000:3.0:1783444442.921240:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:3.0:1783444442.921250:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575345024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444442.921304:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575345024:12345-0@lo:400:kworker.0 Request processed in 56us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444442.921311:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:3.0:1783444442.921327:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:3.0:1783444442.921334:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575345152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444442.921362:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575345152:12345-0@lo:400:kworker.0 Request processed in 28us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444442.921368:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1783444442.922158:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575345152:0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.922172:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575345024:0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.922851:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575344768:0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.922895:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444442.922930:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444442.922937:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575344512:0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.922961:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444442.923091:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575344384:0@lo:38:kworker.0 00000100:00100000:2.0:1783444442.923117:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444442.923137:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575344640:0@lo:38:kworker.0 00000100:00100000:2.0:1783444442.923161:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444442.923180:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575344896:0@lo:38:kworker.0 00000100:00100000:2.0:1783444442.923204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444442.923221:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c2c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575345280:0@lo:38:kworker.0 00000100:00100000:2.0:1783444442.923241:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444442.923270:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575344768 00000100:00100000:2.0:1783444442.923275:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575344768 00000100:00100000:2.0:1783444442.923313:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575344512 00000100:00100000:2.0:1783444442.923316:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575344512 00000100:00100000:2.0:1783444442.923331:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575344384 00000100:00100000:2.0:1783444442.923334:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575344384 00000100:00100000:2.0:1783444442.923344:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575344640 00000100:00100000:2.0:1783444442.923346:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575344640 00000100:00100000:2.0:1783444442.923353:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575345280 00000100:00100000:2.0:1783444442.923356:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575345280 00000100:00100000:2.0:1783444442.923378:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1783444442.923386:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575344768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.923432:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575344768:12345-0@lo:400:kworker.0 Request processed in 46us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444442.923438:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1783444442.923453:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1783444442.923459:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575344512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.923485:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575344512:12345-0@lo:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444442.923491:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1783444442.923502:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1783444442.923506:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575344384:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444442.923523:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444442.923672:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575344384:12345-0@lo:38:kworker.0 Request processed in 163us (553us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444442.923679:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1783444442.923693:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1783444442.923697:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575344640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444442.923707:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444442.923730:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575344640:12345-0@lo:38:kworker.0 Request processed in 31us (567us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444442.923735:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1783444442.923746:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1783444442.923749:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575345280:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444442.923758:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444442.923962:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575345280:12345-0@lo:38:kworker.0 Request processed in 210us (719us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444442.923967:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1783444442.923988:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575344896 00000100:00100000:2.0:1783444442.923992:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575344896 00000100:00100000:2.0:1783444442.924012:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:2.0:1783444442.924017:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575344896:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444442.924027:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444442.924054:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575344896:12345-0@lo:38:kworker.0 Request processed in 35us (849us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444442.924060:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:2.0:1783444442.924100:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575344512:0@lo:400:kworker.0 00000100:00100000:2.0:1783444442.924111:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575344768:0@lo:400:kworker.0 00000100:00080000:2.0:1783444442.924140:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444442.924145:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444442.924148:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575344384:0@lo:38:kworker.0 00000100:00080000:2.0:1783444442.924157:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444442.924160:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444442.924163:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e380a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575344640:0@lo:38:kworker.0 00000100:00080000:2.0:1783444442.924170:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444442.924172:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444442.924175:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575344896:0@lo:38:kworker.0 00000100:00080000:2.0:1783444442.924182:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444442.924186:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444442.924197:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c2c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575345280:0@lo:38:kworker.0 00000100:00080000:0.0:1783444442.924559:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444442.924565:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444442.924568:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783444443.167608:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444443.219436:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:0.0:1783444443.219463:0:3626:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557813504 offset 0 length 520: 4 00000100:00100000:0.0:1783444443.219486:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444443.219758:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557813760 00000100:00100000:2.0:1783444443.219769:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557813760 00000100:00100000:2.0:1783444443.219851:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557813632 00000100:00100000:2.0:1783444443.219855:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557813632 00000100:00100000:2.0:1783444443.219872:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1058 00000100:00100000:2.0:1783444443.219882:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557813760:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444443.219953:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557813760:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444443.219961:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1058 00000100:00100000:2.0:1783444443.219976:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1331 00000100:00100000:2.0:1783444443.219981:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557813632:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444443.220002:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444443.220022:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557813632:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 40us (536us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444443.220029:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1331 00000100:00080000:0.0:1783444443.221543:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444443.422501:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:1.0:1783444443.548906:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00000400:3.0:1783444443.937370:0:3634:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444427/real 1783444427] req@ffff9368f8fe6d80 x1870073575339520/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444443 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444443.937399:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9368f8fe6d80 x1870073575339520/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444443 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444443.937430:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783444443.937434:0:3634:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783444443.937438:0:3634:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783444443.937440:0:3634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783444443.937445:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368f8fe6d80 x1870073575339520/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444443 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444443.937454:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368e6a93b80 x1870073575341312/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444448 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444443.937466:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c436bb80 x1870073575342848/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444453 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444443.937475:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9368e3808380 x1870073575344256/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444458 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783444443.937486:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783444443.937488:0:3634:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783444443.937490:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783444443.937492:0:3634:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1783444443.937504:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575339520:0@lo:400:kworker.0 00000100:00080000:3.0:1783444443.937545:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444443.937550:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783444443.937552:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444443.937557:0:92306:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3377 00000100:00080000:3.0:1783444443.937564:0:92306:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444443.937591:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5972d80 x1870073575345408/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444443.937608:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444443.937611:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444443.937617:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444443.937621:0:92306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3433 00000100:00080000:3.0:1783444443.937624:0:92306:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444443.937628:0:92306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444443.937642:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4368a80 x1870073575345536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444443.937662:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444443.937665:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444443.937666:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444443.937669:0:92306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3433 00000100:00080000:3.0:1783444443.937671:0:92306:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444443.937674:0:92306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444443.937686:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd170700 x1870073575345792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444443.937699:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444443.937702:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444443.937703:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444443.937706:0:92306:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3433 00000100:00080000:3.0:1783444443.937709:0:92306:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444443.937712:0:92306:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444443.937721:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd173b80 x1870073575346048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444443.937744:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444443.937747:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444443.937753:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444443.937757:0:92306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3433 00000100:00080000:3.0:1783444443.937759:0:92306:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444443.937762:0:92306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444443.937783:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c33f1880 x1870073575346432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444443.938527:0:66241:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:2.0:1783444443.938536:0:66241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:2.0:1783444443.938558:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575345408:0@lo:250:kworker.0 00000400:00000100:2.0:1783444443.938601:0:3632:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575345408 offset 0 length 520: 4 00000100:00100000:2.0:1783444443.938632:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575345536:0@lo:38:kworker.0 00000100:00100000:2.0:1783444443.938656:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444443.938677:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575345792:0@lo:38:kworker.0 00000100:00100000:2.0:1783444443.938699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444443.938728:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575346048:0@lo:38:kworker.0 00000100:00100000:2.0:1783444443.938752:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444443.938770:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575346432:0@lo:38:kworker.0 00000100:00100000:2.0:1783444443.938809:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444443.938838:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ea496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575345664:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.938862:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444443.938880:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444443.938886:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575345920:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.938907:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444443.939005:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575345536 00000100:00100000:2.0:1783444443.939012:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575345536 00000100:00100000:2.0:1783444443.939049:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575345792 00000100:00100000:2.0:1783444443.939052:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575345792 00000100:00100000:2.0:1783444443.939062:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575346432 00000100:00100000:2.0:1783444443.939064:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575346432 00000100:00100000:2.0:1783444443.939071:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575345664 00000100:00100000:2.0:1783444443.939073:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575345664 00000100:00100000:2.0:1783444443.939095:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575345920 00000100:00100000:2.0:1783444443.939097:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575345920 00000100:00100000:2.0:1783444443.939109:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1783444443.939116:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575345664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939163:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575345664:12345-0@lo:400:kworker.0 Request processed in 46us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444443.939170:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1783444443.939183:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1783444443.939188:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575345920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939225:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575345920:12345-0@lo:400:kworker.0 Request processed in 36us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444443.939240:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1783444443.939259:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1783444443.939263:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575345536:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444443.939281:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444443.939309:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575345536:12345-0@lo:38:kworker.0 Request processed in 44us (652us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444443.939314:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1783444443.939323:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1783444443.939327:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e380a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575345792:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444443.939335:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444443.939352:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e380a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575345792:12345-0@lo:38:kworker.0 Request processed in 24us (653us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444443.939357:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1783444443.939365:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1783444443.939368:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575346432:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444443.939376:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444443.939392:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575346432:12345-0@lo:38:kworker.0 Request processed in 22us (582us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444443.939397:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1783444443.939416:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575346048 00000100:00100000:2.0:1783444443.939419:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575346048 00000100:00100000:2.0:1783444443.939442:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:2.0:1783444443.939446:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575346048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444443.939456:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444443.939488:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575346048:12345-0@lo:38:kworker.0 Request processed in 41us (735us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444443.939494:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:2.0:1783444443.939535:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575346176:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444443.939584:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575344256:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939598:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444443.939604:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575346304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939624:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444443.939647:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575346176 00000100:00100000:2.0:1783444443.939651:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575346176 00000100:00100000:2.0:1783444443.939674:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575346304 00000100:00100000:2.0:1783444443.939678:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575346304 00000100:00100000:2.0:1783444443.939712:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1783444443.939720:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575346176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939756:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575346176:12345-0@lo:400:kworker.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444443.939762:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1783444443.939774:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:2.0:1783444443.939780:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575346304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939823:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3808380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575346304:12345-0@lo:400:kworker.0 Request processed in 44us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444443.939830:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:2.0:1783444443.939863:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575345920:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939875:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ea496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575345664:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939908:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575346304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.939915:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575346176:0@lo:400:kworker.0 00000100:00080000:2.0:1783444443.939936:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444443.939940:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444443.939943:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575345536:0@lo:38:kworker.0 00000100:00080000:2.0:1783444443.939950:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444443.939952:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444443.939955:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575345792:0@lo:38:kworker.0 00000100:00080000:2.0:1783444443.939962:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444443.939964:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444443.939967:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575346048:0@lo:38:kworker.0 00000100:00080000:2.0:1783444443.939973:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444443.939975:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444443.939978:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575346432:0@lo:38:kworker.0 00000100:00100000:2.0:1783444443.940153:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575342848:0@lo:400:kworker.0 00000100:00100000:2.0:1783444443.940162:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e6a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575341312:0@lo:400:kworker.0 00010000:00010000:0.0:1783444444.189069:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444444.449359:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:1.0:1783444444.573598:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00100000:2.0:1783444444.957340:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575346560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444444.957411:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444444.957465:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575346560 00000100:00100000:2.0:1783444444.957473:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575346560 00000100:00100000:2.0:1783444444.957537:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1783444444.957547:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575346560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444444.957584:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444444.957628:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575346560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444444.957635:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1783444444.957681:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575346560:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783444444.958214:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444444.962625:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575346688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444444.962701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444444.962764:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575346688 00000100:00100000:3.0:1783444444.962773:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575346688 00000100:00100000:3.0:1783444444.962856:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1783444444.962866:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575346688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444444.962901:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444444.962954:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575346688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444444.962963:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00080000:3.0:1783444444.962988:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444444.963033:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575346688:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783444445.221098:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444445.477304:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444445.607418:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00100000:0.0:1783444446.227284:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444446.227703:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444446.228627:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557814016 00000100:00100000:2.0:1783444446.228639:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557814016 00000100:00100000:2.0:1783444446.228715:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557813888 00000100:00100000:2.0:1783444446.228718:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557813888 00000100:00100000:2.0:1783444446.228741:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1061 00000100:00100000:2.0:1783444446.228751:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557814016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444446.228844:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557814016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 94us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444446.228852:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1061 00000100:00100000:2.0:1783444446.228881:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1335 00000100:00100000:2.0:1783444446.228886:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557813888:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444446.228908:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444446.228934:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870073557813888:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 47us (1232us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444446.228941:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1335 00000100:00080000:3.0:1783444446.229403:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783444446.238028:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444446.498562:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000020:01000004:1.0:1783444446.620856:0:92437:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783444446.620864:0:92437:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783444446.620865:0:92437:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783444446.620962:0:92437:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff936901f97800 00000020:01000004:1.0:1783444446.620981:0:92437:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783444446.620996:0:92437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783444446.621011:0:92437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9368dd0eb380) 00000020:00000080:1.0:1783444446.621029:0:92437:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1783444446.621257:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00100000:10000000:2.0:1783444446.671134:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783444446.672514:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1783444446.686550:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1783444446.686850:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.687107:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.687344:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783444446.687557:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.687810:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.688020:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.688271:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.688492:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783444446.688709:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.688870:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783444446.689079:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.689313:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783444446.689495:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783444446.689664:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.689949:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783444446.690177:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.690326:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.690528:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.691302:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.693840:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.694216:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783444446.694511:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783444446.694910:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.695110:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783444446.695319:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.695543:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.695754:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.695967:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783444446.696233:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783444446.696491:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783444446.696700:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783444446.701414:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.701782:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783444446.702152:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.702294:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.702609:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783444446.702841:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783444446.703108:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.703319:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783444446.703486:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.705961:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783444446.707903:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.708229:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783444446.708710:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.709565:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.710838:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.712411:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.713916:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.715565:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783444446.716394:0:92437:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1783444446.718038:0:92437:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783444446.718279:0:92437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783444446.718290:0:92437:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783444446.718302:0:92437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832c77 00000020:01000004:3.0:1783444446.718309:0:92437:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783444446.718321:0:92437:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783444446.718327:0:92437:0:(tgt_mount.c:101:server_register_mount()) register mount ffff936901f97800 from MGS 00000020:01000004:3.0:1783444446.718331:0:92437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783444446.718341:0:92437:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9367c2c619c0) 00000020:00000080:3.0:1783444446.718352:0:92437:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:3.0:1783444446.718421:0:92437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff936901f97800 from MGS, refs=2 00080000:01000000:3.0:1783444446.718666:0:92437:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783444446.718674:0:92437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832c85 00010000:00010000:3.0:1783444446.718839:0:92437:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1783444446.723284:0:92437:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783444446.727843:0:92442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783444446.728200:0:92437:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783444446.728247:0:92437:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783444446.729503:0:92437:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783444446.729763:0:92437:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783444446.729984:0:92437:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783444446.729991:0:92437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783444446.731767:0:92437:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783444446.731778:0:92437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783444446.732557:0:92437:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783444446.732567:0:92437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1783444446.733315:0:92437:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783444446.733339:0:92437:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1783444446.733341:0:92437:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1783444446.733344:0:92437:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1783444446.733350:0:92437:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 82, was 0): CONNECTING 00000100:00100000:1.0:1783444446.733356:0:92437:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000001:00100000:0.0:1783444447.011480:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:0.0:1783444447.011490:0:8415:0:(genops.c:906:class_export_put()) final put ffff9367c17cf000/08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:0.0:1783444447.011531:0:77261:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17cf000/08efc25c-17e5-4d29-97d2-f1505f195a06 for lustre-OST0000 00000020:00000080:0.0:1783444447.011567:0:77261:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c17cc800 for lustre-OST0000 00000001:00100000:2.0:1783444447.017970:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:2.0:1783444447.017980:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368c6bcc000/08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:2.0:1783444447.018020:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c6bcc000/08efc25c-17e5-4d29-97d2-f1505f195a06 for lustre-OST0001 00000020:00000080:2.0:1783444447.018120:0:50586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368f98b7000 for lustre-OST0001 00010000:00010000:2.0:1783444447.261000:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444447.519005:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444447.644914:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00100000:0.0:1783444448.267850:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444448.267888:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444448.267977:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557814272 00000100:00100000:2.0:1783444448.267988:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557814272 00000100:00100000:2.0:1783444448.268075:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557814144 00000100:00100000:2.0:1783444448.268079:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557814144 00000100:00100000:3.0:1783444448.268094:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1062 00000100:00100000:3.0:1783444448.268123:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557814272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:0.0:1783444448.268131:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444448.268261:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557814272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 151us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444448.268270:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1062 00000100:00100000:2.0:1783444448.268295:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1336 00000100:00100000:2.0:1783444448.268307:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557814144:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:2.0:1783444448.268332:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444448.268395:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557814144:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 88us (505us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444448.268416:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1336 00010000:00010000:0.0:1783444448.285152:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444448.549394:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444448.668961:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00080000:3.0:1783444449.052922:0:61798:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444449.052932:0:61798:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783444449.052935:0:61798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444449.052940:0:61798:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444449.052944:0:61798:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444449.052953:0:61798:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3434 00000100:00080000:3.0:1783444449.052958:0:61798:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444449.052966:0:61798:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444449.053010:0:61798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c33f0380 x1870073575346816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444449.053084:0:61798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444449.053088:0:61798:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444449.053090:0:61798:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444449.053093:0:61798:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3434 00000100:00080000:3.0:1783444449.053096:0:61798:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444449.053099:0:61798:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444449.053111:0:61798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973e680 x1870073575347072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444449.053127:0:61798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444449.053145:0:61798:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444449.053147:0:61798:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444449.053150:0:61798:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3434 00000100:00080000:3.0:1783444449.053153:0:61798:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444449.053156:0:61798:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444449.053172:0:61798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5803800 x1870073575347328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444449.053205:0:61798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444449.053207:0:61798:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444449.053209:0:61798:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444449.053212:0:61798:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3434 00000100:00080000:3.0:1783444449.053228:0:61798:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444449.053233:0:61798:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444449.053244:0:61798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4ac9880 x1870073575347712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444449.053279:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575347456:0@lo:400:kworker.0 00000100:00100000:3.0:1783444449.053370:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444449.053413:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444449.053434:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575347584:0@lo:400:kworker.0 00000100:00100000:3.0:1783444449.053459:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444449.053500:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575347456 00000100:00100000:3.0:1783444449.053507:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575347456 00000100:00100000:3.0:1783444449.053568:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575347584 00000100:00100000:3.0:1783444449.053571:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575347584 00000100:00100000:3.0:1783444449.053595:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:3.0:1783444449.053604:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575347456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444449.053658:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575347456:12345-0@lo:400:kworker.0 Request processed in 55us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444449.053665:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:3.0:1783444449.053679:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:3.0:1783444449.053684:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575347584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444449.053706:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575347584:12345-0@lo:400:kworker.0 Request processed in 22us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444449.053712:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00080000:3.0:1783444449.053733:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444449.053736:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444449.053763:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575347584:0@lo:400:kworker.0 00000100:00100000:3.0:1783444449.053773:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575347456:0@lo:400:kworker.0 00000100:00100000:1.0:1783444449.053892:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575347200:0@lo:400:kworker.0 00000100:00100000:1.0:1783444449.053926:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444449.053957:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444449.053963:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575346944:0@lo:400:kworker.0 00000100:00100000:1.0:1783444449.053996:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444449.054026:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575347200 00000100:00100000:1.0:1783444449.054030:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575347200 00000100:00100000:1.0:1783444449.054061:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575346944 00000100:00100000:1.0:1783444449.054064:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575346944 00000100:00100000:1.0:1783444449.054085:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1783444449.054091:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575347200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444449.054136:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575347200:12345-0@lo:400:kworker.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444449.054144:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1783444449.054160:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1783444449.054165:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575346944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444449.054190:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575346944:12345-0@lo:400:kworker.0 Request processed in 24us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444449.054195:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1783444449.054226:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575346944:0@lo:400:kworker.0 00000100:00100000:1.0:1783444449.054235:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575347200:0@lo:400:kworker.0 00000100:00100000:2.0:1783444449.054407:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575346816:0@lo:38:kworker.0 00000100:00100000:2.0:1783444449.054448:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444449.054480:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575347072:0@lo:38:kworker.0 00000100:00100000:2.0:1783444449.054504:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444449.054521:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575347328:0@lo:38:kworker.0 00000100:00100000:2.0:1783444449.054559:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444449.054577:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575347712:0@lo:38:kworker.0 00000100:00100000:2.0:1783444449.054598:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444449.054626:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575347328 00000100:00100000:2.0:1783444449.054629:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575347328 00000100:00100000:2.0:1783444449.054649:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:2.0:1783444449.054655:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575347328:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444449.054674:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444449.054708:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575347328:12345-0@lo:38:kworker.0 Request processed in 52us (148us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444449.054714:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:2.0:1783444449.054730:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575346816 00000100:00100000:2.0:1783444449.054733:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575346816 00000100:00100000:2.0:1783444449.054748:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575347072 00000100:00100000:2.0:1783444449.054750:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575347072 00000100:00100000:2.0:1783444449.054761:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575347712 00000100:00100000:2.0:1783444449.054763:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575347712 00000100:00100000:2.0:1783444449.054773:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1783444449.054777:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575346816:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444449.054806:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444449.054838:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575346816:12345-0@lo:38:kworker.0 Request processed in 59us (389us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444449.054844:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1783444449.054855:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:2.0:1783444449.054859:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e6a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575347072:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444449.054869:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444449.054892:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e6a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575347072:12345-0@lo:38:kworker.0 Request processed in 31us (387us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444449.054897:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:2.0:1783444449.054908:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1783444449.054912:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575347712:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444449.054921:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444449.054942:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575347712:12345-0@lo:38:kworker.0 Request processed in 29us (343us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444449.054947:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00080000:2.0:1783444449.054977:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444449.054982:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444449.054985:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575346816:0@lo:38:kworker.0 00000100:00080000:2.0:1783444449.054994:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444449.054997:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444449.054999:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575347072:0@lo:38:kworker.0 00000100:00080000:2.0:1783444449.055006:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444449.055009:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444449.055011:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575347328:0@lo:38:kworker.0 00000100:00080000:2.0:1783444449.055029:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444449.055032:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444449.055034:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575347712:0@lo:38:kworker.0 00000100:00080000:3.0:1783444449.056321:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783444449.311911:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444449.567383:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444449.694172:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00100000:0.0:1783444450.077341:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575347840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444450.077426:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444450.077932:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575347840 00000100:00100000:2.0:1783444450.077954:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575347840 00000100:00100000:2.0:1783444450.078012:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1783444450.078023:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575347840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444450.078056:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444450.078110:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575347840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444450.078118:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1783444450.078176:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575347840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444450.078546:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575347968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444450.078584:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444450.078730:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575347968 00000100:00100000:3.0:1783444450.078735:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575347968 00000100:00100000:3.0:1783444450.078772:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1783444450.078779:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575347968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444450.078815:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444450.078858:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575347968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444450.078864:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:1.0:1783444450.078931:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575347968:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783444450.336124:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444450.589305:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444450.716972:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:2.0:1783444451.356958:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444451.616420:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444451.740901:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:0.0:1783444452.381149:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444452.637704:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444452.766872:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00000100:00100000:0.0:1783444453.149599:0:3632:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444443/real 1783444443] req@ffff9367c5972d80 x1870073575345408/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444453 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444453.149656:0:3632:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9367c5972d80 x1870073575345408/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444453 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444453.149676:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444453.149691:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783444453.149769:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575345408:0@lo:250:kworker.0 10000000:01000000:1.0:1783444453.160885:0:92437:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1783444453.160908:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832841 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.160921:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832841 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.160928:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1783444453.160942:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.160952:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e383283a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832841 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.160993:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38327a7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161000:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38327a7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161005:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161008:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161012:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1be00/0x42cb6883e38327a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38327a7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161021:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38327c3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161026:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38327c3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161031:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161035:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161038:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c10c00/0x42cb6883e38327bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38327c3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161046:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38327ed expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161052:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38327ed expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161068:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161078:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161083:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1bc00/0x42cb6883e38327e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38327ed expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161092:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38327fb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161107:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38327fb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161112:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161115:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161118:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5756c00/0x42cb6883e38327f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38327fb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161133:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832817 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161139:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832817 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161144:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161147:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161151:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1aa00/0x42cb6883e3832810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832817 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161160:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832825 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161166:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832825 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161182:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161185:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161189:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1b200/0x42cb6883e383281e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832825 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161198:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e383284f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161203:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e383284f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161207:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161210:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161212:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c10e00/0x42cb6883e3832848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e383284f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161223:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38327b5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161229:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38327b5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161233:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161236:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161239:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e38327ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38327b5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161250:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38327d1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161265:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38327d1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161270:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444453.161273:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161277:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4750a00/0x42cb6883e38327ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38327d1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161287:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38327df expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161293:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38327df expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161298:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783444453.161301:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161304:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368f5756000/0x42cb6883e38327d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38327df expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161312:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832809 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161318:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832809 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161323:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783444453.161325:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161328:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6b1ae00/0x42cb6883e3832802 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832809 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.161355:0:92437:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832833 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444453.161363:0:92437:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832833 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.161368:0:92437:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783444453.161371:0:92437:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1783444453.161375:0:92437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4751000/0x42cb6883e383282c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832833 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783444453.167901:0:92437:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 82, was 0): DISCONN 00000100:00080000:1.0:1783444453.167921:0:92437:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444453.167930:0:92437:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3434 00000100:00080000:1.0:1783444453.167936:0:92437:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783444453.167943:0:92437:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444453.167986:0:92437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367cb23bb80 x1870073575348096/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444453.168006:0:92437:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:0.0:1783444453.169191:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444453.169199:0:77261:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783444453.169202:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444453.169206:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444453.169210:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444453.169215:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3440 00000100:00080000:0.0:1783444453.169218:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444453.169224:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444453.169252:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c79abb80 x1870073575348224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444453.169360:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575348352:0@lo:400:kworker.0 00000100:00100000:3.0:1783444453.169439:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444453.169518:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444453.169522:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444453.169524:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444453.169529:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3440 00000100:00080000:0.0:1783444453.169532:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444453.169536:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444453.169551:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c79a9500 x1870073575348480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444453.169632:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575348608:0@lo:400:kworker.0 00000100:00100000:1.0:1783444453.169663:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444453.169710:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575348352 00000100:00100000:1.0:1783444453.169718:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575348352 00000100:00100000:1.0:1783444453.169769:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575348608 00000100:00100000:1.0:1783444453.169773:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575348608 00000100:00100000:1.0:1783444453.169823:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1783444453.169832:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575348352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444453.169992:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1783444453.170005:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575348608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444453.170048:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575348608:12345-0@lo:400:kworker.0 Request processed in 46us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.170067:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00080000:2.0:1783444453.170118:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444453.171589:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444453.171598:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444453.171602:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444453.171609:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3440 00000100:00080000:0.0:1783444453.171613:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444453.171619:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444453.171655:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c79a8a80 x1870073575348736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444453.171718:0:77261:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444453.171721:0:77261:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444453.171723:0:77261:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444453.171726:0:77261:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3440 00000100:00080000:0.0:1783444453.171729:0:77261:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444453.171733:0:77261:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444453.171744:0:77261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c79aa680 x1870073575349120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444453.171781:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575348096:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783444453.171869:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.171915:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575348224:0@lo:38:kworker.0 00000100:00100000:0.0:1783444453.171942:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.171961:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575348480:0@lo:38:kworker.0 00000100:00100000:0.0:1783444453.171984:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.171998:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575348736:0@lo:38:kworker.0 00000100:00100000:0.0:1783444453.172035:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.172050:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575349120:0@lo:38:kworker.0 00000100:00100000:0.0:1783444453.172084:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.172136:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575348992:0@lo:400:kworker.0 00000100:00100000:0.0:1783444453.172162:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.172180:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444453.172187:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575348864:0@lo:400:kworker.0 00000100:00100000:0.0:1783444453.172208:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.172238:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575348992 00000100:00100000:0.0:1783444453.172245:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575348992 00000100:00100000:0.0:1783444453.172286:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575348864 00000100:00100000:0.0:1783444453.172289:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575348864 00000100:00100000:0.0:1783444453.172313:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:0.0:1783444453.172325:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575348992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444453.172379:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575348992:12345-0@lo:400:kworker.0 Request processed in 58us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.172386:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:0.0:1783444453.172398:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:0.0:1783444453.172404:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575348864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444453.172428:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575348864:12345-0@lo:400:kworker.0 Request processed in 25us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.172434:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:0.0:1783444453.172467:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575348864:0@lo:400:kworker.0 00000100:00100000:0.0:1783444453.172478:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575348992:0@lo:400:kworker.0 00000100:00100000:0.0:1783444453.172517:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575348608:0@lo:400:kworker.0 00000100:00100000:0.0:1783444453.172560:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575348224 00000100:00100000:0.0:1783444453.172564:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575348224 00000100:00100000:0.0:1783444453.172580:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575348480 00000100:00100000:0.0:1783444453.172582:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575348480 00000100:00100000:0.0:1783444453.172592:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575349120 00000100:00100000:0.0:1783444453.172594:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575349120 00000100:00100000:0.0:1783444453.172605:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1783444453.172608:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575348224:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444453.172627:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444453.172660:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575348224:12345-0@lo:38:kworker.0 Request processed in 49us (716us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444453.172666:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1783444453.172678:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1783444453.172682:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575348480:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444453.172691:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444453.172715:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575348480:12345-0@lo:38:kworker.0 Request processed in 31us (730us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444453.172721:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1783444453.172732:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1783444453.172736:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575349120:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444453.172744:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444453.172766:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575349120:12345-0@lo:38:kworker.0 Request processed in 29us (682us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444453.172771:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00080000:0.0:1783444453.172816:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444453.172821:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444453.172830:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575348224:0@lo:38:kworker.0 00000100:00080000:0.0:1783444453.172841:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444453.172844:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444453.172847:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575348480:0@lo:38:kworker.0 00000100:00080000:0.0:1783444453.172854:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444453.172856:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444453.172859:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575349120:0@lo:38:kworker.0 00000100:00100000:2.0:1783444453.173015:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575348736 00000100:00100000:2.0:1783444453.173020:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575348736 00000100:00100000:2.0:1783444453.173044:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:2.0:1783444453.173049:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575348736:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444453.173060:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444453.173096:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575348736:12345-0@lo:38:kworker.0 Request processed in 46us (1060us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444453.173110:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00080000:2.0:1783444453.173137:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444453.173141:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444453.173160:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444453.173164:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444453.173167:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575348736:0@lo:38:kworker.0 00000100:00100000:2.0:1783444453.173201:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575348096 00000100:00100000:2.0:1783444453.173205:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575348096 00000100:00100000:2.0:1783444453.173223:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783444453.173228:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3632:x1870073575348096:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783444453.173244:0:92443:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo t0 exp 0000000000000000 cur 3444 last 0 00000020:00000080:2.0:1783444453.173273:0:92443:0:(genops.c:1406:class_connect()) connect: client c89ab73b-dbb2-4305-b221-37cc64d61227, cookie 0x42cb6883e3832c8c 00000100:00080000:2.0:1783444453.173414:0:92443:0:(import.c:65:import_set_state_nolock()) ffff9367cae8e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444453.173458:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+5:3632:x1870073575348096:12345-0@lo:250:mount.lustre.0 Request processed in 228us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.173466:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783444453.173502:0:3632:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 28 00000100:00080000:2.0:1783444453.173509:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1783444453.173517:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783444453.173521:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783444453.173526:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783444453.173528:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783444453.173551:0:3632:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783444453.173560:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb23bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575348096:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1783444453.173594:0:50586:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.120@tcp 10000000:01000000:2.0:1783444453.173610:0:50586:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1783444453.173613:0:50586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783444453.173620:0:50586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783444453.173621:0:50586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.173622:0:50586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.173624:0:50586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.173625:0:50586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.173626:0:50586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444453.173628:0:50586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.173629:0:50586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783444453.173659:0:50586:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783444453.173667:0:50586:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1783444453.173669:0:50586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783444453.173670:0:50586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783444453.173671:0:50586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.173672:0:50586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.173673:0:50586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.173674:0:50586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.173675:0:50586:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444453.173677:0:50586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.173678:0:50586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783444453.173690:0:50586:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1783444453.173694:0:50586:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1783444453.173695:0:50586:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1783444453.173697:0:50586:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783444453.173698:0:50586:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.173699:0:50586:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.173700:0:50586:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.173701:0:50586:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.173702:0:50586:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444453.173703:0:50586:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.173704:0:50586:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1783444453.173721:0:50586:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1783444453.173745:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575349504:0@lo:253:kworker.0 00000100:00100000:2.0:1783444453.173781:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.173848:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575349376:0@lo:253:kworker.0 00000100:00100000:2.0:1783444453.173878:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.173894:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444453.173899:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575349248:0@lo:253:kworker.0 00000100:00100000:2.0:1783444453.173933:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.173956:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575349504 00000100:00100000:2.0:1783444453.173960:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575349504 00000100:00100000:2.0:1783444453.173980:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575349376 00000100:00100000:2.0:1783444453.173983:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575349376 00000100:00100000:2.0:1783444453.173993:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575349248 00000100:00100000:2.0:1783444453.173995:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575349248 00000100:00100000:2.0:1783444453.174007:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783444453.174012:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d42bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3633:x1870073575349504:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783444453.174032:0:92443:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1783444453.174170:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783444453.174179:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d42bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3636:x1870073575349376:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783444453.174198:0:92444:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1783444453.174232:0:92447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00080000:2.0:1783444453.174492:0:92437:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1783444453.174505:0:92437:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783444453.174539:0:92437:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783444453.174544:0:92437:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783444453.174610:0:92437:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783444453.174636:0:92437:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783444453.174640:0:92437:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783444453.174641:0:92437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444453.174642:0:92437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.174643:0:92437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.174644:0:92437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.174645:0:92437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.174646:0:92437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444453.174647:0:92437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444453.174649:0:92437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.174650:0:92437:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783444453.174652:0:92437:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783444453.174655:0:92437:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783444453.174660:0:92437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444453.174661:0:92437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.174662:0:92437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.174663:0:92437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.174664:0:92437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.174665:0:92437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444453.174666:0:92437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444453.174667:0:92437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.174668:0:92437:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783444453.174683:0:92437:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783444453.174694:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575349632:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783444453.174731:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.174748:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaab16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.174763:0:92445:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1783444453.174768:0:92445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1783444453.174872:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575349632 00000100:00100000:2.0:1783444453.174877:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575349632 20000000:01000000:2.0:1783444453.174964:0:92443:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 119 00000100:00100000:2.0:1783444453.175121:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783444453.175129:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3636:x1870073575349248:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783444453.175149:0:92448:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1783444453.177729:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575348352:12345-0@lo:400:kworker.0 Request processed in 7886us (8278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444453.177745:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 20000000:01000000:1.0:1783444453.181490:0:92449:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783444453.181500:0:92449:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783444453.181503:0:92449:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783444453.181506:0:92449:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783444453.181849:0:92449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783444453.182327:0:92443:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444453.182359:0:92443:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783444453.182706:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575348352:0@lo:400:kworker.0 20000000:01000000:2.0:1783444453.194065:0:92443:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444453.194086:0:92443:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1783444453.194576:0:92447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783444453.194582:0:92447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783444453.194610:0:92447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194626:0:92447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783444453.194636:0:92447:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054818s 00010000:00010000:3.0:1783444453.194640:0:92447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194648:0:92447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194656:0:92447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194663:0:92447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194669:0:92447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444453.194673:0:92447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194681:0:92447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194709:0:92447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194716:0:92447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.194722:0:92447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832c93 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444453.195022:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d42bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3633:x1870073575349504:12345-0@lo:253:kworker.0 Request processed in 21005us (21235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.195032:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783444453.195076:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783444453.195086:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:92437:x1870073575349632:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783444453.195143:0:92443:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444453.195146:0:92443:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783444453.195155:0:92443:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1783444453.195161:0:92443:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:3.0:1783444453.195453:0:3633:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1783444453.195456:0:3633:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783444453.195457:0:3633:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444453.195458:0:3633:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444453.195460:0:3633:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444453.195461:0:3633:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444453.195463:0:3633:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444453.195465:0:3633:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444453.195466:0:3633:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1783444453.195470:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575349504:0@lo:253:kworker.0 20000000:01000000:0.0:1783444453.195665:0:92444:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783444453.197752:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:92437:x1870073575349632:12345-0@lo:253:mount.lustre.0 Request processed in 2660us (23011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.197772:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783444453.199162:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575349632:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783444453.199183:0:92437:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783444453.199186:0:92437:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783444453.199188:0:92437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444453.199189:0:92437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.199190:0:92437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.199192:0:92437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.199193:0:92437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.199194:0:92437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444453.199195:0:92437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444453.199197:0:92437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.199198:0:92437:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783444453.199227:0:92437:0:(tgt_mount.c:101:server_register_mount()) register mount ffff936901f97800 from lustre-MDT0000 10000000:01000000:2.0:1783444453.199260:0:92437:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783444453.199263:0:92437:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783444453.199273:0:92437:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff936901f97800 10000000:01000000:2.0:1783444453.199277:0:92437:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783444453.199283:0:92437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff936901f97800 10000000:01000000:2.0:1783444453.199286:0:92437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783444453.199290:0:92437:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff936901f97800 from 1 10000000:01000000:2.0:1783444453.199293:0:92437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783444453.199353:0:92437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444453.199365:0:92437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444453.199375:0:92437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444453.199397:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575349760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783444453.199471:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.199522:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c66ea240 going to sleep for 11 seconds 00000100:00100000:3.0:1783444453.199631:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575349760 00000100:00100000:3.0:1783444453.199639:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575349760 00000100:00100000:3.0:1783444453.199686:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783444453.199697:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+7:92437:x1870073575349760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444453.199712:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444453.199728:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04800/0x42cb6883e3832ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832c9a expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.199765:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04800/0x42cb6883e3832ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832c9a expref: 8 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.199776:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04800/0x42cb6883e3832ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832c9a expref: 8 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.199785:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04800, rc 0) 00000100:00100000:3.0:1783444453.199850:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:92437:x1870073575349760:12345-0@lo:101:mount.lustre.0 Request processed in 155us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.199857:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783444453.201545:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575349760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444453.201572:0:92437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.201585:0:92437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444453.201606:0:92437:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783444453.201623:0:92437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.201631:0:92437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444453.201638:0:92437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783444453.201646:0:92437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783444453.201652:0:92437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff936901f97800 10000000:01000000:0.0:1783444453.201655:0:92437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783444453.201660:0:92437:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783444453.201674:0:92437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444453.201710:0:92437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.201718:0:92437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.201728:0:92437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444453.201750:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575349888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783444453.201846:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.201881:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c52cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1783444453.201969:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575349888 00000100:00100000:3.0:1783444453.201975:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575349888 00000100:00100000:3.0:1783444453.202018:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783444453.202028:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:92437:x1870073575349888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444453.202042:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444453.202057:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832ca8 expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.202078:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 9 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.202087:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 9 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.202095:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04e00, rc 0) 00000100:00100000:3.0:1783444453.202146:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:92437:x1870073575349888:12345-0@lo:101:mount.lustre.0 Request processed in 118us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.202153:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783444453.203146:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575349888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444453.203165:0:92437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.203174:0:92437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444453.203241:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575350016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783444453.203278:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.205521:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c52cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1783444453.205583:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575350016 00000100:00100000:0.0:1783444453.205594:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575350016 00000100:00100000:0.0:1783444453.205644:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783444453.205655:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:92437:x1870073575350016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783444453.205881:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575350016:12345-0@lo:501:mount.lustre.0 Request processed in 227us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.205904:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783444453.206647:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575350016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444453.206707:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575350144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444453.206765:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.206820:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c66ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444453.206998:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575350144 00000100:00100000:3.0:1783444453.207005:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575350144 00000100:00100000:3.0:1783444453.207047:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783444453.207067:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575350144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444453.210756:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575350144:12345-0@lo:503:mount.lustre.0 Request processed in 3693us (3982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.210772:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783444453.215910:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575350144:0@lo:503:mount.lustre.0 20000000:01000000:2.0:1783444453.219114:0:92444:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444453.219133:0:92444:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783444453.219484:0:92448:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783444453.219642:0:92447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444453.219648:0:92447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444453.219672:0:92447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219689:0:92447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444453.219699:0:92447:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054818s 00010000:00010000:0.0:1783444453.219703:0:92447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219711:0:92447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219717:0:92447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219724:0:92447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219730:0:92447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444453.219734:0:92447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219741:0:92447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219770:0:92447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219778:0:92447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.219784:0:92447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cb6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444453.221000:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d42bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:3636:x1870073575349376:12345-0@lo:253:kworker.0 Request processed in 46816us (47114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.221012:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1783444453.221441:0:3636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783444453.221444:0:3636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783444453.221445:0:3636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.221446:0:3636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.221447:0:3636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.221449:0:3636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.221450:0:3636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444453.221453:0:3636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.221454:0:3636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783444453.221459:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575349376:0@lo:253:kworker.0 00000100:00100000:0.0:1783444453.226301:0:92450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92450:1870073575350272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444453.226495:0:92450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.226609:0:92450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c70f3240 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.226669:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575350272 00000100:00100000:2.0:1783444453.226680:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575350272 00000100:00100000:2.0:1783444453.226774:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783444453.226784:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:92450:x1870073575350272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.230719:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:92450:x1870073575350272:12345-0@lo:502:llog_process_th.0 Request processed in 3927us (4215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.230734:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783444453.230871:0:92450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92450:1870073575350272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444453.230908:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444453.230920:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444453.230922:0:92450:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783444453.230928:0:92450:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783444453.230931:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783444453.230946:0:92450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9368e7120000) 00000020:00000080:0.0:1783444453.230969:0:92450:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1783444453.230975:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783444453.231063:0:92450:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783444453.231071:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832cc4 00000020:00000080:0.0:1783444453.231317:0:92450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783444453.231322:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444453.231326:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444453.231327:0:92450:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783444453.231330:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444453.231333:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444453.231353:0:92450:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783444453.231358:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783444453.231367:0:92450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9368e7123380) 00000020:00000080:0.0:1783444453.231379:0:92450:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1783444453.231384:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783444453.231386:0:92450:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783444453.231389:0:92450:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783444453.231394:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783444453.231445:0:92450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff936901f97800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783444453.231459:0:92450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9368e7124d40) 00000020:00000080:0.0:1783444453.231470:0:92450:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1783444453.231524:0:92450:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783444453.231530:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832cd9 00000020:00000080:0.0:1783444453.231622:0:92450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783444453.231629:0:92450:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783444453.231634:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42cb6883e3832ce0 00080000:01000000:0.0:1783444453.231639:0:92450:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783444453.231642:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832ce7 20000000:01000000:3.0:1783444453.243355:0:92448:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783444453.243378:0:92448:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783444453.243715:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3636:x1870073575349248:12345-0@lo:253:kworker.0 Request processed in 68581us (69775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.243727:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:0.0:1783444453.243905:0:92447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444453.243911:0:92447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444453.243937:0:92447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.243955:0:92447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444453.243965:0:92447:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055447s 00010000:00010000:0.0:1783444453.243970:0:92447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.243978:0:92447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.243985:0:92447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.244006:0:92447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.244012:0:92447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444453.244017:0:92447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.244026:0:92447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.244040:0:92447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.244049:0:92447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.244269:0:92447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4750400/0x42cb6883e3832cee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783444453.244387:0:3636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783444453.244390:0:3636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783444453.244391:0:3636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.244393:0:3636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.244394:0:3636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.244402:0:3636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.244404:0:3636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444453.244405:0:3636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.244407:0:3636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783444453.244411:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575349248:0@lo:253:kworker.0 00010000:00010000:0.0:1783444453.325319:0:92450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1783444453.326493:0:92450:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 115964116997 lx: 0 gen 22 00000001:00080000:0.0:1783444453.326538:0:92450:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 08efc25c-17e5-4d29-97d2-f1505f195a06 idx: 2 lr: 0 srv lr: 115964116997 lx: 0 gen 24 00000001:00000004:0.0:1783444453.326569:0:92450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116997 00000001:00080000:0.0:1783444453.329487:0:92450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1783444453.329579:0:92450:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9367c70f3b40: xid 1870073575332736, transno 115964116997, client gen 22, slot idx 1 00000001:00080000:0.0:1783444453.330473:0:92450:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9367c5849d80: xid 1870073575332480, transno 115964116996, client gen 22, slot idx 2 00000020:00000080:0.0:1783444453.332685:0:92450:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9367c1e80000) 00000020:00000080:0.0:1783444453.332812:0:92450:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1783444453.342285:0:92450:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783444453.342301:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832d0a 00000020:00000080:2.0:1783444453.351823:0:92450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783444453.371441:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42cb6883e3832d11 00000020:00000080:0.0:1783444453.373040:0:92450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783444453.373067:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444453.373075:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444453.373077:0:92450:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783444453.373081:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783444453.373084:0:92450:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783444453.373086:0:92450:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444453.373087:0:92450:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444453.373089:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783444453.373092:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444453.373093:0:92450:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783444453.373096:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444453.373101:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444453.373102:0:92450:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783444453.373107:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783444453.373161:0:92450:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783444453.373179:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444453.373182:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444453.373183:0:92450:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783444453.373186:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444453.373189:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444453.373190:0:92450:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783444453.373194:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783444453.373199:0:92450:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:0.0:1783444453.373225:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783444453.373243:0:92450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9367c1e83380) 00000020:00000080:0.0:1783444453.373263:0:92450:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783444453.373269:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783444453.373567:0:92450:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783444453.373573:0:92450:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783444453.373590:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832d1f 00010000:00080000:0.0:1783444453.373621:0:92450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ef128000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1783444453.377590:0:92450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1783444453.379846:0:92450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444453.379863:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783444453.379906:0:92450:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783444453.379933:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832d26 00000100:00080000:2.0:1783444453.379945:0:92450:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444453.379952:0:92450:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9368ef128000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444453.379992:0:92450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973e680 x1870073575350400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444453.380024:0:92450:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1783444453.380248:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444453.380252:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.380254:0:92450:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1783444453.380258:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783444453.380260:0:92450:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1783444453.380262:0:92450:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444453.380263:0:92450:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444453.380265:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783444453.380268:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.380269:0:92450:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783444453.380272:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783444453.380277:0:92450:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783444453.380281:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.380282:0:92450:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783444453.380285:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783444453.380437:0:92450:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1783444453.380469:0:92450:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783444453.380473:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444453.380486:0:92450:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9367c3330000) 00000020:00000080:2.0:1783444453.380503:0:92450:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783444453.380508:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783444453.380705:0:92450:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783444453.380711:0:92450:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783444453.380718:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832d34 00010000:00080000:2.0:1783444453.380751:0:92450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ff68c800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00000100:00100000:0.0:1783444453.380900:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575350400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783444453.380973:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444453.381215:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575350400 00000100:00100000:3.0:1783444453.381224:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575350400 00000100:00100000:3.0:1783444453.381266:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1783444453.381274:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575350400:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783444453.381309:0:8430:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3444 last 0 00000020:00000080:3.0:1783444453.381346:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832d3b 00000004:00100000:3.0:1783444453.381360:0:8430:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783444453.381455:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9367c5620000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444453.381513:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575350400:12345-0@lo:38:llog_process_th.0 Request processed in 238us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.381521:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1783444453.381579:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783444453.381712:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1783444453.381720:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783444453.381725:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783444453.381727:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef128000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:2.0:1783444453.381940:0:92450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:2.0:1783444453.385007:0:92450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783444453.385421:0:92450:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1783444453.386512:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444453.386534:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575350528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444453.386612:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444453.387867:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575350528 00000100:00100000:1.0:1783444453.387879:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575350528 00000100:00100000:1.0:1783444453.387942:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1783444453.387952:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575350528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444453.387990:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:1.0:1783444453.388228:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575350528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 276us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444453.388237:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1783444453.388309:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575350528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444453.394889:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575350400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783444453.395108:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444453.395149:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444453.395218:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444453.395253:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557814528 00000100:00100000:0.0:1783444453.395262:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557814528 00000100:00100000:0.0:1783444453.395292:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557814656 00000100:00100000:0.0:1783444453.395295:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557814656 00000100:00100000:0.0:1783444453.395347:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1067 00000100:00100000:0.0:1783444453.395359:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2404:x1870073557814656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444453.395439:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2404:x1870073557814656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.395447:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1067 00000100:00100000:0.0:1783444453.395468:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1343 00000100:00100000:0.0:1783444453.395473:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557814528:12345-192.168.204.20@tcp:38:kworker.0 00000100:00100000:0.0:1783444453.395512:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557814528:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 37us (363us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783444453.395519:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1343 00000100:00100000:3.0:1783444453.395837:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557814400 00000100:00100000:3.0:1783444453.395842:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557814400 00000100:00100000:3.0:1783444453.395874:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1783444453.395879:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2400:x1870073557814400:12345-192.168.204.20@tcp:250:kworker.0 00010000:00080000:3.0:1783444453.395898:0:92444:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp t0 exp 0000000000000000 cur 3444 last 0 00000020:00000080:3.0:1783444453.395929:0:92444:0:(genops.c:1406:class_connect()) connect: client 28921b6e-3bc9-4a81-ae87-1992169ba754, cookie 0x42cb6883e3832d42 00000100:00080000:3.0:1783444453.396083:0:92444:0:(import.c:65:import_set_state_nolock()) ffff9367c5626800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783444453.396211:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444453.396427:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+5:2400:x1870073557814400:12345-192.168.204.20@tcp:250:kworker.0 Request processed in 545us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.396436:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000040:00080000:2.0:1783444453.398625:0:92450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783444453.399450:0:92450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:2.0:1783444453.399648:0:92450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00010000:00010000:1.0:1783444453.410519:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783444453.411274:0:92456:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1783444453.411280:0:92456:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783444453.415028:0:92450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444453.415049:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783444453.415320:0:92450:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783444453.415358:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832d49 00000100:00080000:2.0:1783444453.415371:0:92450:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444453.415379:0:92450:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368ff68c800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444453.415416:0:92450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f973e680 x1870073575350656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444453.415451:0:92450:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1783444453.415575:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575350656:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783444453.415650:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1783444453.415879:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444453.415884:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.415886:0:92450:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783444453.415888:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783444453.415903:0:92450:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1783444453.415905:0:92450:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444453.415908:0:92450:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444453.415909:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783444453.415912:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.415914:0:92450:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783444453.415916:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783444453.415921:0:92450:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783444453.415925:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.415926:0:92450:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783444453.415929:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783444453.415933:0:92450:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1783444453.415955:0:92450:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783444453.415958:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444453.415971:0:92450:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9367c3334d40) 00000020:00000080:2.0:1783444453.415990:0:92450:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1783444453.415995:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1783444453.416346:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575350656 00000100:00100000:1.0:1783444453.416355:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575350656 00000100:00100000:1.0:1783444453.416398:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5898 00000100:00100000:1.0:1783444453.416406:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3632:x1870073575350656:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1783444453.416433:0:26199:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3444 last 0 00000020:00000080:1.0:1783444453.416455:0:26199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832d57 00002000:00100000:1.0:1783444453.416467:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9368eb18d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783444453.416471:0:26199:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783444453.416474:0:26199:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783444453.416573:0:26199:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783444453.416596:0:26199:0:(import.c:65:import_set_state_nolock()) ffff9368eb18b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444453.416665:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575350656:12345-0@lo:8:llog_process_th.0 Request processed in 258us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444453.416673:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5898 00000100:00100000:1.0:1783444453.416721:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783444453.416730:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783444453.416737:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783444453.416741:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783444453.416744:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ff68c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783444453.416963:0:92450:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783444453.416971:0:92450:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783444453.416979:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3832d5e 00010000:00080000:2.0:1783444453.417010:0:92450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368ead89800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1783444453.417225:0:92450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1783444453.417288:0:92450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783444453.417301:0:92450:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1783444453.427152:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575350784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444453.427232:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.427664:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575350784 00000100:00100000:0.0:1783444453.427673:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575350784 00000100:00100000:0.0:1783444453.427736:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:0.0:1783444453.427756:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575350784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444453.427810:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444453.427862:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575350784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.427870:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00080000:3.0:1783444453.427935:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444453.427977:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575350784:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1783444453.433032:0:92450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1783444453.433545:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783444453.433567:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575350656:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1783444453.433964:0:92456:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783444453.434028:0:92456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3444476238613ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783444453.434045:0:92456:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:2.0:1783444453.434941:0:92450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:2.0:1783444453.435142:0:92450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000040:00080000:2.0:1783444453.436579:0:92458:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1783444453.436587:0:92458:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783444453.439969:0:92450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783444453.440028:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783444453.440103:0:92450:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783444453.440134:0:92450:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832d65 00000100:00080000:1.0:1783444453.440145:0:92450:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000004:00080000:0.0:1783444453.440145:0:92438:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:1.0:1783444453.440151:0:92450:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9368ead89800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444453.440188:0:92450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367cb239500 x1870073575350912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783444453.440220:0:92450:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1783444453.440333:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575350912:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783444453.440416:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1783444453.440462:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444453.440467:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444453.440469:0:92450:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783444453.440472:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444453.440477:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444453.440478:0:92450:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783444453.440481:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783444453.440483:0:92450:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783444453.440485:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444453.440493:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444453.440494:0:92450:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783444453.440498:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444453.440500:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444453.440501:0:92450:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783444453.440505:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783444453.440535:0:92450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92450:1870073575351040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444453.440539:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575350912 00000100:00100000:0.0:1783444453.440546:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575350912 00000100:00100000:1.0:1783444453.440580:0:92450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.440584:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5899 00000100:00100000:0.0:1783444453.440593:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3632:x1870073575350912:12345-0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783444453.440610:0:92450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08e40 going to sleep for 11 seconds 00010000:00080000:0.0:1783444453.440619:0:26212:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3444 last 0 00000020:00000080:0.0:1783444453.440643:0:26212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3832d6c 00002000:00100000:0.0:1783444453.440657:0:26212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9368ef0b2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783444453.440661:0:26212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783444453.440664:0:26212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783444453.440737:0:26212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783444453.440759:0:26212:0:(import.c:65:import_set_state_nolock()) ffff9368ef0b1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444453.440842:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575350912:12345-0@lo:8:llog_process_th.0 Request processed in 248us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.440850:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5899 00000100:00100000:1.0:1783444453.440975:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783444453.440983:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:2.0:1783444453.440987:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575351040 00000100:00080000:1.0:1783444453.440990:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1783444453.440991:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575351040 00000100:00080000:1.0:1783444453.440994:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783444453.440997:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ead89800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783444453.441017:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000004:00080000:1.0:1783444453.441017:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783444453.441023:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:92450:x1870073575351040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444453.441023:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575350912:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783444453.441152:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:92450:x1870073575351040:12345-0@lo:502:llog_process_th.0 Request processed in 128us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.441158:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:2.0:1783444453.441199:0:92458:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783444453.441258:0:92458:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3444483468346ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783444453.441265:0:92458:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783444453.441490:0:92450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92450:1870073575351040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444453.441517:0:92450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444453.441523:0:92450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444453.441524:0:92450:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783444453.441528:0:92450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1783444453.441997:0:92437:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1783444453.442020:0:92437:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783444453.442039:0:92437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444453.442051:0:92437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444453.442059:0:92437:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff936901f97800 from 1 10000000:01000000:2.0:1783444453.442062:0:92437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783444453.442101:0:92437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444453.442110:0:92437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444453.442119:0:92437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444453.442135:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783444453.442178:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.442209:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.442226:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575351168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444453.442254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.442291:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575351296 00000100:00100000:2.0:1783444453.442295:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575351296 00000100:00100000:2.0:1783444453.442782:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783444453.442818:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:92437:x1870073575351296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444453.442836:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444453.442858:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832d73 expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444453.442883:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 9 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444453.442895:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 9 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444453.442905:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71a00, rc 0) 00000100:00100000:2.0:1783444453.442955:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:92437:x1870073575351296:12345-0@lo:101:mount.lustre.0 Request processed in 138us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.442962:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783444453.442995:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575351168 00000100:00100000:2.0:1783444453.443000:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575351168 00000100:00100000:2.0:1783444453.443034:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:2.0:1783444453.443040:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575351168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444453.443062:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444453.443180:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444453.443195:0:92437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783444453.443202:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783444453.443204:0:92437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444453.443255:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575351168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.443266:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:2.0:1783444453.443312:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575351168:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1783444453.443971:0:92438:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783444453.444107:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351424:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783444453.444167:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444453.444206:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.444258:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575351424 00000100:00100000:2.0:1783444453.444264:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575351424 00000100:00100000:2.0:1783444453.444351:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783444453.444360:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ebe2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:92437:x1870073575351424:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783444453.444377:0:92445:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783444453.444394:0:92445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783444453.444398:0:92445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783444453.444401:0:92445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783444453.444404:0:92445:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 122 00000100:00100000:2.0:1783444453.444488:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ebe2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:92437:x1870073575351424:12345-0@lo:256:mount.lustre.0 Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.444495:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783444453.444558:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351424:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783444453.447968:0:92437:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783444453.448002:0:92437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.448017:0:92437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444453.448027:0:92437:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff936901f97800 from 1 10000000:01000000:1.0:1783444453.448030:0:92437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783444453.448084:0:92437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.448092:0:92437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.448103:0:92437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444453.448130:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783444453.448203:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444453.448257:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444453.448776:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575351552 00000100:00100000:3.0:1783444453.448825:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575351552 00000100:00100000:3.0:1783444453.448960:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783444453.448970:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ebe2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+9:92437:x1870073575351552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444453.448985:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444453.449001:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832d88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832d81 expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.449025:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832d81 expref: 10 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.449036:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832d81 expref: 10 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.449045:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04a00, rc 0) 00000100:00100000:3.0:1783444453.449094:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ebe2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575351552:12345-0@lo:101:mount.lustre.0 Request processed in 124us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.449101:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783444453.450511:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444453.450540:0:92437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444453.450574:0:92437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444453.451559:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783444453.455518:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.455586:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.455716:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575351680 00000100:00100000:2.0:1783444453.455727:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575351680 00000100:00100000:2.0:1783444453.455824:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783444453.455835:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575351680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444453.456007:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575351680:12345-0@lo:501:mount.lustre.0 Request processed in 173us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.456014:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783444453.456088:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444453.456149:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444453.456204:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.456219:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c67b8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444453.457035:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575351808 00000100:00100000:0.0:1783444453.457045:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575351808 00000100:00100000:0.0:1783444453.457116:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783444453.457125:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575351808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783444453.457244:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575351808:12345-0@lo:503:mount.lustre.0 Request processed in 119us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.457251:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783444453.458371:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575351808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444453.461078:0:92460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92460:1870073575351936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.461182:0:92460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.461232:0:92460:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444453.461294:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575351936 00000100:00100000:0.0:1783444453.461311:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575351936 00000100:00100000:0.0:1783444453.461367:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783444453.461378:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92460:x1870073575351936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444453.462330:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92460:x1870073575351936:12345-0@lo:502:llog_process_th.0 Request processed in 950us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.462350:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783444453.462847:0:92460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92460:1870073575351936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444453.462881:0:92460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444453.462892:0:92460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.462895:0:92460:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783444453.462902:0:92460:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff936901f97800 00000020:00000080:2.0:1783444453.462906:0:92460:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783444453.462913:0:92460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444453.462916:0:92460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.462917:0:92460:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783444453.462920:0:92460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444453.462922:0:92460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.462924:0:92460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783444453.462927:0:92460:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff936901f97800 00000020:00000080:2.0:1783444453.462929:0:92460:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783444453.463025:0:92460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92460:1870073575352064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.463450:0:92460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.463485:0:92460:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.466633:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575352064 00000100:00100000:2.0:1783444453.466649:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575352064 00000100:00100000:2.0:1783444453.466712:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783444453.466724:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92460:x1870073575352064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.466923:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92460:x1870073575352064:12345-0@lo:502:llog_process_th.0 Request processed in 201us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.466931:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783444453.467006:0:92460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92460:1870073575352064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444453.467043:0:92460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444453.467050:0:92460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444453.467052:0:92460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783444453.467056:0:92460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783444453.469498:0:92437:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1783444453.469538:0:92437:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444453.469767:0:92437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.469782:0:92437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444453.469878:0:92437:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783444453.469881:0:92437:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff936901f97800 10000000:01000000:0.0:1783444453.469885:0:92437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff936901f97800 10000000:01000000:0.0:1783444453.469890:0:92437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783444453.469895:0:92437:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff936901f97800 from 1 10000000:01000000:0.0:1783444453.469898:0:92437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444453.469938:0:92437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.469947:0:92437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.469970:0:92437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444453.469998:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575352192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783444453.470081:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.470126:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444453.470868:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575352192 00000100:00100000:0.0:1783444453.470877:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575352192 00000100:00100000:0.0:1783444453.470923:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783444453.470932:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:92437:x1870073575352192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444453.470946:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444453.470960:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832d8f expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.470985:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 11 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.470997:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 11 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.471005:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751c00, rc 0) 00000100:00100000:0.0:1783444453.471050:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92437:x1870073575352192:12345-0@lo:101:mount.lustre.0 Request processed in 118us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.471396:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783444453.471459:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575352192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444453.471476:0:92437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444453.471489:0:92437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444453.471617:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575352320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783444453.471648:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444453.471675:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.474346:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575352320 00000100:00100000:2.0:1783444453.474361:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575352320 00000100:00100000:2.0:1783444453.474431:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783444453.474442:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92437:x1870073575352320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444453.474645:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92437:x1870073575352320:12345-0@lo:501:mount.lustre.0 Request processed in 204us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.474652:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783444453.475232:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575352320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444453.475289:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575352448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444453.475362:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444453.475403:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08840 going to sleep for 11 seconds 00000100:00100000:0.0:1783444453.475607:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575352448 00000100:00100000:0.0:1783444453.475613:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575352448 00000100:00100000:0.0:1783444453.475654:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783444453.475661:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92437:x1870073575352448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783444453.475761:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92437:x1870073575352448:12345-0@lo:503:mount.lustre.0 Request processed in 99us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.475768:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783444453.475927:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575352448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444453.476363:0:92462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92462:1870073575352576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.476403:0:92462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.476439:0:92462:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7240 going to sleep for 11 seconds 00000100:00100000:0.0:1783444453.476561:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575352576 00000100:00100000:0.0:1783444453.476566:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575352576 00000100:00100000:0.0:1783444453.476604:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783444453.476612:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92462:x1870073575352576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444453.476709:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92462:x1870073575352576:12345-0@lo:502:llog_process_th.0 Request processed in 96us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.476717:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783444453.476888:0:92462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92462:1870073575352576:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783444453.476945:0:92462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783444453.476959:0:92462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9367c33319c0) 00000020:00000080:2.0:1783444453.476987:0:92462:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783444453.477158:0:92462:0:(tgt_mount.c:153:server_get_mount()) get mount ffff936901f97800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783444453.477163:0:92462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff936901f97800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783444453.477166:0:92462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936901f97800 4 00010000:00080000:2.0:1783444453.477190:0:92462:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368c6bc8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1783444453.482728:0:92462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1783444453.482891:0:92462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783444453.482953:0:92462:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783444453.482981:0:92462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42cb6883e3832da4 00000100:00080000:2.0:1783444453.482993:0:92462:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444453.483000:0:92462:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9368c6bc8000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444453.483042:0:92462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fdf80 x1870073575352704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444453.483080:0:92462:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783444453.483684:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575352704:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783444453.483770:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.483938:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575352704 00000100:00100000:2.0:1783444453.483945:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575352704 00000100:00100000:2.0:1783444453.483976:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1783444453.483983:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575352704:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783444453.484044:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575352704:12345-0@lo:38:llog_process_th.0 Request processed in 59us (273us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783444453.484051:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1783444453.484164:0:92462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92462:1870073575352832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.484214:0:92462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.484238:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575352832 00000100:00100000:2.0:1783444453.484242:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575352832 00000100:00100000:2.0:1783444453.484275:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783444453.484282:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92462:x1870073575352832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444453.484686:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783444453.484695:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368c6bc8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444453.484700:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783444453.484711:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575352704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783444453.485105:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92462:x1870073575352832:12345-0@lo:502:llog_process_th.0 Request processed in 772us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.485115:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783444453.485170:0:92462:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.485186:0:92462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92462:1870073575352832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.485233:0:92462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92462:1870073575352960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.485270:0:92462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444453.485392:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575352960 00000100:00100000:2.0:1783444453.485398:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575352960 00000100:00100000:2.0:1783444453.485434:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783444453.485441:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92462:x1870073575352960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444453.485510:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92462:x1870073575352960:12345-0@lo:502:llog_process_th.0 Request processed in 69us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.485517:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783444453.485548:0:92462:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783444453.485642:0:92462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:92462:1870073575352960:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783444453.485661:0:92462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783444453.488228:0:92437:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783444453.488274:0:92437:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444453.488298:0:92437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.488321:0:92437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783444453.488396:0:92437:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783444453.488405:0:92437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444453.488406:0:92437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444453.488407:0:92437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444453.488408:0:92437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444453.488410:0:92437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444453.488411:0:92437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444453.488412:0:92437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444453.488414:0:92437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444453.488415:0:92437:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783444453.488418:0:92437:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783444453.488421:0:92437:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783444453.488422:0:92437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444453.488423:0:92437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444453.488423:0:92437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444453.488424:0:92437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444453.488425:0:92437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444453.488426:0:92437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444453.488427:0:92437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444453.488428:0:92437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444453.488428:0:92437:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783444453.488459:0:92437:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783444453.488481:0:92437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575353088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783444453.488562:0:92437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444453.488596:0:92437:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e7028600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444453.488628:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575353088 00000100:00100000:3.0:1783444453.488635:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575353088 00000100:00100000:3.0:1783444453.488681:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783444453.488925:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92437:x1870073575353088:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783444453.488957:0:92444:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783444453.488971:0:92444:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783444453.503786:0:92444:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444453.503819:0:92444:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783444453.504414:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:92437:x1870073575353088:12345-0@lo:253:mount.lustre.0 Request processed in 15489us (15847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.504427:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783444453.504495:0:92437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:92437:1870073575353088:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783444453.504510:0:92437:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783444453.504513:0:92437:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783444453.504514:0:92437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444453.504515:0:92437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444453.504517:0:92437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444453.504518:0:92437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444453.504519:0:92437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444453.504520:0:92437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444453.504521:0:92437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444453.504523:0:92437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444453.504525:0:92437:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783444453.504540:0:92437:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1783444453.505476:0:92447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783444453.505482:0:92447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783444453.505506:0:92447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.505523:0:92447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 10 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.505538:0:92447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.505576:0:92447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 10 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.505604:0:92447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 10 pid: 92443 timeout: 3544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444453.505619:0:92447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92447:1870073575353216:0@lo:104: 00000100:00100000:3.0:1783444453.505666:0:92447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444453.506052:0:92447:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e7028c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444453.506076:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575353216 00000100:00100000:3.0:1783444453.506082:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575353216 00000100:00100000:3.0:1783444453.506148:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783444453.506157:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:92447:x1870073575353216:12345-0@lo:104: 00010000:00010000:3.0:1783444453.506171:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.506222:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783444453.506228:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:92447:x1870073575353216:12345-0@lo:104: Request processed in 72us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.506235:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783444453.506273:0:92447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92447:1870073575353216:0@lo:104: 00010000:00010000:3.0:1783444453.506290:0:92447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.506307:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444453.507085:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.507094:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444453.507099:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.507107:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444453.507113:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444453.507118:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783444453.507153:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.507160:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444453.507181:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.507188:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832d7a expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.507205:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444453.507207:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444453.507209:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444453.507223:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575353344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444453.507272:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444453.508773:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575353344 00000100:00100000:3.0:1783444453.508802:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575353344 00010000:00010000:3.0:1783444453.508846:0:19646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 11 pid: 92443 timeout: 3544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444453.508893:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1783444453.508901:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c7862050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+11:3633:x1870073575353344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444453.508915:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444453.508921:0:19646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 11 pid: 92443 timeout: 3544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.508933:0:19646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 11 pid: 92443 timeout: 3544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.508951:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71a00/0x42cb6883e3832d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832d73 expref: 11 pid: 92443 timeout: 3544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.508965:0:19646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.508973:0:19646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783444453.508988:0:19646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003507022s 00010000:00010000:3.0:1783444453.508993:0:19646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509000:0:19646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509007:0:19646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509023:0:19646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509029:0:19646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444453.509033:0:19646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509041:0:19646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509060:0:19646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509071:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444453.509132:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c7862050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+10:3633:x1870073575353344:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444453.509139:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00010000:00010000:3.0:1783444453.509205:0:92447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509212:0:92447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444453.509218:0:92447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832dab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444453.509257:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575353344:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783444453.523841:0:92437:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:3.0:1783444453.532193:0:92437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783444453.533697:0:92468:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:0.0:1783444453.533706:0:92468:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:3.0:1783444453.534610:0:92469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783444453.534784:0:92437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1783444453.535169:0:92469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1783444453.536032:0:92437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783444453.536071:0:92437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783444453.537304:0:92469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783444453.537434:0:92469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1783444453.539495:0:92437:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783444453.539520:0:92437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1783444453.539630:0:92437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783444453.541646:0:92437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1783444453.541941:0:92470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92470:1870073575353472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783444453.542013:0:92470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444453.542069:0:92470:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08c00 going to sleep for 11 seconds 00000040:00080000:0.0:1783444453.542140:0:92437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783444453.542173:0:92437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:2.0:1783444453.542208:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575353472 00000100:00100000:2.0:1783444453.542218:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575353472 00000100:00100000:2.0:1783444453.542291:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000040:00080000:0.0:1783444453.542293:0:92437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783444453.542314:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92470:x1870073575353472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783444453.542416:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92470:x1870073575353472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444453.542424:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00080000:10000000:0.0:1783444453.543696:0:92437:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/32) registered 00000100:00100000:1.0:1783444453.545088:0:92470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92470:1870073575353472:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783444453.545152:0:92470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783444453.545208:0:92470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92470:1870073575353600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783444453.545284:0:92470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444453.545324:0:92470:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444453.545728:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575353600 00000100:00100000:0.0:1783444453.545737:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575353600 00000100:00100000:0.0:1783444453.545811:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:0.0:1783444453.545820:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92470:x1870073575353600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444453.545982:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92470:x1870073575353600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 163us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.545992:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1783444453.546027:0:92470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92470:1870073575353600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444453.546100:0:92470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92470:1870073575353728:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783444453.546130:0:92470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444453.546157:0:92470:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c170e240 going to sleep for 11 seconds 00000100:00100000:0.0:1783444453.546218:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575353728 00000100:00100000:0.0:1783444453.546223:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575353728 00000100:00100000:0.0:1783444453.546272:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:0.0:1783444453.546279:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92470:x1870073575353728:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444453.546592:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92470:x1870073575353728:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 312us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444453.546613:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1783444453.546679:0:92470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92470:1870073575353728:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783444453.546784:0:92470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:2.0:1783444453.550020:0:92437:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964116997 00010000:00080000:1.0:1783444453.551357:0:92471:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92471 00010000:02000000:1.0:1783444453.551374:0:92471:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1783444453.551378:0:92471:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1783444453.551382:0:92471:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1783444453.551831:0:92437:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783444453.551851:0:92437:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783444453.551872:0:92437:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783444453.551893:0:92437:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000040:00080000:3.0:1783444453.552615:0:92470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783444453.552681:0:92470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783444453.552698:0:92470:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1783444453.553289:0:92437:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783444453.556672:0:92437:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:2.0:1783444453.571716:0:92471:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1783444453.663853:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444453.789288:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:2.0:1783444454.429010:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444454.686072:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:3.0:1783444454.813093:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 10000000:01000000:2.0:1783444454.815856:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783444454.815865:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff936901f97800 from 123 10000000:01000000:2.0:1783444454.815870:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783444454.815916:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.815927:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.815938:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.815962:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575353856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.816023:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.816078:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444454.816303:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575353856 00000100:00100000:3.0:1783444454.816324:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575353856 00000100:00100000:3.0:1783444454.816378:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783444454.816387:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:6503:x1870073575353856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444454.816401:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444454.816416:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832db2 expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.816440:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832db2 expref: 11 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.816450:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832db2 expref: 11 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.816472:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05600, rc 0) 00000100:00100000:3.0:1783444454.816522:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575353856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444454.816529:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783444454.816610:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575353856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.816624:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.816633:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.816685:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575353984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.816719:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.816752:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444454.816953:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575353984 00000100:00100000:3.0:1783444454.816958:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575353984 00000100:00100000:3.0:1783444454.816996:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783444454.817003:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575353984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783444454.817019:0:92445:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783444454.817035:0:92445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783444454.817039:0:92445:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 123 00000100:00100000:3.0:1783444454.817118:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575353984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444454.817126:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783444454.817160:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575353984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783444454.817213:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783444454.817220:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.817229:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444454.817238:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444454.817241:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 52 10000000:01000000:3.0:1783444454.817244:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444454.817262:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.817290:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.817298:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444454.817323:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.817353:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444454.817374:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444454.817386:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575354112 00000100:00100000:3.0:1783444454.817389:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575354112 00000100:00100000:3.0:1783444454.817412:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783444454.817420:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c326dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575354112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444454.817428:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444454.817439:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832dc0 expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.817455:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 12 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.817463:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 12 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.817470:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05a00, rc 0) 00000100:00100000:3.0:1783444454.817498:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c326dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575354112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444454.817504:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783444454.817544:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444454.817554:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.817562:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444454.817610:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.817634:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444454.817647:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444454.817657:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575354240 00000100:00100000:3.0:1783444454.817660:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575354240 00000100:00100000:3.0:1783444454.817679:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783444454.817685:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690064fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575354240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.819162:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690064fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575354240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1469us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444454.819174:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783444454.819238:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.819980:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.820044:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444454.820086:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.820184:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575354368 00000100:00100000:2.0:1783444454.820197:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575354368 00000100:00100000:2.0:1783444454.820243:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783444454.820252:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690064c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575354368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.820384:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690064c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575354368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.820392:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783444454.820443:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444454.821208:0:92528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783444454.821288:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783444454.821320:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444454.821331:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.821342:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444454.821352:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783444454.821354:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cd800 from 120 10000000:01000000:2.0:1783444454.821357:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783444454.821389:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.821397:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.821406:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.821428:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.821479:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.821500:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88240 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.821649:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575354496 00000100:00100000:0.0:1783444454.821656:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575354496 00000100:00100000:0.0:1783444454.821700:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783444454.821708:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690067a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575354496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.821719:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444454.821732:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4750a00/0x42cb6883e3832dd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832dce expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.821755:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4750a00/0x42cb6883e3832dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832dce expref: 13 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.821766:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4750a00/0x42cb6883e3832dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832dce expref: 13 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.821774:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750a00, rc 0) 00000100:00100000:0.0:1783444454.821840:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690067a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575354496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.821854:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783444454.821896:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.821910:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dd5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.821919:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832dd5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.821965:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.821994:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.822008:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.822021:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575354624 00000100:00100000:0.0:1783444454.822025:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575354624 00000100:00100000:0.0:1783444454.822047:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783444454.822053:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575354624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783444454.822066:0:92448:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783444454.822083:0:92448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783444454.822087:0:92448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783444454.822089:0:92448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783444454.822093:0:92448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783444454.822095:0:92448:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:0.0:1783444454.822167:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575354624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.822174:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783444454.822200:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783444454.822269:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783444454.822280:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dd5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.822286:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dd5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444454.822292:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783444454.822295:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1783444454.822297:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783444454.822325:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.822332:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.822339:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.822351:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.822375:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.822389:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.822400:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575354752 00000100:00100000:0.0:1783444454.822403:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575354752 00000100:00100000:0.0:1783444454.822422:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783444454.822427:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575354752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.822434:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444454.822441:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832ddc expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.822454:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 14 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.822468:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 14 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.822474:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751800, rc 0) 00000100:00100000:0.0:1783444454.822499:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575354752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.822505:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783444454.822532:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.822542:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.822550:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.822608:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.822633:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.822644:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.822655:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575354880 00000100:00100000:0.0:1783444454.822658:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575354880 00000100:00100000:0.0:1783444454.822679:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783444454.822684:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575354880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.822830:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575354880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.822837:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783444454.822867:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575354880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.822905:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.822941:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.822955:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.822965:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575355008 00000100:00100000:0.0:1783444454.822968:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575355008 00000100:00100000:0.0:1783444454.822989:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783444454.822994:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575355008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.827673:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575355008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4669us (4722us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.827688:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783444454.828210:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444454.830102:0:92530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1783444454.840044:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1783444454.840093:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783444454.840106:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.840119:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444454.840129:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1783444454.840132:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ef0cd800 from 1 10000000:01000000:2.0:1783444454.840135:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783444454.840175:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.840182:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.840194:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.840217:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.840370:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.840451:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.843577:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575355136 00000100:00100000:0.0:1783444454.843591:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575355136 00000100:00100000:0.0:1783444454.843700:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783444454.843711:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575355136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.843729:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444454.843749:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751400/0x42cb6883e3832df1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832dea expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.843778:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751400/0x42cb6883e3832df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832dea expref: 15 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.844376:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751400/0x42cb6883e3832df1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832dea expref: 15 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.844387:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751400, rc 0) 00000100:00100000:0.0:1783444454.844469:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575355136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 761us (4100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.844494:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783444454.844610:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444454.844630:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832df1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.844655:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832df1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444454.844674:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783444454.844680:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832df1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.844687:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832df1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444454.844696:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783444454.844699:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef0cd800 from 7 10000000:01000000:2.0:1783444454.844702:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783444454.844729:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.844737:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.844744:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.844765:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.844827:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.852156:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444454.852210:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575355264 00000100:00100000:3.0:1783444454.852221:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575355264 00000100:00100000:3.0:1783444454.855486:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783444454.855526:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575355264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444454.855546:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444454.855570:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05400/0x42cb6883e3832dff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832df8 expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.855600:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05400/0x42cb6883e3832dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832df8 expref: 16 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.855610:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05400/0x42cb6883e3832dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832df8 expref: 16 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.855619:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05400, rc 0) 00000100:00100000:3.0:1783444454.855717:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575355264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (10889us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444454.855724:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783444454.862117:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444454.862149:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dff expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.862185:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832dff expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.862288:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.862365:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.862410:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.862528:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575355392 00000100:00100000:0.0:1783444454.862535:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575355392 00000100:00100000:0.0:1783444454.862585:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783444454.862595:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575355392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.862725:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575355392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.862733:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783444454.865466:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.865531:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.865601:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.865651:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.865712:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575355520 00000100:00100000:0.0:1783444454.865719:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575355520 00000100:00100000:0.0:1783444454.865771:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783444454.865780:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575355520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.865922:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575355520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.865930:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783444454.866147:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444454.867453:0:92532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444454.867675:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444454.867701:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444454.867712:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dff expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.867723:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832dff expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444454.867732:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444454.867735:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 52 10000000:01000000:0.0:1783444454.867738:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444454.867772:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.867952:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.867964:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.867987:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.868042:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.868083:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444454.868130:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575355648 00000100:00100000:3.0:1783444454.868137:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575355648 00000100:00100000:3.0:1783444454.868212:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783444454.868222:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575355648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444454.868236:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444454.868251:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832e06 expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.868903:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 17 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.868929:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 17 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.868938:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f04400, rc 0) 00000100:00100000:3.0:1783444454.868991:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575355648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 771us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444454.868999:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783444454.869097:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.869113:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.869121:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.869187:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.869215:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.878236:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.882609:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575355776 00000100:00100000:2.0:1783444454.882625:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575355776 00000100:00100000:2.0:1783444454.882708:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783444454.882719:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575355776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.882939:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575355776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (13721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.882948:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783444454.883020:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.883074:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.883128:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.883160:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88840 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.883174:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575355904 00000100:00100000:2.0:1783444454.883178:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575355904 00000100:00100000:2.0:1783444454.883196:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783444454.883210:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575355904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.883295:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575355904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.883302:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783444454.883345:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575355904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444454.883946:0:92533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1783444454.883999:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1783444454.884023:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444454.884033:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.884045:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444454.884054:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783444454.884057:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783444454.884060:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783444454.884087:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.884095:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.884104:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.884121:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.884152:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.884178:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.884192:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575356032 00000100:00100000:2.0:1783444454.884197:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575356032 00000100:00100000:2.0:1783444454.884218:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783444454.884224:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575356032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444454.884233:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444454.884246:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832e14 expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.884266:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 18 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.884276:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 18 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.884284:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70e00, rc 0) 00000100:00100000:2.0:1783444454.884326:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575356032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.884333:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783444454.884364:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444454.884376:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.884384:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.884423:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.884445:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.884463:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.884474:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575356160 00000100:00100000:2.0:1783444454.884477:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575356160 00000100:00100000:2.0:1783444454.884493:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783444454.884498:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575356160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.884606:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575356160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.884613:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783444454.884641:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.884664:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.884698:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.884711:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.884722:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575356288 00000100:00100000:2.0:1783444454.884725:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575356288 00000100:00100000:2.0:1783444454.884741:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783444454.884747:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575356288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.886189:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575356288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1436us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.886199:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783444454.889002:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444454.897869:0:92534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1783444454.897934:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1783444454.897956:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783444454.897969:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.897980:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444454.897989:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783444454.898000:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368f9acf800 from 7 10000000:01000000:2.0:1783444454.898003:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783444454.898043:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.898051:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.898062:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.898088:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.898158:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.898204:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.912009:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575356416 00000100:00100000:0.0:1783444454.912026:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575356416 00000100:00100000:0.0:1783444454.912091:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783444454.912101:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575356416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.912129:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444454.912148:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4750e00/0x42cb6883e3832e29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832e22 expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.912178:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4750e00/0x42cb6883e3832e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832e22 expref: 19 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.912189:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4750e00/0x42cb6883e3832e29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e22 expref: 19 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.912198:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750e00, rc 0) 00000100:00100000:0.0:1783444454.912298:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575356416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (14139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.912306:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783444454.912966:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444454.912987:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.912998:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.913077:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.913119:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.913156:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.936978:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575356544 00000100:00100000:0.0:1783444454.936994:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575356544 00000100:00100000:0.0:1783444454.937058:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783444454.937069:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575356544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.937264:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575356544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (24144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.937284:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783444454.937512:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.937569:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.937625:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.938836:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.953277:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575356672 00000100:00100000:0.0:1783444454.953297:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575356672 00000100:00100000:0.0:1783444454.953376:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783444454.953387:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575356672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.953550:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575356672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (15923us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.953568:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783444454.953652:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444454.960063:0:92536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444454.960470:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444454.960499:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444454.960510:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.960522:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444454.960532:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444454.960535:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 52 10000000:01000000:0.0:1783444454.960538:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444454.960576:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.960594:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.960605:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.960631:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.960702:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.960751:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444454.960837:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575356800 00000100:00100000:3.0:1783444454.960845:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575356800 00000100:00100000:3.0:1783444454.960888:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783444454.960898:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575356800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444454.960914:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444454.960929:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832e30 expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.960953:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 20 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.960963:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 20 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.960971:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05c00, rc 0) 00000100:00100000:3.0:1783444454.961018:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575356800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444454.961025:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783444454.961266:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444454.961411:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.961421:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.961484:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.961516:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.961545:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.961607:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575356928 00000100:00100000:0.0:1783444454.961612:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575356928 00000100:00100000:0.0:1783444454.961647:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783444454.961654:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575356928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.971355:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575356928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.971418:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.971508:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444454.971553:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.972126:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575356928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 10468us (10605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.972140:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783444454.972183:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575357056 00000100:00100000:0.0:1783444454.972189:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575357056 00000100:00100000:0.0:1783444454.972239:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783444454.972247:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575357056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.972390:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575357056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444454.972397:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783444454.972642:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444454.976228:0:92537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1783444454.976559:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1783444454.976599:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444454.976611:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.976624:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444454.976634:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783444454.976637:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783444454.976640:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444454.976682:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.976690:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.976718:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.976744:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.976984:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.977022:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f59a6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.977183:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575357184 00000100:00100000:2.0:1783444454.977192:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575357184 00000100:00100000:2.0:1783444454.977237:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783444454.977247:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575357184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444454.977262:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444454.977277:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832e3e expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.977303:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 21 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.977324:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 21 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.977332:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70600, rc 0) 00000100:00100000:2.0:1783444454.977383:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575357184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.977400:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783444454.977477:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444454.977493:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444454.977501:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444454.977560:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.977607:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444454.977640:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444454.977719:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575357312 00000100:00100000:1.0:1783444454.977724:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575357312 00000100:00100000:1.0:1783444454.977758:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783444454.977773:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575357312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444454.977955:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575357312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444454.977962:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783444454.978223:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.978254:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444454.978295:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444454.978332:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.978368:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575357440 00000100:00100000:2.0:1783444454.978373:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575357440 00000100:00100000:2.0:1783444454.978408:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783444454.978416:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575357440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.984512:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575357440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6085us (6205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.984528:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783444454.984676:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444454.985770:0:92538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783444454.986023:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783444454.986053:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783444454.986066:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.986078:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444454.986088:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783444454.986091:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef29c800 from 7 10000000:01000000:0.0:1783444454.986093:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783444454.986131:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.986138:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.986147:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.986169:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.986222:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.986277:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f59a6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.986359:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575357568 00000100:00100000:2.0:1783444454.986367:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575357568 00000100:00100000:2.0:1783444454.986418:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783444454.986428:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575357568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444454.986441:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444454.986455:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70a00/0x42cb6883e3832e53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832e4c expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.986480:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70a00/0x42cb6883e3832e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832e4c expref: 22 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.986491:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70a00/0x42cb6883e3832e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e4c expref: 22 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.986501:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70a00, rc 0) 00000100:00100000:2.0:1783444454.986547:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575357568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.986554:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783444454.986637:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.986651:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e53 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444454.986659:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832e53 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444454.986710:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444454.986736:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444454.986759:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f59a6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.986948:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575357696 00000100:00100000:2.0:1783444454.986960:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575357696 00000100:00100000:2.0:1783444454.986993:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783444454.987000:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575357696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.987110:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575357696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.987116:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783444454.987147:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.987174:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.987212:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.987226:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444454.987237:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575357824 00000100:00100000:2.0:1783444454.987240:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575357824 00000100:00100000:2.0:1783444454.987261:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783444454.987280:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575357824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.987370:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575357824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444454.987376:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783444454.987419:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444454.998446:0:92539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783444454.998723:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783444454.998746:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783444454.998759:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e53 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.998772:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e53 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444454.998847:0:6503:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1783444454.998850:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9368c507b380 from 1 10000000:01000000:2.0:1783444454.998853:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783444454.998903:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.998911:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444454.998922:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444454.998949:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444454.999016:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444454.999063:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444454.999684:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575357952 00000100:00100000:0.0:1783444454.999693:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575357952 00000100:00100000:0.0:1783444454.999751:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783444454.999760:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575357952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444454.999776:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444455.000588:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751a00/0x42cb6883e3832e61 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832e5a expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444455.000627:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751a00/0x42cb6883e3832e61 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832e5a expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444455.000640:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751a00/0x42cb6883e3832e61 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e5a expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444455.000649:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751a00, rc 0) 00000100:00100000:0.0:1783444455.000775:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575357952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1016us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444455.000831:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783444455.005091:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575357952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444455.005126:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444455.005139:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444455.005191:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783444455.005196:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444455.005204:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444455.009111:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783444455.009122:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:2.0:1783444455.009127:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783444455.009189:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444455.009203:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444455.009214:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444455.009246:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575358080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444455.009441:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444455.009512:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88840 going to sleep for 11 seconds 00000100:00100000:0.0:1783444455.009567:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575358080 00000100:00100000:0.0:1783444455.009577:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575358080 00000100:00100000:0.0:1783444455.009645:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783444455.009655:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575358080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444455.009671:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444455.009688:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832e68 expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444455.009716:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 24 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444455.009728:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 24 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444455.009738:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751000, rc 0) 00000100:00100000:0.0:1783444455.009933:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575358080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444455.009941:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783444455.010043:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575358080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444455.010058:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444455.010067:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444455.010129:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575358208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444455.010158:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444455.010186:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d88840 going to sleep for 11 seconds 00000100:00100000:0.0:1783444455.010252:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575358208 00000100:00100000:0.0:1783444455.010257:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575358208 00000100:00100000:0.0:1783444455.010299:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783444455.010316:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575358208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444455.010408:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575358208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (248us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444455.010416:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783444455.010554:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575358208:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783444455.010588:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783444455.010596:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.010604:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444455.197528:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444455.197570:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575358336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444455.197646:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444455.197753:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575358336 00000100:00100000:3.0:1783444455.197762:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575358336 00000100:00100000:3.0:1783444455.197856:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:3.0:1783444455.197869:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575358336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444455.197902:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444455.197951:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575358336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444455.197960:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00080000:0.0:1783444455.198525:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444455.198570:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575358336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444455.199063:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444455.199077:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575358464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444455.199121:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444455.199402:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575358464 00000100:00100000:3.0:1783444455.199409:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575358464 00000100:00100000:3.0:1783444455.199467:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:3.0:1783444455.199477:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575358464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444455.199503:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444455.199554:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575358464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444455.199560:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00080000:1.0:1783444455.199681:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444455.199982:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575358464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444455.309252:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444455.309364:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557814784 00000100:00100000:1.0:1783444455.309375:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557814784 00000100:00100000:1.0:1783444455.309435:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1783444455.309447:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb78e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+5:70972:x1870073557814784:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444455.309465:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444455.309489:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4c10c00/0x42cb6883e3832e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cd3 expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.309528:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c10c00/0x42cb6883e3832e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cd3 expref: 6 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.309539:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4c10c00/0x42cb6883e3832e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cd3 expref: 6 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.309548:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10c00, rc 0) 00000100:00100000:1.0:1783444455.309631:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb78e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70972:x1870073557814784:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 186us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444455.309638:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:0.0:1783444455.312064:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444455.312409:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557814912 00000100:00100000:1.0:1783444455.312421:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557814912 00000100:00100000:1.0:1783444455.312478:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1783444455.312488:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb78e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70972:x1870073557814912:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783444455.312512:0:92445:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1783444455.312535:0:92445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783444455.312539:0:92445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1783444455.312542:0:92445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1783444455.312545:0:92445:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1783444455.312548:0:92445:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:1.0:1783444455.315718:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb78e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70972:x1870073557814912:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 Request processed in 3220us (3661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444455.315733:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:0.0:1783444455.319164:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444455.319213:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444455.319769:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557815168 00000100:00100000:1.0:1783444455.319781:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557815168 00000100:00100000:1.0:1783444455.319872:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1783444455.319882:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb78ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70972:x1870073557815168:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444455.319900:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444455.319920:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cda expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.319951:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 7 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.319962:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 7 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.319988:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11600, rc 0) 00000100:00100000:1.0:1783444455.320043:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb78ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+7:70972:x1870073557815168:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 161us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444455.320172:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1783444455.320255:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557815040 00000100:00100000:3.0:1783444455.320260:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557815040 00000100:00100000:3.0:1783444455.320295:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1345 00000100:00100000:3.0:1783444455.320310:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557815040:12345-192.168.204.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1783444455.320343:0:80475:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '08efc25c-17e5-4d29-97d2-f1505f195a06' at ffff9368c9a17800, cookie 0x42cb6883e3832cfc 00010000:00080000:3.0:1783444455.320350:0:80475:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp recovering/t0 exp ffff9368c9a17800 cur 3446 last 1783444453 00010000:02000400:3.0:1783444455.320358:0:80475:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1783444455.320364:0:80475:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1783444455.320391:0:80475:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783444455.320524:0:80475:0:(import.c:65:import_set_state_nolock()) ffff9368ea60e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444455.320554:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557815040:12345-192.168.204.20@tcp:38:ll_cfg_requeue.0 Request processed in 252us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444455.320561:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1345 00000100:00100000:0.0:1783444455.326095:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444455.326188:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557815296 00000100:00100000:3.0:1783444455.326198:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557815296 00000100:00100000:3.0:1783444455.326274:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1783444455.326285:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+7:70972:x1870073557815296:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444455.326458:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557815296:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 174us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444455.326467:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1783444455.334976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444455.336363:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444455.336461:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557815552 00000100:00100000:1.0:1783444455.336471:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557815552 00000100:00100000:1.0:1783444455.336528:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1783444455.336537:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d42bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557815552:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444455.336691:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d42bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557815552:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 154us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444455.336699:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:0.0:1783444455.338402:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557815424 00000100:00100000:0.0:1783444455.338417:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557815424 00000100:00100000:0.0:1783444455.338480:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1346 00000100:00100000:0.0:1783444455.338491:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557815424:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1783444455.338515:0:66225:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9367cadadc00 x1870073557815424/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:76/0 lens 328/0 e 0 to 0 dl 1783444466 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783444455.338638:0:92471:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1783444455.338684:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557815424:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 53us (3576us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444455.338694:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1346 00000100:00100000:0.0:1783444455.347472:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444455.347646:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557815680 00000100:00100000:2.0:1783444455.347657:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557815680 00000100:00100000:2.0:1783444455.347721:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:2.0:1783444455.347730:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557815680:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444455.347748:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444455.347767:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d71600/0x42cb6883e3832e84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ce1 expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444455.347818:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d71600/0x42cb6883e3832e84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce1 expref: 9 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444455.347832:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d71600/0x42cb6883e3832e84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce1 expref: 9 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444455.347857:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71600, rc 0) 00000100:00100000:2.0:1783444455.347927:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557815680:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 197us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444455.347935:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:0.0:1783444455.354744:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444455.355136:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557815808 00000100:00100000:1.0:1783444455.355146:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557815808 00000100:00100000:1.0:1783444455.355208:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:1.0:1783444455.355218:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557815808:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444455.355390:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557815808:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 172us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444455.355398:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1783444455.372202:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444455.372711:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557815936 00000100:00100000:3.0:1783444455.372723:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557815936 00000100:00100000:1.0:1783444455.373149:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:1.0:1783444455.373161:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557815936:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444455.373337:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557815936:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 178us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444455.373345:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1783444455.379461:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444455.379917:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557816064 00000100:00100000:1.0:1783444455.379928:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557816064 00000100:00100000:1.0:1783444455.379981:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1783444455.379991:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557816064:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444455.380008:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444455.380026:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ce8 expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.380055:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 10 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.380065:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 10 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444455.380072:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10600, rc 0) 00000100:00100000:1.0:1783444455.380122:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557816064:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 132us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444455.380129:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1783444455.389111:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444455.389185:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557816192 00000100:00100000:1.0:1783444455.389196:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557816192 00000100:00100000:1.0:1783444455.389261:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1783444455.389273:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557816192:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444455.389406:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557816192:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 135us (304us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783444455.389413:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00010000:00010000:0.0:1783444455.453100:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444455.709619:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:1.0:1783444455.837229:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:1.0:1783444456.480729:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444456.734315:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:2.0:1783444456.865324:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:3.0:1783444457.508801:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444457.765417:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:1.0:1783444457.888173:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 0 seconds 00010000:00010000:2.0:1783444458.524939:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444458.571155:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444458.571256:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444458.571288:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557816448 00000100:00100000:2.0:1783444458.571298:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557816448 00000100:00100000:2.0:1783444458.571361:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1068 00000100:00100000:2.0:1783444458.571373:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557816448:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444458.571446:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557816448:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444458.571454:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1068 00000100:00080000:2.0:1783444458.571474:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444458.580432:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557816320 00000100:00100000:0.0:1783444458.580446:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557816320 00000100:00100000:0.0:1783444458.580516:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:0.0:1783444458.580538:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d42bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557816320:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444458.580662:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d42bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557816320:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 125us (9516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444458.580670:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000001:02000400:1.0:1783444458.664129:0:92721:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783444458.782469:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 1 seconds 00000100:00100000:1.0:1783444458.782925:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb23a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575358592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444458.783174:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.783232:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575358592 00000100:00100000:1.0:1783444458.783249:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575358592 00000100:00100000:1.0:1783444458.783297:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:1.0:1783444458.783306:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575358592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444458.783346:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:1.0:1783444458.783391:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575358592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.783399:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:1.0:1783444458.783453:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb23a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575358592:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783444458.783709:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444458.783713:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444458.783717:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444458.783722:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3444 00000100:00080000:2.0:1783444458.783726:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444458.783731:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444458.783751:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fed80 x1870073575358848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444458.783785:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444458.783809:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444458.783811:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444458.783815:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3444 00000100:00080000:2.0:1783444458.783817:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444458.783821:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444458.783834:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fea00 x1870073575359104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444458.783853:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444458.783857:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444458.783858:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444458.783861:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3444 00000100:00080000:2.0:1783444458.783864:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444458.783867:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444458.783877:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69fdf80 x1870073575359360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444458.783899:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444458.783902:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444458.783904:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444458.783906:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3444 00000100:00080000:2.0:1783444458.783908:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444458.783911:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444458.783919:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd199180 x1870073575359744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444458.783989:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783444458.783992:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444458.783994:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368c6bc8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444458.783999:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9368c6bc8000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444458.784010:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367ccc59c00 x1870073575360128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444458.784045:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575358976:0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784082:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444458.784108:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575359872:0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784136:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444458.784155:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783444458.784161:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575358720:0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784185:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444458.784208:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575359616:0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784228:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444458.784267:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575358976 00000100:00100000:2.0:1783444458.784271:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575358976 00000100:00100000:2.0:1783444458.784310:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1783444458.784316:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575358976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784357:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575358976:12345-0@lo:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444458.784364:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1783444458.784385:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575359872 00000100:00100000:2.0:1783444458.784388:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575359872 00000100:00100000:2.0:1783444458.784429:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575359616 00000100:00100000:2.0:1783444458.784432:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575359616 00000100:00100000:2.0:1783444458.784453:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:2.0:1783444458.784460:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575359872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784491:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575359872:12345-0@lo:400:kworker.0 Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444458.784497:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:2.0:1783444458.784507:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:2.0:1783444458.784513:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575359616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784539:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575359616:12345-0@lo:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444458.784545:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00080000:2.0:1783444458.784564:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444458.784567:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444458.784570:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444458.784592:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575359616:0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784604:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575358976:0@lo:400:kworker.0 00000100:00100000:2.0:1783444458.784612:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575359872:0@lo:400:kworker.0 00000100:00100000:0.0:1783444458.785109:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575358848:0@lo:38:kworker.0 00000100:00100000:0.0:1783444458.785162:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444458.785182:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575359104:0@lo:38:kworker.0 00000100:00100000:0.0:1783444458.785215:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444458.785246:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575359360:0@lo:38:kworker.0 00000100:00100000:0.0:1783444458.785274:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444458.785293:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575359744:0@lo:38:kworker.0 00000100:00100000:0.0:1783444458.785314:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444458.785331:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575360128:0@lo:38:kworker.0 00000100:00100000:0.0:1783444458.785351:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444458.785386:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575358848 00000100:00100000:0.0:1783444458.785391:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575358848 00000100:00100000:0.0:1783444458.785415:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575359104 00000100:00100000:0.0:1783444458.785418:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575359104 00000100:00100000:0.0:1783444458.785426:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575359744 00000100:00100000:0.0:1783444458.785428:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575359744 00000100:00100000:0.0:1783444458.785436:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575360128 00000100:00100000:0.0:1783444458.785438:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575360128 00000100:00100000:0.0:1783444458.785448:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1783444458.785454:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575358848:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444458.785496:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3449 last 0 00000020:00000080:0.0:1783444458.785542:0:67017:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42cb6883e3832e92 00000004:00100000:0.0:1783444458.785557:0:67017:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444458.785688:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368c511d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444458.785734:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1870073575358848:12345-0@lo:38:kworker.0 Request processed in 278us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444458.785742:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1783444458.785759:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1783444458.785763:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575359104:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444458.785777:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3449 last 0 00000020:00000080:0.0:1783444458.785823:0:67017:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42cb6883e3832e99 00000004:00100000:0.0:1783444458.785830:0:67017:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444458.785848:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368c511b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444458.785874:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1870073575359104:12345-0@lo:38:kworker.0 Request processed in 109us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444458.785880:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1783444458.785893:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1783444458.785898:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575359744:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444458.785910:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3449 last 0 00000020:00000080:0.0:1783444458.785931:0:67017:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x42cb6883e3832ea0 00000004:00100000:0.0:1783444458.785937:0:67017:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444458.785951:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368c518e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444458.785979:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1870073575359744:12345-0@lo:38:kworker.0 Request processed in 79us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444458.785984:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1783444458.785997:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1783444458.786008:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575360128:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444458.786022:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3449 last 0 00000020:00000080:0.0:1783444458.786043:0:67017:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42cb6883e3832ea7 00000004:00100000:0.0:1783444458.786049:0:67017:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444458.786063:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368c5188000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444458.786088:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575360128:12345-0@lo:38:kworker.0 Request processed in 79us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444458.786094:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1783444458.786124:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575359360 00000100:00100000:0.0:1783444458.786129:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575359360 00000100:00100000:0.0:1783444458.786150:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:0.0:1783444458.786155:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575359360:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444458.786169:0:8430:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9368c9a10800, cookie 0x42cb6883e3832cf5 00010000:00080000:0.0:1783444458.786173:0:8430:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9368c9a10800 cur 3449 last 1783444453 00000004:00100000:0.0:1783444458.786182:0:8430:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444458.786198:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9368c518c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444458.786233:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575359360:12345-0@lo:38:kworker.0 Request processed in 77us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444458.786253:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00010000:00080000:0.0:1783444458.786279:0:92471:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783444458.786284:0:92471:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 115964116998 00000020:00080000:0.0:1783444458.786289:0:92471:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444458.786293:0:92471:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116998 00000020:00080000:0.0:1783444458.786296:0:92471:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444458.786298:0:92471:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116998 00010000:00080000:0.0:1783444458.786408:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368e69fed80 x1870073575358848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444458.786431:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00100000:1.0:1783444458.787900:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575358720 00000100:00100000:1.0:1783444458.787912:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575358720 00000100:00100000:1.0:1783444458.788724:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783444458.788736:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575358720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444458.788859:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575358720:12345-0@lo:400:kworker.0 Request processed in 125us (4672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.788867:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783444458.788944:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575359232:0@lo:400:kworker.0 00000100:00100000:1.0:1783444458.791314:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.791361:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575360000:0@lo:400:kworker.0 00000100:00100000:1.0:1783444458.791394:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.791435:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444458.791443:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd19a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575359488:0@lo:400:kworker.0 00000100:00100000:1.0:1783444458.791465:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.791507:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575360000 00000100:00100000:1.0:1783444458.791514:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575360000 00000100:00100000:1.0:1783444458.791573:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575359488 00000100:00100000:1.0:1783444458.791576:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575359488 00000100:00100000:1.0:1783444458.791600:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:1.0:1783444458.791608:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575360000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444458.791661:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575360000:12345-0@lo:400:kworker.0 Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.791667:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:1.0:1783444458.791688:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:1.0:1783444458.791694:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575359488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444458.791719:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575359488:12345-0@lo:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.791725:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00080000:1.0:1783444458.791768:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444458.791773:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444458.791827:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd19a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575359488:0@lo:400:kworker.0 00000100:00100000:1.0:1783444458.791837:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575360000:0@lo:400:kworker.0 00000100:00100000:1.0:1783444458.791876:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575359232 00000100:00100000:1.0:1783444458.791879:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575359232 00000100:00100000:1.0:1783444458.791910:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1783444458.791915:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575359232:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783444458.794766:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9368e69fed80 x1870073575358848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444483 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444458.794781:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444458.794821:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444458.794827:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444458.794833:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575358848:0@lo:38:kworker.0 00010000:00080000:0.0:1783444458.795106:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368e69fea00 x1870073575359104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444458.795125:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00100000:1.0:1783444458.797803:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575359232:12345-0@lo:400:kworker.0 Request processed in 5859us (6467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.797831:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:1.0:1783444458.797876:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444458.797880:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9368e69fea00 x1870073575359104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444483 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444458.797894:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444458.797901:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444458.797907:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444458.797913:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575359104:0@lo:38:kworker.0 00000100:00100000:1.0:1783444458.797929:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575359232:0@lo:400:kworker.0 00000100:00080000:0.0:1783444458.797970:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:0.0:1783444458.797981:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783444458.797986:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783444458.798192:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116997 gen 3 00000100:00080000:0.0:1783444458.798200:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368f8ca7800 from lustre-MDT0000_UUID committed 115964116997 last 0 00000100:00080000:0.0:1783444458.798204:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1783444458.798503:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575359360:0@lo:38:kworker.0 00010000:00080000:0.0:1783444458.798535:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9368dd199180 x1870073575359744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444458.798569:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00010000:00080000:1.0:1783444458.798583:0:92726:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1783444458.798588:0:92726:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1783444458.798593:0:92726:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1783444458.799958:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9368dd199180 x1870073575359744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444483 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444458.799971:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444458.799976:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444458.799981:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1783444458.800054:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ee2bc63c): req@ffff9368e69afb80 x1870073575342720/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444458.800080:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575359744:0@lo:38:kworker.0 00010000:00080000:0.0:1783444458.800107:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367ccc59c00 x1870073575360128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444458.800121:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:0.0:1783444458.800129:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783444458.800133:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783444458.800135:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368c6bc8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783444458.800140:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575360128:0@lo:38:kworker.0 00000001:00100000:0.0:1783444458.800214:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783444458.800311:0:66242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444458.800340:0:66242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368f5700780 going to sleep for 11 seconds 00000100:00100000:3.0:1783444458.801017:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575358720:0@lo:400:kworker.0 00000001:00100000:3.0:1783444458.802679:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:1.0:1783444458.804914:0:92726:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1783444458.805959:0:66239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575342720 00000100:00100000:2.0:1783444458.807262:0:66239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575342720 00000100:00100000:2.0:1783444458.807321:0:66239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783444458.807332:0:66239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66242:x1870073575342720:12345-0@lo:700:mdt_seqm_0001.0 00010000:00080000:2.0:1783444458.807353:0:66239:0:(ldlm_lib.c:3198:target_queue_recovery_request()) @@@ not queueing req@ffff9367ccd93b80 x1870073575342720/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:79/0 lens 264/0 e 0 to 0 dl 1783444469 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444458.807691:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575360256:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783444458.807804:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.808338:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575360256 00000100:00100000:1.0:1783444458.808345:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575360256 00000100:00100000:1.0:1783444458.808392:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:1.0:1783444458.808400:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575360256:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1783444458.808421:0:23687:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9367cadaed80 x1870073575360256/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:79/0 lens 224/0 e 0 to 0 dl 1783444469 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444458.808440:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575360256:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 42us (658us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444458.808446:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000020:00080000:1.0:1783444458.808461:0:92471:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444458.808464:0:92471:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964116998 00010000:00080000:1.0:1783444458.808467:0:92471:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1783444458.808470:0:92471:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444458.808477:0:92471:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783444458.808480:0:92471:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783444458.808488:0:92471:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9367cadadc00 x1870073557815424/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:76/0 lens 328/0 e 0 to 0 dl 1783444466 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783444458.808505:0:92471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444458.808539:0:92471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ca9 expref: -99 pid: 92471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.808565:0:92471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 7 pid: 92471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.808583:0:92471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 7 pid: 92471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.808591:0:92471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10a00, rc 0) 00010000:00080000:1.0:1783444458.808652:0:92471:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:1.0:1783444458.808665:0:92471:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00000001:00100000:2.0:1783444458.808957:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783444458.821612:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444458.821682:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557816576 00000100:00100000:1.0:1783444458.821692:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557816576 00000100:00100000:1.0:1783444458.821755:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1071 00000100:00100000:1.0:1783444458.821766:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2400:x1870073557816576:12345-192.168.204.20@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1783444458.821857:0:66226:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9367ccc59f80 x1870073557816576/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:79/0 lens 224/0 e 0 to 0 dl 1783444469 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444458.821918:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2400:x1870073557816576:12345-192.168.204.20@tcp:400:ptlrpcd_rcv.0 Request processed in 154us (314us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444458.821926:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1071 00010000:00080000:3.0:1783444458.821963:0:92471:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1783444458.822185:0:92471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 40000000:02000000:3.0:1783444458.822771:0:66239:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00100000:3.0:1783444458.831644:0:66239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66242:x1870073575342720:12345-0@lo:700:mdt_seqm_0001.0 Request processed in 24307us (31326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444458.831662:0:66239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783444458.831692:0:66242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69afb80 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-lwp-MDT0001_UUID:66242:1870073575342720:0@lo:700:mdt_seqm_0001.0 40000000:02000000:0.0:1783444458.831710:0:66242:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000100:00100000:0.0:1783444458.838558:0:66242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71060:x1870073557809920:12345-192.168.204.20@tcp:700:cp.0 Request processed in 21412649us (21412792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444458.838584:0:66242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1783444458.844656:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444458.844821:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557816832 00000100:00100000:3.0:1783444458.844832:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557816832 00000100:00100000:3.0:1783444458.844882:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1351 00000100:00100000:3.0:1783444458.844892:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71060:x1870073557816832:12345-192.168.204.20@tcp:101:cp.0 00010000:00010000:3.0:1783444458.844914:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444458.844936:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05200/0x42cb6883e3832eb5 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cef expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.845046:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.845055:0:66223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.845064:0:66223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783444458.845086:0:66223:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY_WAIT) req@ffff9367cadac000 x1870073575360384/t0(0) o101->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 328/344 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt00_000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444458.845097:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9d80 going to sleep for 0 seconds 00000001:00100000:2.0:1783444458.846428:0:92438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000001:00100000:2.0:1783444458.846437:0:92438:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1783444458.846476:0:92471:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1783444458.846517:0:92471:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1783444458.846529:0:92471:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9367cadaed80 x1870073575360256/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:79/0 lens 224/0 e 0 to 0 dl 1783444469 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783444458.846639:0:92471:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.20@tcp: req@ffff9367ccc59f80 x1870073557816576/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:79/0 lens 224/0 e 0 to 0 dl 1783444469 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783444458.846699:0:92471:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1783444458.847861:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1783444458.847874:0:3632:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9367cb23b480 x1870073575360256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444474 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444458.847896:0:3632:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9367cb23b480 x1870073575360256/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444474 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444458.847904:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1783444458.847918:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1783444458.847924:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007e85e60e): req@ffff9368f8fe7480 x1870073575339264/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/224 e 0 to 0 dl 1783444442 ref 2 fl Rpc:RSQU/200/0 rc -107/-107 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444458.847941:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000072aebbf1): req@ffff9367cadac000 x1870073575360384/t0(0) o101->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 328/344 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt00_000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444458.847954:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb23b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575360256:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1783444458.848033:0:75671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444458.848057:0:75671:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444458.848073:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575339264 00000100:00100000:3.0:1783444458.848079:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575339264 00000100:00100000:3.0:1783444458.848114:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:3.0:1783444458.848122:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75671:x1870073575339264:12345-0@lo:1000:dist_txn-1.0 00000020:00080000:3.0:1783444458.848149:0:8430:0:(tgt_handler.c:3165:tgt_check_resent()) @@@ no reply for RESENT req req@ffff9367cadaf100 x1870073575339264/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:79/0 lens 304/4320 e 0 to 0 dl 1783444469 ref 1 fl Interpret:/202/0 rc 0/0 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444458.849770:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75671:x1870073575339264:12345-0@lo:1000:dist_txn-1.0 Request processed in 1639us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444458.849782:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:3.0:1783444458.849856:0:75671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f8fe7480 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:75671:1870073575339264:0@lo:1000:dist_txn-1.0 00000004:00080000:3.0:1783444458.849906:0:75671:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9368ef11ee40 with version 8 00000020:00080000:3.0:1783444458.849920:0:75671:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444089 cancel update log [0x20000cf21:0x1:0x0].1: rc = 0 00000020:00080000:3.0:1783444458.850011:0:75671:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444089 cancel update log [0x2400088d4:0x1:0x0].1: rc = 0 00000020:00080000:3.0:1783444458.850029:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444089 00000004:00080000:3.0:1783444458.850039:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 8 rpc_version 8 00000020:00100000:3.0:1783444458.850067:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783444458.850074:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367cadaf800 x1870073575360640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444458.850097:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575360640:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783444458.850142:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444458.850165:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444458.850182:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575360640 00000100:00100000:3.0:1783444458.850633:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575360640 00000100:00100000:3.0:1783444458.850687:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1783444458.850696:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75656:x1870073575360640:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783444458.852306:0:66223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444458.852337:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444458.852355:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575360384 00000100:00100000:3.0:1783444458.852362:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575360384 00000100:00100000:3.0:1783444458.852403:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:3.0:1783444458.852413:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66223:x1870073575360384:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783444458.852430:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444458.852453:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832ec3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832ebc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852480:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832ebc expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852496:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832ebc expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852517:0:8430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:3.0:1783444458.852520:0:8430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783444458.852524:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05800, rc 0) 00000100:00100000:3.0:1783444458.852568:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66223:x1870073575360384:12345-0@lo:101:mdt00_000.0 Request processed in 158us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444458.852576:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:3.0:1783444458.852625:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66223:1870073575360384:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1783444458.852642:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832ec3 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852653:0:66223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832ec3 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444458.852677:0:66223:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1783444458.852684:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832ec3 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852691:0:66223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832ec3 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852750:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852759:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852767:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852805:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852812:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.852819:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444458.853033:0:66223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66223:1870073575360768:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783444458.853146:0:66223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444458.853165:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444458.853270:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575360768 00000100:00100000:1.0:1783444458.853275:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575360768 00000100:00100000:1.0:1783444458.853307:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:1.0:1783444458.853314:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66223:x1870073575360768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783444458.853405:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66223:x1870073575360768:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.853418:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:1.0:1783444458.853529:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66223:1870073575360768:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783444458.854693:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575360640:12345-0@lo:1000:osp_up0-1.0 Request processed in 3992us (4544us total) trans 120259084289 rc 0/0 00000100:00100000:1.0:1783444458.854705:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:1.0:1783444458.854767:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575360640:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783444458.854894:0:66223:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x472:0x0], count =400 00000004:00080000:1.0:1783444458.854901:0:66223:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x472:0x0]+400 in llog 00000004:00080000:1.0:1783444458.854916:0:66223:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x602:0x0], index 1: 0 00010000:00010000:1.0:1783444458.855220:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10400/0x42cb6883e3832ed8 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855249:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10400/0x42cb6883e3832ed8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855262:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10400/0x42cb6883e3832ed8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855301:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855309:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855315:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855322:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855339:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444458.855343:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855352:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855366:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:1.0:1783444458.855369:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444458.855456:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855464:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04c00/0x42cb6883e3832eca lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444458.855480:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008001f438 reply state 00000000dd3c6dbf transno 77309411441 ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855492:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855499:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9367c1e5ba00) 00010000:00010000:1.0:1783444458.855501:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444458.855504:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444458.855543:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f05200/0x42cb6883e3832eb5 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cef expref: 10 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855559:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10400/0x42cb6883e3832ed8 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cef expref: 9 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.855580:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff9368dccaee00) 00010000:00010000:1.0:1783444458.855583:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444458.855585:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10400, rc 0) 00000100:00100000:1.0:1783444458.855642:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71060:x1870073557816832:12345-192.168.204.20@tcp:101:cp.0 Request processed in 10751us (10996us total) trans 77309411441 rc 0/0 00000100:00100000:1.0:1783444458.855650:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1351 00000100:00100000:1.0:1783444458.856933:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575360896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444458.856979:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.857088:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575360896 00000100:00100000:1.0:1783444458.857095:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575360896 00000100:00100000:1.0:1783444458.857130:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:1.0:1783444458.857137:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3636:x1870073575360896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444458.857171:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444794368 avail 1298554880 00000100:00100000:1.0:1783444458.857211:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3636:x1870073575360896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.857218:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:1.0:1783444458.857278:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575360896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444458.862257:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444458.862493:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557816960 00000100:00100000:3.0:1783444458.862505:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557816960 00000100:00100000:3.0:1783444458.862558:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5900 00000100:00100000:3.0:1783444458.862568:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2400:x1870073557816960:12345-192.168.204.20@tcp:8:cp.0 00010000:00080000:3.0:1783444458.862604:0:26204:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp 0000000000000000 cur 3449 last 0 00000020:00000080:3.0:1783444458.862637:0:26204:0:(genops.c:1406:class_connect()) connect: client 08efc25c-17e5-4d29-97d2-f1505f195a06, cookie 0x42cb6883e3832ee6 00002000:00100000:3.0:1783444458.862649:0:26204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 08efc25c-17e5-4d29-97d2-f1505f195a06/ffff9368ea60a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783444458.862668:0:26204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783444458.862742:0:26204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783444458.862812:0:26204:0:(import.c:65:import_set_state_nolock()) ffff9368ea60a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444458.862881:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557816960:12345-192.168.204.20@tcp:8:cp.0 Request processed in 313us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444458.862888:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5900 00000100:00100000:3.0:1783444458.868523:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444458.868572:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557817088 00000100:00100000:3.0:1783444458.868582:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557817088 00000100:00100000:3.0:1783444458.868643:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5901 00000100:00100000:3.0:1783444458.868654:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:08efc25c-17e5-4d29-97d2-f1505f195a06+6:0:x1870073557817088:12345-192.168.204.20@tcp:101:cp.0 00010000:00010000:3.0:1783444458.868674:0:26205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444458.868694:0:26205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cf6 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.868721:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x602:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.868754:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.868833:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.868844:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 7 pid: 26205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.868866:0:26205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 7 pid: 26205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.868880:0:26205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368e6f05000, rc 0) 00000100:00100000:3.0:1783444458.868935:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:08efc25c-17e5-4d29-97d2-f1505f195a06+7:0:x1870073557817088:12345-192.168.204.20@tcp:101:cp.0 Request processed in 283us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444458.868943:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5901 00000100:00080000:3.0:1783444458.869406:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444458.883941:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444458.884105:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557817216 00000100:00100000:2.0:1783444458.884115:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557817216 00000100:00100000:2.0:1783444458.884163:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5902 00000100:00100000:2.0:1783444458.884174:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71060:x1870073557817216:12345-192.168.204.20@tcp:101:cp.0 00010000:00010000:2.0:1783444458.884191:0:8824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00000080:3.0:1783444458.884707:0:92471:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac1c48033e10 00100000:10000000:3.0:1783444458.884719:0:92471:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00010000:00010000:2.0:1783444458.884895:0:8824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939cfd expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.884930:0:8824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 8 pid: 26205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.884941:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444458.884946:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444458.884952:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 8 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.885068:0:8824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 8 pid: 26205 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.885085:0:8824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 8 pid: 26205 timeout: 3549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444458.885098:0:8824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8824:1870073575361024:192.168.204.20@tcp:104: 00000100:00100000:2.0:1783444458.885184:0:8824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444458.892555:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444458.892710:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557817344 00000100:00100000:1.0:1783444458.892720:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557817344 00010000:00010000:1.0:1783444458.892758:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 9 pid: 26205 timeout: 3549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444458.892820:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2553 00000100:00100000:1.0:1783444458.892841:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557817344:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444458.892857:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444458.892881:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 9 pid: 26205 timeout: 3549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.892897:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 9 pid: 26205 timeout: 3549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.892927:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.892932:0:6491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.892946:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 9 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.892958:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 9 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.893002:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 9 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444458.893018:0:6491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb23ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6491:1870073575361152:192.168.204.20@tcp:105: 00000100:00100000:1.0:1783444458.893176:0:6491:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c56d1f00 going to sleep for 11 seconds 00010000:00010000:3.0:1783444458.894859:0:8824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c1b002/0x42cb6883e3832eed lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cf6 expref: 9 pid: 26205 timeout: 3549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444458.894898:0:8824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8824:1870073575361024:192.168.204.20@tcp:104: 00010000:00010000:3.0:1783444458.894930:0:8824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 8 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.894944:0:8824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70200, rc 0) 00000100:00100000:3.0:1783444458.895032:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71060:x1870073557817216:12345-192.168.204.20@tcp:101:cp.0 Request processed in 10859us (11101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444458.895042:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5902 00000004:00080000:1.0:1783444458.897216:0:92457:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:1.0:1783444458.897286:0:92457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92457:1870073575361280:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783444458.897353:0:92457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.897403:0:92457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849d80 going to sleep for 11 seconds 00000004:00080000:1.0:1783444458.897424:0:92459:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1783444458.897442:0:92459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92459:1870073575361408:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783444458.897468:0:92459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.897484:0:92459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ceb0c900 going to sleep for 11 seconds 00000100:00100000:1.0:1783444458.897502:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575361280 00000100:00100000:1.0:1783444458.897509:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575361280 00000100:00100000:1.0:1783444458.897566:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575361408 00000100:00100000:1.0:1783444458.897570:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575361408 00000100:00100000:1.0:1783444458.897593:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1783444458.897602:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:92457:x1870073575361280:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783444458.897645:0:26199:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -63 00002000:02000040:1.0:1783444458.897650:0:26199:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:865) 00000100:00100000:3.0:1783444458.899184:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:3.0:1783444458.899199:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:92459:x1870073575361408:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783444458.899230:0:26206:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -62 00002000:02000040:3.0:1783444458.899246:0:26206:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:865) 00002000:00010000:1.0:1783444458.907761:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.907777:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.907819:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x361:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.907824:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x361:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.907830:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.907849:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.907860:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.907882:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.907901:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.908013:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.908018:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908026:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x360:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.908029:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x360:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.908033:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908042:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908049:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908057:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908070:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444458.908107:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.908112:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908127:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35f:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.908130:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.908134:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908144:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908152:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908159:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.908177:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783444458.909515:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.909527:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909540:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35e:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.909544:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.909548:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909559:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909579:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909586:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909607:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783444458.909704:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.909709:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909717:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35d:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.909720:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.909724:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909733:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909741:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909748:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.909768:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1783444458.910083:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783444458.910090:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910099:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.910104:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910114:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910131:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910138:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e3832efb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910156:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444458.910160:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910166:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.910169:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910188:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910199:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910206:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e3832f02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910219:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444458.910223:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910229:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.910243:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910252:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910262:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910270:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e3832f09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910294:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444458.910297:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910304:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.910308:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910315:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910326:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910333:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3832f10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910344:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.910347:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910353:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.910356:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.910374:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.911915:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.911932:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3832f17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.911953:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.911956:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.911957:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.911965:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.911972:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.911979:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.912057:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.912064:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912075:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35c:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.912079:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.912085:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912098:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912119:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912127:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912149:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.912253:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.912259:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912267:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35b:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.912270:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.912273:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912282:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912290:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912297:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912333:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444458.912342:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444458.912347:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912356:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.912360:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912368:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912382:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912400:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e3832f1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912414:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.912417:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912423:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.912426:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912444:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912455:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912461:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e3832f25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912474:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.912476:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.912477:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.912523:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.912528:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912536:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35a:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.912538:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.912542:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912550:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912557:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912569:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912581:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.912588:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.912592:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912598:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.912602:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912609:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912619:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912626:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e3832f2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912639:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.912640:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.912642:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.912685:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.912696:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912703:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x359:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.912706:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x359:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.912709:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912717:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912724:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912730:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912743:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.912749:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.912753:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912760:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.912763:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912770:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912810:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912818:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000387dc32f/0x42cb6883e3832f33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912832:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.912834:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.912836:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.912878:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.912883:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912891:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x358:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.912893:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.912897:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912906:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912913:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912920:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912944:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.912951:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.912954:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912960:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.912963:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912970:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912981:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.912989:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081065b9e/0x42cb6883e3832f3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913000:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.913002:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.913003:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.913045:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.913049:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913057:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x357:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.913066:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x357:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.913070:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913079:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913086:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913093:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913105:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.913112:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.913115:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913121:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.913125:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913132:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913142:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913159:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b62771/0x42cb6883e3832f41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.913173:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.913175:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.913176:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.913220:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.913225:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.913458:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.914367:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x356:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.914373:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.914379:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914461:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914470:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914477:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914498:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.914521:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.914526:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914534:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.914538:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914589:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914604:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914612:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e3832f48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914632:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.914634:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.914636:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.914738:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.914745:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914753:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x355:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.914756:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x355:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.914761:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914991:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.914997:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915001:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915071:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.915107:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.915112:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915119:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x354:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.915121:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x354:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.915125:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915133:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915141:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915159:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915174:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444458.915183:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444458.915188:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915287:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.915294:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915305:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.915308:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915317:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915329:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915337:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb950db/0x42cb6883e3832f56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915354:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.915360:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915361:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.915364:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.915367:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.915374:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915459:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915467:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f285823/0x42cb6883e3832f4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915482:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.915484:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.915486:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.915688:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.915699:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915707:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x353:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.915710:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x353:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.915714:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915723:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915731:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915738:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.915760:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444458.915824:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.915830:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915838:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.915841:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915848:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915860:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915867:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003db722ed/0x42cb6883e3832f5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.915881:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.915883:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.915885:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.916074:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.916081:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916089:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x352:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.916092:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.916096:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916181:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916197:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916205:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916228:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444458.916290:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783444458.916291:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444458.916296:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916300:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916324:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.916327:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916334:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916344:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916351:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abdcbc9/0x42cb6883e3832f64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916363:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.916365:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.916366:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.916399:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x351:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.916402:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x351:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.916406:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916416:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916424:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916431:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916475:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.916506:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.916509:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916515:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x350:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.916517:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x350:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.916520:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916525:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916530:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916534:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916543:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444458.916548:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444458.916550:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916554:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.916561:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916566:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916573:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916578:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e3832f6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916586:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.916588:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916591:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.916593:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916597:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916602:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916612:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092038f22/0x42cb6883e3832f72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916625:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.916626:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.916629:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.916629:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.916680:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.916686:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916694:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34f:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.916698:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.916702:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916712:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916720:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916727:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.916747:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444458.916825:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.916830:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916837:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.916841:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916861:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916872:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916881:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a2a0825/0x42cb6883e3832f79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.916895:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.916896:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.916898:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.917098:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.917105:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917125:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34e:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.917128:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.917132:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917142:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917151:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917158:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917177:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444458.917283:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.917288:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.917296:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.917299:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.917307:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.917319:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.917338:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b5bcede/0x42cb6883e3832f80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444458.917352:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444458.917354:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.917358:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.917361:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.917361:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917372:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34d:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.917376:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.917380:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917461:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917482:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917490:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917513:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.917563:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.917569:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917578:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34c:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.917581:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.917585:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917594:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917603:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917611:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917650:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444458.917660:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444458.917664:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917671:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.917674:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917682:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917694:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917701:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7973f43/0x42cb6883e3832f87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917713:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.917717:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.917829:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.917864:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.917867:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917898:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917911:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917919:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbf4e88c/0x42cb6883e3832f8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917933:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.917934:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.917936:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.917982:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.917987:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.917995:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34b:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.917999:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.918002:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918012:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918035:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918048:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918069:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.918112:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.918117:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918125:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34a:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.918129:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.918133:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918143:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918151:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918157:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918168:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444458.918218:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.918224:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918337:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444458.918343:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918351:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.918354:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918361:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918372:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918380:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074cfe0e5/0x42cb6883e3832f95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918394:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.918404:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918411:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.918414:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918423:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918433:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918441:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fb6d0d8/0x42cb6883e3832f9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918452:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.918454:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.918456:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.918462:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.918529:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x349:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.918532:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x349:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.918536:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918545:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918552:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918560:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918582:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.918624:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.918629:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918711:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x348:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.918714:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x348:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.918719:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918818:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918838:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.918845:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.918853:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.918861:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444458.926880:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.926902:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.926909:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.926944:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.926969:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.926978:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db2400fb/0x42cb6883e3832fa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927005:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.927010:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927017:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.927021:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927029:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927040:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927047:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c45daecc/0x42cb6883e3832faa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927081:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.927087:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.927090:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.927093:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.927189:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.927203:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927216:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x347:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.927221:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.927227:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927253:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927263:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927272:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927300:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.927340:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.927344:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927350:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x346:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.927352:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x346:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.927355:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927361:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927366:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927371:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927384:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444458.927390:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444458.927393:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927397:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.927405:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927410:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927418:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927423:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e3832fb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927433:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.927435:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927440:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.927442:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927445:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.927447:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927454:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927458:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e3832fb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927472:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.927474:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.927475:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.927514:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.927519:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927527:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x345:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.927530:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x345:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.927534:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927544:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927552:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927559:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927620:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.927677:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.927682:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927704:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x344:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.927707:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x344:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.927711:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927720:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927728:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.927735:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927879:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444458.927884:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927892:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.927895:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927902:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927914:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.927920:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8999e51/0x42cb6883e3832fbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444458.928229:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444458.928334:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557817600 00000100:00100000:2.0:1783444458.928343:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557817600 00000100:00100000:2.0:1783444458.928394:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:2.0:1783444458.928406:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd129c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71060:x1870073557817600:12345-192.168.204.20@tcp:35:cp.0 00000001:00080000:2.0:1783444458.928642:0:66229:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 77309411442 00000100:00100000:2.0:1783444458.928767:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd129c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+12:71060:x1870073557817600:12345-192.168.204.20@tcp:35:cp.0 Request processed in 361us (540us total) trans 77309411443 rc 0/0 00000100:00100000:2.0:1783444458.928775:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 233 00000020:00080000:2.0:1783444458.928780:0:66229:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783444458.928879:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.928884:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.928894:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.928898:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.928906:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.928922:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.928930:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.928933:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.928935:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.929491:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783444458.929500:0:26199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e3832fc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444458.929564:0:6491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb23ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6491:1870073575361152:192.168.204.20@tcp:105: 00010000:00010000:1.0:1783444458.930016:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444458.930057:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557817344:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 37218us (37507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.930067:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2553 00010000:00010000:1.0:1783444458.930394:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444458.930494:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.930506:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.930520:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x343:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.930524:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.930530:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.930543:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.930553:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.930560:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.932426:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444458.932539:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.932547:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.932561:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x342:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.932565:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.932570:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.932968:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.932992:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.932998:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933021:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444458.933039:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444458.933045:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933052:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.933057:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933065:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933081:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933089:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5155d80/0x42cb6883e3832fcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933112:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.933121:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933128:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.933132:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933139:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933149:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933156:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15493e1/0x42cb6883e3832fd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.933168:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.933169:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.933171:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783444458.933475:0:26199:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00000100:00100000:1.0:1783444458.933576:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:92457:x1870073575361280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 35970us (36218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.933600:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1783444458.933683:0:92457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92457:1870073575361280:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783444458.933704:0:92457:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x361:0x0] from OST, last_created [0x280000401:0x361:0x0]last_used is [0x280000401:0x322:0x0] 00000100:00100000:1.0:1783444458.933838:0:92457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb23ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92457:1870073575361664:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783444458.933886:0:92457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.933912:0:92457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75ddd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444458.933930:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575361536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444458.933956:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444458.933991:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575361664 00000100:00100000:1.0:1783444458.933998:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575361664 00000100:00100000:1.0:1783444458.934038:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:1.0:1783444458.934046:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:92457:x1870073575361664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783444458.934083:0:26203:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 866 00010000:00010000:2.0:1783444458.934393:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444458.937562:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:92457:x1870073575361664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3509us (3668us total) trans 4294969453 rc 0/0 00000100:00100000:1.0:1783444458.937577:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00000100:00100000:1.0:1783444458.937962:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575361536 00000100:00100000:1.0:1783444458.937970:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575361536 00000100:00100000:1.0:1783444458.938014:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:1.0:1783444458.938024:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575361536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444458.938048:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444458.938087:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575361536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (4130us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444458.938094:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:1.0:1783444458.938151:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575361536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444458.938190:0:92457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb23ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92457:1870073575361664:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783444458.938596:0:92457:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x361:0x0]-[0x280000401:0x381:0x0] 00002000:00010000:3.0:1783444458.943390:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.943403:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.943422:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x361:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.943426:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x361:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.943433:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.943448:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.943911:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.943924:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.943944:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444458.943956:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.943965:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.943985:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.943991:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.944013:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.944035:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.944043:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050a7c936/0x42cb6883e3832fdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.944064:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.944066:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.944068:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444458.944122:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.944128:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944136:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x360:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.944139:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x360:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.944143:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944151:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944159:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944166:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944568:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444458.944615:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.944620:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944629:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35f:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.944631:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.944635:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944645:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944653:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944660:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.944675:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783444458.944718:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.944723:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945061:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444458.945068:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945075:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.945080:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945088:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945110:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945118:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045583d9b/0x42cb6883e3832fe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945137:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.945140:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945147:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.945151:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945158:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945167:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945174:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b522588f/0x42cb6883e3832fe9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945187:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.945189:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444458.945579:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35e:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.945587:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.945592:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.945603:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.945611:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.945618:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.945633:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444458.945691:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.945697:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.945705:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35d:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.945708:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.945712:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.945719:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945904:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.945908:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945916:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.945920:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945929:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945941:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.945949:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e3832ff0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.946035:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.946037:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.946039:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.946048:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444458.946651:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.946670:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.946696:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444458.947121:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.947128:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.947137:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.947141:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.947160:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.947174:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.947181:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281a2b89/0x42cb6883e3832ff7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.947347:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.947354:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.947364:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35c:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.947367:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.947372:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.947383:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.947391:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.947397:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.947413:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444458.947466:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.948160:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948181:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35b:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.948184:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.948189:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948214:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948222:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948228:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948255:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783444458.948317:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.948323:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948332:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35a:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.948335:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.948339:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948349:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948369:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948376:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948386:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783444458.948430:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.948436:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948444:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x359:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.948447:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x359:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.948451:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948460:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.948468:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949579:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444458.949589:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949599:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.949604:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949613:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949633:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949641:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000442ed625/0x42cb6883e3832ffe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949671:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444458.949675:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949681:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.949684:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949692:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949703:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949710:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e3833005 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949721:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444458.949724:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949730:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444458.949733:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949752:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949774:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949782:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003433468a/0x42cb6883e383300c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444458.949810:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.949811:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.949813:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.949820:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444458.950566:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950608:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444458.950709:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.950715:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950726:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x358:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.950730:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.950735:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950747:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950755:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950762:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950776:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783444458.950837:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.950843:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950851:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x357:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.950861:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x357:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.950866:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950875:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950884:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950891:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950900:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783444458.950947:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.950953:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950972:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x356:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.950976:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.950981:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950990:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.950997:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.951011:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.951020:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783444458.951075:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.951082:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.951089:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x355:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.951092:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x355:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.951096:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.951105:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.951113:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.951120:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.951129:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783444458.951164:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.951170:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.951183:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x354:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.951186:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x354:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.951190:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956094:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783444458.956109:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956123:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444458.956129:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956140:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956163:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956170:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f774bdc4/0x42cb6883e3833013 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956205:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783444458.956210:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956217:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444458.956220:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956249:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956260:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956268:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032d9fa25/0x42cb6883e383301a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956281:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444458.956285:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956292:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444458.956295:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956303:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956314:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956320:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f86d01c/0x42cb6883e3833021 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956345:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444458.956349:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956356:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444458.956359:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956368:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956378:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956385:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e3833028 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956399:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444458.956404:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956410:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444458.956413:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956431:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956442:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956449:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1ad169a/0x42cb6883e383302f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444458.956462:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444458.956464:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444458.956465:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444458.958067:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958080:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958088:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958115:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444458.958249:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.958256:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958267:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x353:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:3.0:1783444458.958271:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x353:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.958276:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958285:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958296:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.958307:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958310:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958323:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958336:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444458.958340:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.958343:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958356:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958373:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958381:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ba4bd5/0x42cb6883e3833036 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.958383:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.958394:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958402:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x352:0x0].0x0 since=3449s v=(0 0) 00010000:00010000:1.0:1783444458.958404:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444458.958405:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.958410:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958412:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958432:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444458.958435:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958437:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.958457:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958459:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958478:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958491:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad06fd7c/0x42cb6883e383303d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.958504:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.958506:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.958507:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.958870:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444458.959289:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959327:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.959350:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.959356:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959364:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.959369:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959377:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.959393:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.959394:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959404:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959405:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009145694d/0x42cb6883e3833044 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959426:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x351:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.959431:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x351:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.959436:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959436:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.959446:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444458.959447:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959450:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444458.959458:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959466:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959499:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.959526:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.959533:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959540:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90800 already unused, calling callback (ffffffffc0c36f90) 00002000:00010000:3.0:1783444458.959542:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.959545:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959550:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959558:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959562:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x350:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.959573:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x350:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.959573:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959579:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959593:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959598:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f218104b/0x42cb6883e383304b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959604:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959617:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.959619:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.959622:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.959625:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444458.959635:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.959638:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.959643:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.959680:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.959686:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959694:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34f:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.959697:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.959701:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959710:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959718:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959745:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.959759:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444458.960362:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.960369:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960384:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960396:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960403:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fecfb8c8/0x42cb6883e3833052 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960418:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.960421:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960427:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.960429:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960436:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960443:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960450:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000231e4156/0x42cb6883e3833059 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.960472:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.960474:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.960476:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.960545:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444458.962014:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.962026:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962043:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34e:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.962048:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.962054:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962067:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962077:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962085:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962102:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444458.962186:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.962191:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962205:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34d:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.962208:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.962212:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962220:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962227:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962245:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962260:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783444458.962306:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.962312:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962320:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34c:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.962323:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.962327:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962337:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962358:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962366:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962376:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783444458.962417:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.962422:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962430:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34b:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.962433:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.962437:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962447:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962454:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962462:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962494:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783444458.962537:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.962543:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962550:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34a:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.962554:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.962558:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962568:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962576:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962584:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962592:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783444458.962630:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.962636:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962644:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x349:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.962654:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x349:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.962658:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962668:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962677:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962685:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962697:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1783444458.962697:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783444458.962707:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962718:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.962723:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962733:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.962741:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.962748:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962751:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962761:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x348:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.962768:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x348:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.962768:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e3833060 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962774:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962808:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962823:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962834:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783444458.962837:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962839:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962857:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444458.962858:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1783444458.962871:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962881:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962894:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.962898:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.962906:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb67712a/0x42cb6883e3833067 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962908:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962928:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x347:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.962931:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.962934:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962944:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962948:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783444458.962955:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962957:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962976:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444458.962978:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.962982:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.962994:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1783444458.963000:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963014:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963022:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000469b75c7/0x42cb6883e383306e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.963030:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.963039:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963046:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783444458.963053:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963058:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x346:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.963066:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x346:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.963068:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444458.963072:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963074:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963095:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963095:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963106:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963113:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963122:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783444458.963172:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.963178:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963185:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x345:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.963189:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x345:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.963193:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963201:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963218:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963224:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963246:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1783444458.963288:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.963293:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963301:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x344:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:3.0:1783444458.963303:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x344:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.963307:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963316:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963323:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963330:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963362:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1783444458.963366:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963375:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b85184c/0x42cb6883e3833075 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444458.963405:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444458.963410:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963411:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783444458.963418:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963424:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x343:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:1.0:1783444458.963430:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444458.963431:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444458.963437:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963439:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963461:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963483:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963485:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963498:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963506:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963510:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1783444458.963519:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a50d659a/0x42cb6883e383307c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963534:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783444458.963538:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963545:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91c00 already unused, calling callback (ffffffffc0c36f90) 00002000:00010000:3.0:1783444458.963549:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444458.963549:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963559:0:26206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963563:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963570:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x342:0x0].0x0 since=3450s v=(0 0) 00010000:00010000:1.0:1783444458.963578:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963580:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444458.963590:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963593:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000805fece2/0x42cb6883e3833083 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963606:0:26206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963620:0:26206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963630:0:26206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963634:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783444458.963640:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444458.963641:0:26206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1783444458.963664:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.963667:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963676:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963686:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963693:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfb6f332/0x42cb6883e383308a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963708:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783444458.963711:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963718:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.963722:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963743:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963756:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963764:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd7f7838/0x42cb6883e3833091 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963780:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783444458.963784:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963813:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.963816:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963823:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963831:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963836:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da5efb75/0x42cb6883e3833098 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963861:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444458.963864:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963871:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.963874:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963883:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963894:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963902:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f3cb8b1/0x42cb6883e383309f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963916:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444458.963918:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.963923:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.964284:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964305:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964317:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964323:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dbe9975/0x42cb6883e38330a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964336:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444458.964339:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964344:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.964346:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964352:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964360:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964366:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba44ce8/0x42cb6883e38330ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964385:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444458.964387:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964393:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444458.964396:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964402:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964411:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964418:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb7e729/0x42cb6883e38330b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444458.964428:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.964429:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.964431:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444458.964520:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.965014:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444458.966161:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783444458.975881:0:26206:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:3.0:1783444458.975975:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:92459:x1870073575361408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 76775us (78501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444458.975988:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00000100:00100000:2.0:1783444458.977344:0:92459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92459:1870073575361408:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783444458.977362:0:92459:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x361:0x0] from OST, last_created [0x2c0000401:0x361:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:3.0:1783444458.977461:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444458.977636:0:92459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc59880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92459:1870073575361920:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783444458.977690:0:92459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444458.977718:0:92459:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef1779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444458.977741:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575361920 00000100:00100000:2.0:1783444458.977747:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575361920 00000100:00100000:2.0:1783444458.977810:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1783444458.977820:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:92459:x1870073575361920:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783444458.977862:0:26208:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 866 00000100:00100000:2.0:1783444458.984191:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:92459:x1870073575361920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6366us (6494us total) trans 4294969456 rc 0/0 00000100:00100000:2.0:1783444458.985565:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1783444458.985657:0:92459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc59880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92459:1870073575361920:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783444458.985672:0:92459:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x361:0x0]-[0x2c0000401:0x381:0x0] 00000100:00100000:3.0:1783444458.988365:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575361792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444458.988450:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444458.988628:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575361792 00000100:00100000:2.0:1783444458.988637:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575361792 00000100:00100000:2.0:1783444458.988699:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:2.0:1783444458.988709:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575361792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444458.988739:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444458.993097:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575361792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4378us (4635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444458.993113:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:2.0:1783444458.994883:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575361792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783444459.549068:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783444459.722969:0:92776:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783444459.723301:0:92776:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783444460.317903:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444460.317928:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575362048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444460.318000:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444460.318051:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575362048 00000100:00100000:2.0:1783444460.318058:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575362048 00000100:00100000:2.0:1783444460.318113:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:2.0:1783444460.318122:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575362048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444460.318147:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444460.318202:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575362048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444460.318220:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00080000:2.0:1783444460.318239:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444460.318280:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575362048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444460.323334:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444460.323357:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575362176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444460.323424:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444460.323474:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575362176 00000100:00100000:2.0:1783444460.323482:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575362176 00000100:00100000:2.0:1783444460.323531:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:2.0:1783444460.323548:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575362176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444460.323578:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444460.323616:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575362176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444460.323623:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00080000:2.0:1783444460.323640:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444460.323669:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575362176:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783444460.574262:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444460.628046:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444460.628107:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444460.628133:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444460.630407:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444460.630934:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557817728 00000100:00100000:3.0:1783444460.630946:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557817728 00000100:00100000:3.0:1783444460.630997:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:3.0:1783444460.631006:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557817728:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444460.631101:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557817728:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 95us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444460.631108:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:2.0:1783444460.631550:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557817984 00000100:00100000:2.0:1783444460.631555:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557817984 00000100:00100000:2.0:1783444460.631608:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557817856 00000100:00100000:2.0:1783444460.631612:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557817856 00000100:00100000:2.0:1783444460.631647:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1072 00000100:00100000:2.0:1783444460.631655:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+12:2403:x1870073557817984:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444460.631725:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+12:2403:x1870073557817984:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 70us (3617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444460.631732:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1072 00000100:00100000:2.0:1783444460.631752:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1073 00000100:00100000:2.0:1783444460.631758:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557817856:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444460.631814:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557817856:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 57us (3681us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444460.631820:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1073 00000100:00100000:0.0:1783444460.632556:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557818112 00000100:00100000:0.0:1783444460.632564:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557818112 00000100:00100000:0.0:1783444460.632612:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2484 00000100:00100000:0.0:1783444460.632620:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557818112:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444460.632660:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557818112:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444460.632667:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2484 00000100:00080000:3.0:1783444460.633323:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444460.633330:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444460.633333:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:1.0:1783444460.743194:0:92826:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444460.744992:0:92826:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783444460.951700:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444460.952084:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557818240 00000100:00100000:0.0:1783444460.952095:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557818240 00000100:00100000:0.0:1783444460.952189:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1352 00000100:00100000:0.0:1783444460.952212:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71329:x1870073557818240:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1783444460.952234:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444460.952260:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38330bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d04 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444460.959822:0:66225:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7492us 00010000:00010000:1.0:1783444460.972399:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.972428:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.972442:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.972457:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.972464:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.972470:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444460.972617:0:66225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66225:1870073575362304:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783444460.972686:0:66225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444460.972720:0:66225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1783444460.972744:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575362304 00000100:00100000:1.0:1783444460.972751:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575362304 00000100:00100000:1.0:1783444460.972814:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:1.0:1783444460.972824:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66225:x1870073575362304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783444460.972902:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66225:x1870073575362304:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444460.972910:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:1.0:1783444460.972962:0:66225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66225:1870073575362304:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783444460.973004:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38330d0 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973023:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38330d0 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973032:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38330d0 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444460.973067:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38330d0 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973081:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973088:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973094:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973100:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973105:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444460.973110:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973117:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973130:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:1.0:1783444460.973133:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444460.973138:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973151:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38330c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973163:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973168:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973173:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973177:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444460.973180:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973186:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973209:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9367cd15cf00) 00010000:00010000:1.0:1783444460.973212:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444460.973215:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973221:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38330c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973264:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38330bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d04 expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973294:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38330d0 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d04 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444460.973302:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c200) 00010000:00010000:1.0:1783444460.973304:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444460.973307:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27e00, rc 0) 00000100:00100000:1.0:1783444460.973357:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71329:x1870073557818240:12345-192.168.204.20@tcp:101:rm.0 Request processed in 21149us (21667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444460.973364:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1352 00000100:00100000:2.0:1783444460.994534:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444460.994653:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557818368 00000100:00100000:3.0:1783444460.994666:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557818368 00000100:00100000:3.0:1783444460.994739:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1353 00000100:00100000:3.0:1783444460.994751:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+12:71329:x1870073557818368:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444460.994785:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444460.994833:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e38330d7 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d0b expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444460.994900:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38330de lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444460.994913:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38330de lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444460.994927:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38330de lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444460.994979:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783444460.994983:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783444460.995019:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e38330d7 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d0b expref: 14 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444460.995054:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38330de lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d0b expref: 13 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444460.995064:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c300) 00010000:00010000:3.0:1783444460.995067:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783444460.995071:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513bc00, rc 0) 00000100:00100000:3.0:1783444460.995132:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+13:71329:x1870073557818368:12345-192.168.204.20@tcp:101:rm.0 Request processed in 383us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444460.995140:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1353 00000100:00100000:3.0:1783444461.006974:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444461.013179:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557818624 00000100:00100000:1.0:1783444461.013208:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557818624 00000100:00100000:1.0:1783444461.013294:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1354 00000100:00100000:1.0:1783444461.013305:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+13:71329:x1870073557818624:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1783444461.013328:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444461.013358:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27000/0x42cb6883e38330e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d12 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444461.013485:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783444461.013589:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27000/0x42cb6883e38330e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d12 expref: 15 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.013603:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9367cd15cf00) 00010000:00010000:1.0:1783444461.013606:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444461.013611:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27000/0x42cb6883e38330e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d12 expref: 15 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.013659:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27000, rc 0) 00000100:00100000:1.0:1783444461.013737:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+14:71329:x1870073557818624:12345-192.168.204.20@tcp:101:rm.0 Request processed in 433us (6772us total) trans 77309411444 rc 301/301 00000100:00100000:1.0:1783444461.013744:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1354 00000100:00100000:0.0:1783444461.036321:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444461.036426:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557818752 00000100:00100000:1.0:1783444461.036437:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557818752 00000100:00100000:1.0:1783444461.036485:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:1.0:1783444461.036495:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+14:71329:x1870073557818752:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:1.0:1783444461.044749:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+14:71329:x1870073557818752:12345-192.168.204.20@tcp:37:rm.0 Request processed in 8243us (8426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444461.044763:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:3.0:1783444461.080438:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.080490:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557819008 00000100:00100000:3.0:1783444461.080500:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557819008 00000100:00100000:3.0:1783444461.080546:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:3.0:1783444461.080557:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+14:71329:x1870073557819008:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:3.0:1783444461.081616:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+15:71329:x1870073557819008:12345-192.168.204.20@tcp:35:rm.0 Request processed in 1057us (1184us total) trans 77309411445 rc 0/0 00000100:00100000:3.0:1783444461.081627:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:2.0:1783444461.087880:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.088043:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557819264 00000100:00100000:3.0:1783444461.088054:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557819264 00000100:00100000:3.0:1783444461.088120:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1355 00000100:00100000:3.0:1783444461.088131:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+15:71329:x1870073557819264:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444461.088157:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444461.088184:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e38330f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d19 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.088333:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513aa00/0x42cb6883e38330fa lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.088354:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513aa00/0x42cb6883e38330fa lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.088367:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513aa00/0x42cb6883e38330fa lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444461.088378:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783444461.088485:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e38330f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d19 expref: 18 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.088510:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513aa00/0x42cb6883e38330fa lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d19 expref: 17 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.088518:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c300) 00010000:00010000:3.0:1783444461.088521:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783444461.088524:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513aa00, rc 0) 00000100:00100000:3.0:1783444461.088578:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+17:71329:x1870073557819264:12345-192.168.204.20@tcp:101:rm.0 Request processed in 449us (712us total) trans 77309411446 rc 0/0 00000100:00100000:3.0:1783444461.088585:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1355 00000100:00100000:1.0:1783444461.100673:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.100784:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557819392 00000100:00100000:3.0:1783444461.100811:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557819392 00000100:00100000:3.0:1783444461.100868:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1356 00000100:00100000:3.0:1783444461.100879:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+17:71329:x1870073557819392:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444461.100907:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444461.100943:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e3833108 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d20 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.101014:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e383310f lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.101028:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e383310f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.101039:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e383310f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444461.101096:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1783444461.101099:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444461.101119:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e383310f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.101147:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e3833108 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d20 expref: 19 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.101248:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e383310f lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d20 expref: 18 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.101259:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:3.0:1783444461.101262:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444461.101265:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513ba00, rc 0) 00000100:00100000:3.0:1783444461.101332:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+18:71329:x1870073557819392:12345-192.168.204.20@tcp:101:rm.0 Request processed in 455us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444461.101340:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1356 00000100:00100000:3.0:1783444461.105116:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444461.105203:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557819648 00000100:00100000:1.0:1783444461.105215:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557819648 00000100:00100000:1.0:1783444461.105281:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1357 00000100:00100000:1.0:1783444461.105292:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+18:71329:x1870073557819648:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1783444461.105314:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444461.105335:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833116 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d27 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444461.105448:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1783444461.106243:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833116 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d27 expref: 20 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.106259:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c300) 00010000:00010000:1.0:1783444461.106269:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444461.106275:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833116 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d27 expref: 20 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.106286:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27600, rc 0) 00000100:00100000:1.0:1783444461.106388:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+19:71329:x1870073557819648:12345-192.168.204.20@tcp:101:rm.0 Request processed in 1097us (1283us total) trans 77309411447 rc 301/301 00000100:00100000:1.0:1783444461.106396:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1357 00000100:00100000:2.0:1783444461.114247:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.114335:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557819776 00000100:00100000:3.0:1783444461.114346:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557819776 00000100:00100000:3.0:1783444461.114420:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:3.0:1783444461.114432:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+19:71329:x1870073557819776:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:1.0:1783444461.119164:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+19:71329:x1870073557819776:12345-192.168.204.20@tcp:37:rm.0 Request processed in 4720us (4916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444461.119178:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:0.0:1783444461.126975:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.127058:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557820032 00000100:00100000:3.0:1783444461.127070:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557820032 00000100:00100000:3.0:1783444461.127140:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 237 00000100:00100000:3.0:1783444461.127151:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+19:71329:x1870073557820032:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:3.0:1783444461.127423:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+20:71329:x1870073557820032:12345-192.168.204.20@tcp:35:rm.0 Request processed in 273us (459us total) trans 77309411448 rc 0/0 00000100:00100000:3.0:1783444461.127431:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 237 00000100:00100000:2.0:1783444461.139387:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.139579:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557820288 00000100:00100000:3.0:1783444461.139591:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557820288 00000100:00100000:3.0:1783444461.139656:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1358 00000100:00100000:3.0:1783444461.139667:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+20:71329:x1870073557820288:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444461.139694:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444461.139718:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833124 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d2e expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.139886:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e383312b lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.139901:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e383312b lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.139913:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e383312b lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444461.139949:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1783444461.140076:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833124 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d2e expref: 23 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.140098:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e383312b lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d2e expref: 22 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.140108:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:3.0:1783444461.140112:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783444461.140117:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513be00, rc 0) 00000100:00100000:3.0:1783444461.140269:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+22:71329:x1870073557820288:12345-192.168.204.20@tcp:101:rm.0 Request processed in 603us (891us total) trans 77309411449 rc 0/0 00000100:00100000:3.0:1783444461.140277:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1358 00000100:00100000:1.0:1783444461.144268:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444461.144507:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557820416 00000100:00100000:2.0:1783444461.144517:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557820416 00000100:00100000:2.0:1783444461.144584:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1359 00000100:00100000:2.0:1783444461.144595:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71329:x1870073557820416:12345-192.168.204.20@tcp:41:rm.0 00000004:00000024:2.0:1783444461.144651:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382966272 00000100:00100000:2.0:1783444461.144744:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71329:x1870073557820416:12345-192.168.204.20@tcp:41:rm.0 Request processed in 150us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444461.144753:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1359 00000100:00100000:0.0:1783444461.149269:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.149905:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557820672 00000100:00100000:3.0:1783444461.149915:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557820672 00000100:00100000:3.0:1783444461.149973:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1360 00000100:00100000:3.0:1783444461.149983:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+22:71329:x1870073557820672:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1783444461.150067:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1783444461.150095:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10400/0x42cb6883e3832ed8 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cef expref: 22 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150118:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff9368dccaee00) 00010000:00010000:3.0:1783444461.150135:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e383310f lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d20 expref: 21 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150144:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:3.0:1783444461.150171:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444461.150200:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150213:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150224:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150236:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150243:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150249:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150352:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150361:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.150369:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783444461.151171:0:80475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4a:0x0].2, 64 off8320 00000004:00080000:3.0:1783444461.151183:0:80475:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3452193393702ns, next at 3453193391424ns, rc = 0 00010000:00010000:3.0:1783444461.151246:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151270:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151279:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151286:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151292:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151299:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151330:0:80475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444461.151351:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151357:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151363:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151368:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444461.151373:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151381:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151415:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444461.151419:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783444461.151423:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151428:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e3833147 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151447:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151453:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151458:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151463:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151467:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444461.151470:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151475:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151482:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:3.0:1783444461.151484:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444461.151486:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151503:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e3833139 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444461.151512:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000387b2781 reply state 00000000c539138d transno 77309411450 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151523:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.151529:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9367c1e5ba00) 00010000:00010000:3.0:1783444461.151531:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444461.151533:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444461.151631:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+22:71329:x1870073557820672:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1645us (2368us total) trans 77309411450 rc 0/0 00000100:00100000:3.0:1783444461.151639:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1360 00010000:00010000:2.0:1783444461.155382:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444461.155395:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.155416:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ac00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444461.155421:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.155431:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.155469:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:2.0:1783444461.155472:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783444461.155477:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 1/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.155484:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ac00/0x42cb6883e383314e lrc: 0/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.155511:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444461.155513:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444461.155515:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444461.156015:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.156438:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557820928 00000100:00100000:3.0:1783444461.156449:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557820928 00000100:00100000:3.0:1783444461.156513:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:3.0:1783444461.156522:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd12a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+22:71329:x1870073557820928:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:3.0:1783444461.156780:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd12a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+23:71329:x1870073557820928:12345-192.168.204.20@tcp:35:rm.0 Request processed in 257us (768us total) trans 77309411451 rc 0/0 00000100:00100000:3.0:1783444461.156814:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:1.0:1783444461.159545:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444461.159963:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557821184 00000100:00100000:3.0:1783444461.159974:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557821184 00000100:00100000:3.0:1783444461.160033:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1361 00000100:00100000:3.0:1783444461.160043:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+23:71329:x1870073557821184:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1783444461.160104:0:66223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783444461.160145:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e383312b lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d2e expref: 23 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160182:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c11c00/0x42cb6883e3832c3f lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cbe expref: 22 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160205:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9367cd15ce00) 00010000:00010000:3.0:1783444461.160222:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38330de lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d0b expref: 21 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160231:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c300) 00010000:00010000:3.0:1783444461.160234:0:66223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444461.160256:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160268:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160278:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160291:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160298:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160304:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160390:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160417:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.160425:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444461.162027:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1783444461.162052:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162062:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162070:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162076:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ae00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444461.162081:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162089:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162103:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:2.0:1783444461.162106:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783444461.162111:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162130:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ae00/0x42cb6883e3833163 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162232:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162241:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162247:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162254:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162259:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444461.162263:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162269:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162279:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c300) 00010000:00010000:2.0:1783444461.162282:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444461.162285:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162292:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a400/0x42cb6883e3833155 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444461.162303:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d923e714 reply state 00000000faf187a9 transno 77309411452 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162322:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.162331:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9368d40f4900) 00010000:00010000:2.0:1783444461.162333:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444461.162337:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444461.162542:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+22:71329:x1870073557821184:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2496us (3006us total) trans 77309411452 rc 0/0 00000100:00100000:2.0:1783444461.162552:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1361 00000100:00100000:2.0:1783444461.167384:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444461.167572:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444461.167825:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557821568 00000100:00100000:0.0:1783444461.167836:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557821568 00000100:00100000:0.0:1783444461.167888:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:0.0:1783444461.167899:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+22:71329:x1870073557821568:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:0.0:1783444461.168166:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+23:71329:x1870073557821568:12345-192.168.204.20@tcp:35:rm.0 Request processed in 268us (593us total) trans 77309411453 rc 0/0 00000100:00100000:0.0:1783444461.168175:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:2.0:1783444461.171304:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557821312 00000100:00100000:2.0:1783444461.171320:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557821312 00000100:00100000:2.0:1783444461.171391:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 736 00000100:00100000:2.0:1783444461.171403:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557821312:12345-192.168.204.20@tcp:103:rm.0 00010000:00010000:2.0:1783444461.171420:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444461.171447:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38330d0 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d04 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.171467:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c200) 00010000:00010000:2.0:1783444461.171479:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444461.171555:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557821312:12345-192.168.204.20@tcp:103:rm.0 Request processed in 155us (4183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444461.171563:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 736 00000100:00100000:2.0:1783444461.173991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444461.174082:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557821824 00000100:00100000:1.0:1783444461.174091:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557821824 00000100:00100000:1.0:1783444461.174149:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1362 00000100:00100000:1.0:1783444461.174173:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+23:71329:x1870073557821824:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1783444461.174251:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783444461.174279:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513aa00/0x42cb6883e38330fa lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d19 expref: 23 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.174299:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c4c10000/0x42cb6883e3832c23 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xa:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cb7 expref: 22 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.174311:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15c300) 00010000:00010000:1.0:1783444461.174320:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444461.174385:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.174394:0:71469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.174415:0:71469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444461.174439:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff664e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575362432:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1783444461.174499:0:71469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444461.174544:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444461.174706:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575362432 00000100:00100000:2.0:1783444461.174717:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575362432 00000100:00100000:2.0:1783444461.174770:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:2.0:1783444461.174778:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:71469:x1870073575362432:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1783444461.174833:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444461.174852:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e3833171 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e383316a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.174874:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 6 pid: 92471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.174884:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e3833171 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383316a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.174912:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 6 pid: 92471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.174926:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 6 pid: 92471 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444461.174937:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8431:1870073575362560:192.168.204.20@tcp:104: 00000100:00100000:2.0:1783444461.175003:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c170e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444461.180441:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444461.180522:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557821952 00000100:00100000:0.0:1783444461.180533:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557821952 00010000:00010000:0.0:1783444461.180571:0:8436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 7 pid: 92471 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444461.180615:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2554 00000100:00100000:0.0:1783444461.180625:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557821952:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444461.180639:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444461.180645:0:8436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 7 pid: 92471 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.180660:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 7 pid: 92471 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.180697:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:0.0:1783444461.180718:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e3833171 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383316a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.180729:0:8436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e3833171 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x42cb6883e383316a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.180738:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e3833171 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x42cb6883e383316a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.180820:0:8436:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e3833171 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383316a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444461.180838:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8436:1870073575362688:0@lo:105: 00000100:00100000:0.0:1783444461.180887:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444461.180924:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ca127600 going to sleep for 11 seconds 00000100:00100000:1.0:1783444461.181275:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575362688 00000100:00100000:1.0:1783444461.181282:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575362688 00000100:00100000:1.0:1783444461.181339:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1783444461.181347:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8436:x1870073575362688:12345-0@lo:105: 00010000:00010000:1.0:1783444461.181359:0:6488:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.181369:0:6488:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.181378:0:6488:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.181385:0:6488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.181392:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.181409:0:6488:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.181423:0:6488:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9367c6c26200) 00000100:00100000:1.0:1783444461.181474:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:8436:x1870073575362688:12345-0@lo:105: Request processed in 128us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444461.181482:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1783444461.182495:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8436:1870073575362688:0@lo:105: 00010000:00010000:0.0:1783444461.182517:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444461.182576:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557821952:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 1950us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444461.182585:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2554 00010000:00010000:2.0:1783444461.184235:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3832eae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ca9 expref: 6 pid: 92471 timeout: 3552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444461.184258:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8431:1870073575362560:192.168.204.20@tcp:104: 00010000:00010000:2.0:1783444461.184286:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e3833171 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383316a expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.184316:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:2.0:1783444461.184319:0:8431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444461.184321:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030600, rc 0) 00000100:00100000:2.0:1783444461.184447:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:71469:x1870073575362432:12345-0@lo:101:mdt00_004.0 Request processed in 9669us (9946us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444461.184456:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:1.0:1783444461.184594:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff664e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575362432:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1783444461.184614:0:71469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444461.184637:0:71469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1783444461.185129:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.185141:0:71469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.185233:0:71469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444461.185260:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575362816:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1783444461.185309:0:71469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444461.185385:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444461.185490:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575362816 00000100:00100000:2.0:1783444461.185497:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575362816 00000100:00100000:2.0:1783444461.185582:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1783444461.185591:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:71469:x1870073575362816:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1783444461.185611:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444461.185630:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e383317f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833178 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.185656:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e383317f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833178 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.185669:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e383317f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833178 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.185678:0:8430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9367c709ef00) 00010000:00010000:2.0:1783444461.185680:0:8430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444461.185682:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031200, rc 0) 00000100:00100000:2.0:1783444461.185744:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:71469:x1870073575362816:12345-0@lo:101:mdt00_004.0 Request processed in 153us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444461.185750:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:3.0:1783444461.185875:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575362816:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1783444461.185890:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383317f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444461.185901:0:71469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383317f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444461.185920:0:71469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1783444461.185961:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575362944:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783444461.185990:0:71469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444461.186644:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575362944 00000100:00100000:1.0:1783444461.186656:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575362944 00000100:00100000:1.0:1783444461.186880:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:1.0:1783444461.186889:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:71469:x1870073575362944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783444461.186975:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:71469:x1870073575362944:12345-0@lo:1000:mdt00_004.0 Request processed in 87us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444461.186983:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:1.0:1783444461.187252:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444461.187275:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575362944:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783444461.187333:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575363072:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783444461.187363:0:71469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444461.187388:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dd300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444461.187485:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575363072 00000100:00100000:2.0:1783444461.187490:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575363072 00000100:00100000:2.0:1783444461.187525:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:2.0:1783444461.187533:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:71469:x1870073575363072:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783444461.187977:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:71469:x1870073575363072:12345-0@lo:1000:mdt00_004.0 Request processed in 444us (612us total) trans 0 rc 1/1 00000100:00100000:2.0:1783444461.187984:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:1.0:1783444461.188084:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575363072:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1783444461.188148:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.188169:0:71469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.188179:0:71469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444461.188203:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575363200:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1783444461.188230:0:71469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444461.188254:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75dde40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444461.188347:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575363200 00000100:00100000:2.0:1783444461.188351:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575363200 00000100:00100000:2.0:1783444461.188384:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:2.0:1783444461.188391:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:71469:x1870073575363200:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1783444461.188402:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444461.188514:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e383318d lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833186 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.188541:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e383318d lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833186 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.188556:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e383318d lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833186 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.188564:0:8430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367c709e500) 00010000:00010000:2.0:1783444461.188567:0:8430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783444461.188571:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030200, rc 0) 00000100:00100000:2.0:1783444461.188610:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:71469:x1870073575363200:12345-0@lo:101:mdt00_004.0 Request processed in 219us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444461.188616:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:1.0:1783444461.188678:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:71469:1870073575363200:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1783444461.188971:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.188983:0:71469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.189030:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.189038:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.189046:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783444461.189524:0:71469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].2, 432 off34200 00000040:00080000:1.0:1783444461.189574:0:71469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].2, 512 off34432 00000004:00080000:1.0:1783444461.189581:0:71469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9367c75dde40 with version 9 00000004:00080000:3.0:1783444461.189940:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 9 rpc_version 9 00000020:00100000:3.0:1783444461.189971:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783444461.189980:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9368e3efb100 x1870073575363456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444461.190000:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3efb100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575363456:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783444461.190053:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444461.190126:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444461.190235:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575363456 00000100:00100000:2.0:1783444461.190253:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575363456 00000100:00100000:2.0:1783444461.190329:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:2.0:1783444461.190339:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fa171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75656:x1870073575363456:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783444461.195200:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fa171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75656:x1870073575363456:12345-0@lo:1000:osp_up0-1.0 Request processed in 4842us (5124us total) trans 120259084290 rc 0/0 00000100:00100000:2.0:1783444461.195218:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:1.0:1783444461.196330:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3efb100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575363456:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1783444461.196619:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783444461.196647:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196658:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196665:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196899:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444461.196905:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196914:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196930:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367cd15cd00) 00010000:00010000:0.0:1783444461.196933:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444461.196937:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196943:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833194 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196963:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196972:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.196980:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.197034:0:71469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783444461.197050:0:71469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1783444461.197056:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.197075:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.197082:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197112:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444461.197119:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197126:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26e00 already unused, calling callback (ffffffffc184ceb0) 00010000:00010000:2.0:1783444461.197130:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444461.197137:0:10323:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197181:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197199:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783444461.197259:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575363584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444461.197322:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444461.197410:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575363584 00000100:00100000:1.0:1783444461.197420:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575363584 00000100:00100000:1.0:1783444461.197469:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1783444461.197478:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+12:3633:x1870073575363584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444461.197492:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444461.197512:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e383318d lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833186 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444461.197526:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0x0 (ffff9367c709e500) 00010000:00010000:1.0:1783444461.197547:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444461.197656:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 1/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197664:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26e00/0x42cb6883e3833186 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e383318d expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197680:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444461.197691:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197705:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc184ceb0) 00010000:00010000:2.0:1783444461.197710:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444461.197717:0:10323:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197738:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.197744:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444461.198056:0:71469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00080000:0.0:1783444461.198067:0:71469:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1783444461.198073:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383317f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.198081:0:71469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383317f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444461.198161:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+22:71329:x1870073557821824:12345-192.168.204.20@tcp:36:rm.0 Request processed in 23991us (24166us total) trans 77309411454 rc 0/0 00000100:00100000:0.0:1783444461.198171:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1362 00000100:00100000:0.0:1783444461.202677:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575363712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444461.202780:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444461.202867:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575363712 00000100:00100000:0.0:1783444461.202875:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575363712 00000100:00100000:0.0:1783444461.202920:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1783444461.202928:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3634:x1870073575363712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444461.202944:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444461.202966:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e3833171 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383316a expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444461.203007:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:0.0:1783444461.203012:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444461.203112:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3634:x1870073575363712:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444461.203120:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1783444461.203157:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575363712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444461.203924:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444461.204203:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.204216:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26200/0x42cb6883e383316a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833171 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444461.204228:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444461.204230:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444461.204232:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444461.208516:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3633:x1870073575363584:12345-0@lo:103:ldlm_bl.0 Request processed in 11027us (11182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444461.208664:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1783444461.208731:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575363584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444461.597065:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444462.622718:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444463.646571:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444463.900970:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575363840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444463.901069:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444463.901103:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575363968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444463.901165:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444463.901297:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575363840 00000100:00100000:2.0:1783444463.901305:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575363840 00000100:00100000:2.0:1783444463.901345:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:2.0:1783444463.901353:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3635:x1870073575363840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444463.901388:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444798464 avail 1298558976 00000100:00100000:2.0:1783444463.901446:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3635:x1870073575363840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444463.901466:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:2.0:1783444463.901482:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575363968 00000100:00100000:2.0:1783444463.901485:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575363968 00000100:00100000:2.0:1783444463.901503:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:2.0:1783444463.901508:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575363968:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444463.901636:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575363840:0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444463.901770:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445027840 avail 1298788352 00000100:00100000:2.0:1783444463.901837:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575363968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 328us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444463.901844:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:3.0:1783444463.901917:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575364096:0@lo:400:kworker.0 00000100:00100000:3.0:1783444463.902027:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444463.902106:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575363968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444463.902215:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575364224:0@lo:400:kworker.0 00000100:00100000:0.0:1783444463.902244:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444463.902255:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575364096 00000100:00100000:1.0:1783444463.902260:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575364096 00000100:00100000:0.0:1783444463.902289:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575364224 00000100:00100000:1.0:1783444463.902293:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783444463.902295:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575364224 00000100:00080000:3.0:1783444463.909678:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444463.912154:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575364736:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.912246:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444463.912302:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575365248:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.912321:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444463.912345:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783444463.912352:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575364608:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.912372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444463.912386:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575365120:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.912402:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444463.912436:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575364608 00000100:00100000:2.0:1783444463.912442:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575364608 00000100:00100000:1.0:1783444463.913449:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575364096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.913485:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575364736 00000100:00100000:1.0:1783444463.913489:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575364736 00000100:00100000:1.0:1783444463.913534:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575365248 00000100:00100000:1.0:1783444463.913537:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575365248 00000100:00100000:1.0:1783444463.913553:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575365120 00000100:00100000:1.0:1783444463.913555:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575365120 00000100:00100000:1.0:1783444463.913572:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:1.0:1783444463.913579:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575364736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.913637:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575364736:12345-0@lo:400:kworker.0 Request processed in 58us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444463.913644:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:1.0:1783444463.913661:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:1.0:1783444463.913666:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575365248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.913686:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575365248:12345-0@lo:400:kworker.0 Request processed in 21us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444463.913692:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:1.0:1783444463.913701:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487 00000100:00100000:1.0:1783444463.913706:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575365120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.913724:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575365120:12345-0@lo:400:kworker.0 Request processed in 18us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444463.913743:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487 00000100:00100000:1.0:1783444463.913802:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575364096:12345-0@lo:400:kworker.0 Request processed in 11490us (11762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444463.913810:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1783444463.913945:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444463.913950:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444463.913952:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444463.913978:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e78c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575364352:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.914008:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444463.914029:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575364864:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.914047:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444463.914061:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575365376:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.914080:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444463.914096:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783444463.914102:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575364480:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.914118:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444463.914133:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575364992:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.914162:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444463.914257:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575364096:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.914287:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575364352 00000100:00100000:1.0:1783444463.914290:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575364352 00000100:00100000:0.0:1783444463.916096:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1783444463.916130:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575364224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444463.916229:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575364224:12345-0@lo:400:kworker.0 Request processed in 117us (13983us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444463.920090:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575364864 00000100:00100000:3.0:1783444463.920105:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575364864 00000100:00100000:2.0:1783444463.920181:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575365376 00000100:00100000:3.0:1783444463.920182:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1783444463.920188:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575365376 00000100:00100000:3.0:1783444463.920196:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575364864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.920215:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575364480 00000100:00100000:2.0:1783444463.920220:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575364480 00000100:00100000:2.0:1783444463.920240:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575364992 00000100:00100000:2.0:1783444463.920243:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575364992 00000100:00100000:2.0:1783444463.920263:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1783444463.920287:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575364608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444463.920294:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575364864:12345-0@lo:400:kworker.0 Request processed in 99us (6242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444463.920303:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:3.0:1783444463.920331:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1783444463.920338:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575365376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444463.920371:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575365376:12345-0@lo:400:kworker.0 Request processed in 34us (6289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444463.920377:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1783444463.920391:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1783444463.920397:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575364480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.920422:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575364608:12345-0@lo:400:kworker.0 Request processed in 136us (8046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444463.920430:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1783444463.920444:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1783444463.920450:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575364992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.920478:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575364992:12345-0@lo:400:kworker.0 Request processed in 29us (6316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444463.920484:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1783444463.920536:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575364608:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.920549:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575365120:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.920560:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575364736:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.920572:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575365248:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.920586:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575364224:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.920607:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1783444463.920620:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575364352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444463.920717:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00080000:0.0:1783444463.920844:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444463.920851:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444463.920854:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444463.920864:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575364992:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.920866:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575364352:12345-0@lo:400:kworker.0 Request processed in 249us (6855us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444463.920885:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e78c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575364352:0@lo:400:kworker.0 00000100:00100000:1.0:1783444463.920889:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1783444463.920901:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575364864:0@lo:400:kworker.0 00000100:00100000:2.0:1783444463.920920:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575365376:0@lo:400:kworker.0 00000100:00100000:3.0:1783444463.921640:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575364480:12345-0@lo:400:kworker.0 Request processed in 1239us (7517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444463.921650:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1783444463.921897:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575364480:0@lo:400:kworker.0 00000100:00100000:2.0:1783444464.421346:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575365504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444464.421437:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444464.421576:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444464.421587:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575365632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444464.421628:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444464.421665:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575365504 00000100:00100000:0.0:1783444464.421672:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575365504 00000100:00100000:0.0:1783444464.421713:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575365632 00000100:00100000:0.0:1783444464.421717:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575365632 00000100:00100000:2.0:1783444464.421738:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:2.0:1783444464.421750:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575365504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444464.421809:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444464.421987:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575365504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 238us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444464.425311:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575365504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444464.425984:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1783444464.425996:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1783444464.426008:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575365632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444464.426043:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444464.429485:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575365632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3483us (7849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444464.429503:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:0.0:1783444464.429584:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575365632:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783444464.671279:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444464.933258:0:75651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x42cb6883e383317f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444464.933280:0:75651:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x42cb6883e383317f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444464.933326:0:75651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e383317f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444464.933333:0:75651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444464.933560:0:75651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c27400/0x42cb6883e3833178 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e383317f expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783444464.933580:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411454 is committed 00000004:00080000:1.0:1783444464.933600:0:75651:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00000100:00100000:3.0:1783444464.933967:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444464.933989:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575365888:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1783444464.934061:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444464.934103:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575365888 00000100:00100000:3.0:1783444464.934115:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575365888 00000100:00100000:3.0:1783444464.934171:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5907 00000100:00100000:3.0:1783444464.934194:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575365888:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1783444464.934240:0:8824:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1538 count 1 00010000:00010000:3.0:1783444464.934296:0:8824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444464.934327:0:8824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 6 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444464.934641:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x602:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1783444464.934646:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783444464.934651:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444464.934848:0:8824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 6 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444464.934864:0:8824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 6 pid: 8824 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444464.934877:0:8824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8824:1870073575366016:192.168.204.20@tcp:104: 00000100:00100000:3.0:1783444464.934950:0:8824:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bfb300 going to sleep for 11 seconds 00010000:00010000:2.0:1783444464.935208:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935218:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935226:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935231:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f04200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444464.935235:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935242:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935258:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9367c1e5ba00) 00010000:00010000:2.0:1783444464.935261:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444464.935266:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935272:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368e6f04200/0x42cb6883e3832ed1 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935300:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935306:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935312:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935316:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444464.935320:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935325:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935333:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xb:0x0].0xb1bed465 (ffff9367c1e5ba00) 00010000:00010000:2.0:1783444464.935335:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444464.935500:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935507:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b000/0x42cb6883e3833140 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xb:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935531:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935539:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935546:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935558:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444464.935561:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935567:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935577:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xa:0x0].0xf7117594 (ffff9368d40f4900) 00010000:00010000:2.0:1783444464.935580:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444464.935584:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.935591:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a800/0x42cb6883e383315c lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xa:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444464.935618:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444464.935631:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575365760:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1783444464.935689:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444464.938318:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575365760 00000100:00100000:2.0:1783444464.938328:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575365760 00000001:00080000:3.0:1783444464.938649:0:92438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000100:00100000:2.0:1783444464.938901:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1783444464.938912:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3633:x1870073575365760:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1783444464.938925:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444464.938948:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e383317f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833178 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444464.939530:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9367c709ef00) 00010000:00010000:2.0:1783444464.939544:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444464.939629:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575365760:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 718us (3940us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444464.939637:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1783444464.939852:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575365760:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:0.0:1783444464.945740:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969456 is committed 00000001:00100000:0.0:1783444464.945781:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000100:00100000:3.0:1783444464.946995:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444464.947083:0:8824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8824:1870073575366016:192.168.204.20@tcp:104: 00010000:00010000:3.0:1783444464.947112:0:8824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444464.948534:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557822080 00000100:00100000:0.0:1783444464.948546:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557822080 00010000:00010000:0.0:1783444464.948651:0:8436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 6 pid: 8824 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444464.948709:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2555 00000100:00100000:0.0:1783444464.948719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557822080:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444464.948734:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444464.948740:0:8436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 6 pid: 8824 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.948754:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 6 pid: 8824 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.948814:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0cf449d/0x42cb6883e3832ef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cfd expref: 6 pid: 8824 timeout: 3555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.948831:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783444464.948835:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783444464.948841:0:8436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.948852:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.948881:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444464.948941:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557822080:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 223us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444464.948949:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2555 00010000:00010000:0.0:1783444464.949140:0:8824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949150:0:8824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949160:0:8824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949167:0:8824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949193:0:8824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783444464.949763:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3636:x1870073575365888:12345-0@lo:6:osp-syn-1-1.0 Request processed in 15581us (15698us total) trans 4294969457 rc 0/0 00000100:00100000:0.0:1783444464.949774:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5907 00010000:00010000:0.0:1783444464.949820:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444464.949825:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949833:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513bc00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444464.949837:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949846:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949859:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949865:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e383319b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444464.949884:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444464.949886:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444464.949888:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783444464.949934:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9368e3efaa00/2, rc 0, transno 4294969457 00000100:00100000:0.0:1783444464.949951:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575365888:0@lo:6:osp-syn-1-1.0 00000001:00080000:0.0:1783444464.955586:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969453 is committed 00000100:00080000:2.0:1783444464.966997:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444465.437165:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444465.437190:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575366144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444465.437311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444465.437473:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575366144 00000100:00100000:2.0:1783444465.437481:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575366144 00000100:00100000:2.0:1783444465.437550:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1783444465.437560:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575366144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444465.437584:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444465.437631:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575366144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444465.437637:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00080000:3.0:1783444465.437700:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444465.437784:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575366144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444465.437871:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575366272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444465.437902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444465.439743:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575366272 00000100:00100000:0.0:1783444465.439754:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575366272 00000100:00100000:0.0:1783444465.439859:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:0.0:1783444465.439872:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575366272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444465.439896:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444465.439977:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3633:x1870073575366272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444465.439984:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00080000:3.0:1783444465.440474:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444465.441090:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575366272:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444465.693397:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444465.743365:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444465.743463:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557822208 00000100:00100000:3.0:1783444465.743473:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557822208 00000100:00100000:3.0:1783444465.743527:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1783444465.743537:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557822208:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444465.743614:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557822208:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444465.743622:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:0.0:1783444465.750387:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444465.750482:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444465.750557:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444465.750631:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557822592 00000100:00100000:3.0:1783444465.750641:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557822592 00000100:00100000:2.0:1783444465.750660:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557822336 00000100:00100000:2.0:1783444465.750666:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557822336 00000100:00100000:3.0:1783444465.750704:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2489 00000100:00100000:3.0:1783444465.750714:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557822592:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444465.750776:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557822464 00000100:00100000:2.0:1783444465.750780:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557822464 00000100:00100000:3.0:1783444465.750832:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557822592:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444465.750835:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1080 00000100:00100000:3.0:1783444465.750845:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2489 00000100:00100000:2.0:1783444465.750850:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557822336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444465.750885:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557822336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 40us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444465.750893:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1080 00000100:00080000:3.0:1783444465.750897:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444465.750903:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444465.750910:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1081 00000100:00100000:2.0:1783444465.750918:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557822464:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444465.750943:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557822464:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444465.750949:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1081 00010000:00010000:3.0:1783444466.732334:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444467.740987:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444468.767074:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783444468.922472:0:93022:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 13:14:28 (1783444468) 00000100:00100000:2.0:1783444469.022406:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575366400:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.022484:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.022533:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575366912:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.022546:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575366400 00000100:00100000:1.0:1783444469.022555:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575366400 00000100:00100000:2.0:1783444469.022559:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.022579:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575367424:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.022598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444469.022600:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783444469.022609:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575366400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.022613:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575367936:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.022634:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444469.022657:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575366400:12345-0@lo:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.022667:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575366400:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.022671:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783444469.022680:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783444469.022686:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575366784:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.022705:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.022724:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575367296:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.022732:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575366912 00000100:00100000:1.0:1783444469.022735:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575366912 00000100:00100000:2.0:1783444469.022746:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.022779:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575367808:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.022782:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575367424 00000100:00100000:1.0:1783444469.022785:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575367424 00000100:00100000:2.0:1783444469.022829:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575366528:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.022831:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575367936 00000100:00100000:1.0:1783444469.022834:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575367936 00000100:00100000:2.0:1783444469.022852:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444469.022857:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575366784 00000100:00100000:1.0:1783444469.022860:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575366784 00000100:00100000:2.0:1783444469.022864:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575367040:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.022873:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575366528 00000100:00100000:1.0:1783444469.022875:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575366528 00000100:00100000:1.0:1783444469.022890:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:1.0:1783444469.022896:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575366912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.022916:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444469.022927:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575366912:12345-0@lo:400:kworker.0 Request processed in 32us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.022934:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575367552:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.022934:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:1.0:1783444469.022946:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1783444469.022951:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575367424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.022957:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.022976:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783444469.022977:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575367424:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.022981:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575366656:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.022982:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1783444469.022993:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1783444469.022998:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575367936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023010:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.023021:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575367168:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.023034:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575367936:12345-0@lo:400:kworker.0 Request processed in 36us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.023039:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444469.023052:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1783444469.023063:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575366656 00000100:00100000:2.0:1783444469.023067:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575367680:0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.023071:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575366656 00000100:00100000:2.0:1783444469.023088:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444469.023088:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1783444469.023094:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575366784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023119:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1783444469.023120:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575366784:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.023125:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575366528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.023125:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1783444469.023136:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1783444469.023142:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575366656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023156:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575366528:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.023163:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1783444469.023164:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575366656:12345-0@lo:400:kworker.0 Request processed in 23us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444469.023168:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:1.0:1783444469.023180:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783444469.023184:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444469.023187:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575367040 00000100:00100000:2.0:1783444469.023190:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575367040 00000100:00100000:1.0:1783444469.023193:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575367296 00000100:00100000:1.0:1783444469.023195:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575367296 00000100:00100000:2.0:1783444469.023214:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575367552 00000100:00100000:2.0:1783444469.023217:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575367552 00000100:00100000:1.0:1783444469.023221:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575367168 00000100:00100000:1.0:1783444469.023223:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575367168 00000100:00100000:2.0:1783444469.023233:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:1.0:1783444469.023238:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575367680 00000100:00100000:2.0:1783444469.023239:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575367040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.023240:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575367680 00000100:00100000:1.0:1783444469.023257:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1783444469.023262:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575367296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023268:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575367040:12345-0@lo:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.023274:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:2.0:1783444469.023285:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:2.0:1783444469.023291:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575367552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.023303:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1870073575367296:12345-0@lo:400:kworker.0 Request processed in 42us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444469.023309:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1783444469.023314:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575367552:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.023319:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:1.0:1783444469.023320:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1783444469.023325:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575367168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023348:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:2.0:1783444469.023355:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575367680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444469.023363:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575367168:12345-0@lo:400:kworker.0 Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444469.023373:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1783444469.023386:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575367680:12345-0@lo:400:kworker.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.023392:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:2.0:1783444469.023418:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575366656:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023428:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575367168:0@lo:400:kworker.0 00000100:00080000:1.0:1783444469.023429:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444469.023432:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444469.023435:0:3635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 2 00000100:00100000:2.0:1783444469.023448:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575367680:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023457:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575366528:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023464:0:3635:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:2.0:1783444469.023469:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:2.0:1783444469.023483:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000020:00080000:2.0:1783444469.023488:0:3635:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9367c75dd300 refcount 2 committed 0 result 0 batchid 73014444090 00000020:00080000:2.0:1783444469.023492:0:3635:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9368f9ce1200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9367c75dde40 00000020:00080000:2.0:1783444469.023495:0:3635:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].2 00000020:00080000:2.0:1783444469.023498:0:3635:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9368f9ce1000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9367c58dc800 00000020:00080000:2.0:1783444469.023500:0:3635:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].2 00000100:00100000:2.0:1783444469.023524:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575367040:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023535:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575367552:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023557:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575368064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444469.023581:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.023606:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575368064 00000100:00100000:2.0:1783444469.023609:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575368064 00000100:00100000:2.0:1783444469.023628:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:2.0:1783444469.023640:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575368064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444469.023666:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444798464 avail 1298558976 00000100:00100000:2.0:1783444469.023700:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575368064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.023707:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:2.0:1783444469.023737:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783444469.023742:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444090 committed batchid 73014444089 00000100:00100000:2.0:1783444469.023762:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575366912:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023771:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575367424:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023778:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575367936:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023814:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575366784:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023823:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575367296:0@lo:400:kworker.0 00000020:00080000:1.0:1783444469.023828:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444089 00000100:00100000:2.0:1783444469.023838:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575367808 00000100:00100000:2.0:1783444469.023841:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575367808 00000100:00100000:2.0:1783444469.023870:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:2.0:1783444469.023876:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575367808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.023911:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575367808:12345-0@lo:400:kworker.0 Request processed in 35us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.023917:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00100000:2.0:1783444469.023945:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575368064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444469.023964:0:3634:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969456 gen 2 00000100:00100000:2.0:1783444469.023973:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575367808:0@lo:400:kworker.0 00000100:00100000:2.0:1783444469.024375:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575368192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444469.024400:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.024435:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575368192 00000100:00100000:2.0:1783444469.024438:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575368192 00000100:00100000:2.0:1783444469.024459:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:2.0:1783444469.024464:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575368192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444469.024480:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445027840 avail 1298788352 00000100:00100000:2.0:1783444469.024507:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575368192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.024513:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:2.0:1783444469.024538:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575368192:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1783444469.027475:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444469.534148:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444469.534175:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575368320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444469.534252:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.534306:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575368320 00000100:00100000:2.0:1783444469.534314:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575368320 00000100:00100000:2.0:1783444469.534378:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1783444469.534388:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575368320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444469.534419:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444469.534465:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575368320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444469.534473:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1783444469.534522:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575368320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444469.538368:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444469.538391:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575368448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444469.538457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444469.538502:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575368448 00000100:00100000:1.0:1783444469.538509:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575368448 00000100:00100000:1.0:1783444469.538550:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:1.0:1783444469.538558:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575368448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444469.538585:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444469.538623:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575368448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444469.538630:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:1.0:1783444469.538673:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575368448:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783444469.792574:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783444469.943350:0:93070:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fffe3004fe0 20000000:00000080:2.0:1783444469.943368:0:93070:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9367c7553000 uarg=0000000000000000 00000040:00100000:2.0:1783444469.944603:0:93070:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:2.0:1783444469.944613:0:93070:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:2.0:1783444469.945095:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:2.0:1783444469.945118:0:93070:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:2.0:1783444469.945146:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:2.0:1783444469.945161:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:2.0:1783444469.945220:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:2.0:1783444469.945228:0:93070:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:2.0:1783444469.945240:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:2.0:1783444469.945384:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:2.0:1783444469.947274:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:2.0:1783444469.947300:0:93070:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:2.0:1783444469.947331:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:2.0:1783444469.947484:0:93070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:2.0:1783444469.947505:0:93070:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783444469.947526:0:93070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947546:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947556:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 23 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947563:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947571:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947578:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947584:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 23 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947601:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947608:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 23 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947614:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 23 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947624:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 9 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947631:0:93070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 9 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947639:0:93070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947680:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 9 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.947963:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 9 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.947979:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575368576:192.168.204.20@tcp:104: 00010000:00010000:2.0:1783444469.948087:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 9 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.948095:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 9 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.948109:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575368704:192.168.204.20@tcp:104: 00010000:00010000:2.0:1783444469.948143:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 23 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.948151:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 23 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.948159:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575368832:0@lo:104: 00000100:00100000:2.0:1783444469.948192:0:93070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783444469.948220:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 23 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.948228:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 23 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.948236:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575368960:0@lo:104: 00000100:00100000:3.0:1783444469.948258:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575368832 00000100:00100000:2.0:1783444469.948261:0:93070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.948266:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575368832 00010000:00010000:2.0:1783444469.948289:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.948298:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 23 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.948304:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369088:0@lo:104: 00000100:00100000:3.0:1783444469.948322:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1783444469.948327:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 23 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.948335:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 23 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.948339:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.948347:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575368960 00000100:00100000:2.0:1783444469.948349:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369216:0@lo:104: 00000100:00100000:3.0:1783444469.948350:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575368960 00000100:00100000:3.0:1783444469.948362:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575369088 00000100:00100000:3.0:1783444469.948365:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575369088 00000100:00100000:2.0:1783444469.948369:0:93070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.948373:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575369216 00000100:00100000:3.0:1783444469.948375:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575369216 00010000:00010000:2.0:1783444469.948385:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.948389:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00010000:00010000:2.0:1783444469.948393:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 23 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.948396:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:93070:x1870073575368832:12345-0@lo:104: 00010000:00010000:3.0:1783444469.948408:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.948413:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369344:0@lo:104: 00000100:00100000:2.0:1783444469.948432:0:93070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783444469.948449:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.948457:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 23 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.948460:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783444469.948465:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369472:0@lo:104: 00000100:00100000:3.0:1783444469.948466:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:93070:x1870073575368832:12345-0@lo:104: Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.948473:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1783444469.948483:0:93070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.948489:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575369344 00000100:00100000:3.0:1783444469.948492:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575369344 00010000:00010000:2.0:1783444469.948497:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.948502:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575369472 00000100:00100000:3.0:1783444469.948504:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575369472 00010000:00010000:2.0:1783444469.948505:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 23 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.948513:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783444469.948513:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369600:0@lo:104: 00000100:00100000:3.0:1783444469.948517:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936901ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:93070:x1870073575368960:12345-0@lo:104: 00010000:00010000:3.0:1783444469.948524:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.948544:0:93070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444469.948559:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1783444469.948561:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 23 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.948570:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936901ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:93070:x1870073575368960:12345-0@lo:104: Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.948576:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:2.0:1783444469.948578:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 23 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.948586:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369728:0@lo:104: 00000100:00100000:2.0:1783444469.948608:0:93070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.948611:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575369600 00000100:00100000:3.0:1783444469.948614:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575369600 00000100:00100000:3.0:1783444469.948624:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575369728 00010000:00010000:2.0:1783444469.948624:0:93070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.948626:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575369728 00010000:00010000:2.0:1783444469.948633:0:93070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 23 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.948640:0:93070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369856:0@lo:104: 00000100:00100000:2.0:1783444469.948660:0:93070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444469.948671:0:93070:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e721d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444469.948828:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783444469.948838:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575369856 00000100:00100000:1.0:1783444469.948841:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575369856 00010000:00010000:0.0:1783444469.948841:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444469.948848:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.948855:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70000 already unused, calling callback (ffffffffc122fc20) 00000100:00100000:1.0:1783444469.948859:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 10000000:00010000:0.0:1783444469.948859:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.948865:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:93070:x1870073575369088:12345-0@lo:104: 00010000:00010000:0.0:1783444469.948868:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.948872:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444469.948875:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444469.948892:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444469.948909:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783444469.948918:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:93070:x1870073575369088:12345-0@lo:104: Request processed in 54us (579us total) trans 0 rc 0/0 00010000:00010000:0.0:1783444469.948920:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.948925:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:0.0:1783444469.948926:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783444469.948937:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783444469.948942:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:93070:x1870073575369216:12345-0@lo:104: 00010000:00010000:0.0:1783444469.948945:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.948949:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.948951:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70000/0x42cb6883e3832e68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.948965:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444469.948968:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.948973:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444469.948976:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.948981:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1783444469.948983:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.948985:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:93070:x1870073575369216:12345-0@lo:104: Request processed in 43us (616us total) trans 0 rc 0/0 10000000:00010000:0.0:1783444469.948990:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.948991:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 10000000:01000000:0.0:1783444469.948996:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783444469.949001:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1783444469.949007:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:93070:x1870073575369344:12345-0@lo:104: 00010000:00010000:0.0:1783444469.949008:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.949013:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949013:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444469.949037:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949045:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4750000/0x42cb6883e3832e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e45 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.949050:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1783444469.949054:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1783444469.949055:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:93070:x1870073575369344:12345-0@lo:104: Request processed in 48us (622us total) trans 0 rc 0/0 00010000:00010000:0.0:1783444469.949057:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.949060:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00010000:0.0:1783444469.949063:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444469.949066:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.949071:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00010000:00010000:0.0:1783444469.949073:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.949076:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+6:93070:x1870073575369472:12345-0@lo:104: 10000000:00010000:0.0:1783444469.949080:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.949083:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444469.949085:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444469.949097:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949103:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444469.949105:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783444469.949115:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+6:93070:x1870073575369472:12345-0@lo:104: Request processed in 39us (631us total) trans 0 rc 0/0 00010000:00010000:0.0:1783444469.949117:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.949120:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:0.0:1783444469.949123:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4751e00/0x42cb6883e3832e30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e37 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949131:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1783444469.949132:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1783444469.949137:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+5:93070:x1870073575369600:12345-0@lo:104: 00010000:00010000:0.0:1783444469.949139:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.949144:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949144:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444469.949148:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949154:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444469.949160:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444469.949165:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444469.949169:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783444469.949173:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+5:93070:x1870073575369600:12345-0@lo:104: Request processed in 37us (629us total) trans 0 rc 0/0 00010000:00010000:0.0:1783444469.949177:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.949178:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:0.0:1783444469.949183:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783444469.949188:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00010000:00010000:0.0:1783444469.949188:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.949193:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+4:93070:x1870073575369728:12345-0@lo:104: 00010000:00010000:0.0:1783444469.949195:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70c00/0x42cb6883e3832e14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e1b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.949199:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949202:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444469.949205:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949211:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444469.949214:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.949220:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783444469.949225:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+4:93070:x1870073575369728:12345-0@lo:104: Request processed in 32us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444469.949230:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:0.0:1783444469.949230:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444469.949237:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.949240:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 10000000:01000000:0.0:1783444469.949243:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783444469.949244:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:93070:x1870073575369856:12345-0@lo:104: 00010000:00010000:1.0:1783444469.949250:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949254:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949259:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444469.949264:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949270:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4750600/0x42cb6883e3832e06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832e0d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.949271:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1783444469.949278:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1783444469.949280:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:93070:x1870073575369856:12345-0@lo:104: Request processed in 36us (620us total) trans 0 rc 0/0 00010000:00010000:0.0:1783444469.949281:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.949286:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00010000:00010000:0.0:1783444469.949287:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444469.949290:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949296:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444469.949301:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444469.949310:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444469.949323:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949328:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444469.949333:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949340:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4751600/0x42cb6883e3832ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832de3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949348:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444469.949351:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949355:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368e6f05e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444469.949358:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949363:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444469.949369:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444469.949373:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444469.949385:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949390:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444469.949401:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949407:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368e6f05e00/0x42cb6883e3832dc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832dc7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949416:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444469.949418:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949424:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444469.949427:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949433:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444469.949439:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444469.949445:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783444469.949453:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444469.949457:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.949458:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949463:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444469.949465:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444469.949468:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949468:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444469.949474:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4750200/0x42cb6883e3832d8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832d96 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.949476:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444469.949482:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444469.949488:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444469.949492:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444469.949494:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444469.949496:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444469.949501:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.949506:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444469.949508:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444469.949511:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.949516:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4750800/0x42cb6883e3832ca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3832caf expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444469.949517:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575369984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.949539:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444469.949541:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444469.949542:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444469.949547:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.949572:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575369984 00000100:00100000:0.0:1783444469.949573:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575370496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.949576:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575369984 00000100:00100000:0.0:1783444469.949592:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444469.949593:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 24 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444469.949605:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575371008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.949613:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575370496 00000100:00100000:3.0:1783444469.949616:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575370496 00000100:00100000:0.0:1783444469.949623:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444469.949626:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 25 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.949641:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575371008 00000100:00100000:0.0:1783444469.949642:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783444469.949643:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575371008 00000100:00100000:0.0:1783444469.949647:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575370112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.949652:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 26 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444469.949667:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.949669:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1783444469.949674:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+26:3635:x1870073575369984:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444469.949680:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575370624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.949683:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.949688:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 26 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.949697:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 26 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444469.949711:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444469.949712:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.949735:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+26:3635:x1870073575369984:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444469.949738:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575369984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.949746:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1783444469.949757:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575370112 00000100:00100000:3.0:1783444469.949760:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575370112 00010000:00010000:0.0:1783444469.949765:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444469.949771:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 26 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444469.949772:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575370240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.949781:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575370624 00000100:00100000:3.0:1783444469.949784:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575370624 00010000:00010000:3.0:1783444469.949810:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 27 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444469.949812:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.949820:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575370240 00000100:00100000:0.0:1783444469.949822:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575370752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.949823:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575370240 00010000:00010000:3.0:1783444469.949832:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 28 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444469.949842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.949843:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:3.0:1783444469.949848:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+28:3635:x1870073575370496:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444469.949852:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:3.0:1783444469.949855:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783444469.949857:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575370368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.949859:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 28 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.949866:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 28 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.949876:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444469.949883:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444469.949893:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575370880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.949898:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+28:3635:x1870073575370496:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.949903:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1783444469.949910:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444469.949919:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575370752 00000100:00100000:3.0:1783444469.949922:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575370752 00010000:00010000:3.0:1783444469.949932:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 28 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.949943:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575370368 00000100:00100000:3.0:1783444469.949945:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575370368 00010000:00010000:3.0:1783444469.949954:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 29 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.949964:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575370880 00000100:00100000:3.0:1783444469.949965:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575370880 00010000:00010000:3.0:1783444469.949973:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 30 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.949982:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:3.0:1783444469.949987:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+30:3635:x1870073575371008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.949995:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.949998:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 30 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950007:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 30 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950017:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.950054:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+30:3635:x1870073575371008:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.950060:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:3.0:1783444469.950072:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1783444469.950078:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+29:3635:x1870073575370112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.950094:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.950098:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 29 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950106:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 29 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950115:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.950136:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+29:3635:x1870073575370112:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.950142:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1783444469.950155:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1783444469.950161:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+28:3635:x1870073575370624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.950168:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.950172:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 28 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950180:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 28 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950189:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.950208:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+28:3635:x1870073575370624:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.950213:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1783444469.950224:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1783444469.950229:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+27:3633:x1870073575370240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.950236:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.950240:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 27 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950254:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 27 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950265:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.950301:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+27:3633:x1870073575370240:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.950306:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1783444469.950319:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1783444469.950324:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d34f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+26:3633:x1870073575370752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.950333:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.950336:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 26 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950344:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 26 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950351:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.950369:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d34f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+26:3633:x1870073575370752:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.950374:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1783444469.950403:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1783444469.950409:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3633:x1870073575370368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.950416:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.950420:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 25 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950428:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 25 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950443:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.950465:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3633:x1870073575370368:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.950471:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1783444469.950483:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1783444469.950488:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575370880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.950496:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.950499:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 24 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950507:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 24 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.950515:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.950534:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575370880:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.950539:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1783444469.950583:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575370112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.950591:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575370624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.950598:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575370496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444469.950605:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575371008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444469.950940:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751000/0x42cb6883e3832e6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832e68 expref: 23 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.950953:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575368832:0@lo:104: 00010000:00010000:2.0:1783444469.950969:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70600/0x42cb6883e3832e45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832e3e expref: 22 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.950977:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575368960:0@lo:104: 00010000:00010000:2.0:1783444469.950986:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05c00/0x42cb6883e3832e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832e30 expref: 21 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.950994:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369088:0@lo:104: 00010000:00010000:2.0:1783444469.951003:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70e00/0x42cb6883e3832e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832e14 expref: 20 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.951020:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7268380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369216:0@lo:104: 00010000:00010000:2.0:1783444469.951044:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04400/0x42cb6883e3832e0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832e06 expref: 19 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.951053:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369344:0@lo:104: 00010000:00010000:2.0:1783444469.951060:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751800/0x42cb6883e3832de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832ddc expref: 18 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.951067:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369472:0@lo:104: 00010000:00010000:2.0:1783444469.951074:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05a00/0x42cb6883e3832dc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832dc0 expref: 17 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.951081:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369600:0@lo:104: 00010000:00010000:2.0:1783444469.951089:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751c00/0x42cb6883e3832d96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832d8f expref: 16 pid: 92444 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.951097:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369728:0@lo:104: 00010000:00010000:2.0:1783444469.951105:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04e00/0x42cb6883e3832caf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3832ca8 expref: 15 pid: 92445 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.951113:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575369856:0@lo:104: 00000100:00100000:0.0:1783444469.951186:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575370368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444469.951194:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575370880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444469.951200:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575370240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444469.951206:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccc59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575370752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444469.960926:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444469.961012:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444469.961168:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557822720 00000100:00100000:1.0:1783444469.961177:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557822720 00000100:00100000:2.0:1783444469.961211:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575368576:192.168.204.20@tcp:104: 00010000:00010000:1.0:1783444469.961214:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 10 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444469.961230:0:93070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93070:1870073575368704:192.168.204.20@tcp:104: 00000100:00100000:1.0:1783444469.961241:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557822848 00000100:00100000:1.0:1783444469.961244:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557822848 00010000:00010000:1.0:1783444469.961253:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 11 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444469.961270:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2565 00000100:00100000:1.0:1783444469.961277:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:28921b6e-3bc9-4a81-ae87-1992169ba754+11:2404:x1870073557822720:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783444469.961285:0:93070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.961290:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444469.961295:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 11 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.961307:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 11 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444469.961394:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2566 00000100:00100000:3.0:1783444469.961405:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28921b6e-3bc9-4a81-ae87-1992169ba754+11:2403:x1870073557822848:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783444469.961414:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444469.961437:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 11 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.977947:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c10600/0x42cb6883e3832e8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce8 expref: 11 pid: 92443 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444469.977976:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444469.978090:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557822720:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 16809us (17169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444469.978100:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2565 00010000:00010000:3.0:1783444469.981254:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 9 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981285:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c11600/0x42cb6883e3832e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cda expref: 9 pid: 92448 timeout: 3560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981302:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981310:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981331:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981339:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981345:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981352:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981358:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444469.981362:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981370:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981409:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444469.981421:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444469.981489:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28921b6e-3bc9-4a81-ae87-1992169ba754+8:2403:x1870073557822848:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 20085us (20474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444469.981500:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2566 00010000:00010000:2.0:1783444469.982692:0:93070:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.982704:0:93070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444469.982710:0:93070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444470.558126:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444470.558156:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575371136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444470.558237:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444470.558383:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575371136 00000100:00100000:0.0:1783444470.558392:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575371136 00000100:00100000:0.0:1783444470.558449:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:0.0:1783444470.558459:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575371136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444470.558482:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444470.558529:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1870073575371136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444470.558536:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1783444470.558627:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575371136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444470.559046:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575371264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444470.559075:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444470.559154:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575371264 00000100:00100000:1.0:1783444470.559159:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575371264 00000100:00100000:1.0:1783444470.559193:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1783444470.559201:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575371264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444470.559214:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444470.559263:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575371264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444470.559270:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:2.0:1783444470.559344:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575371264:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783444470.813366:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444470.865700:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444470.865746:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444470.865781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444470.865825:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557823104 00000100:00100000:2.0:1783444470.865835:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557823104 00000100:00100000:0.0:1783444470.865859:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444470.865893:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557823232 00000100:00100000:2.0:1783444470.865896:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557823232 00000100:00100000:0.0:1783444470.865899:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1088 00000100:00100000:0.0:1783444470.865908:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2403:x1870073557823104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444470.865917:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1089 00000100:00100000:2.0:1783444470.865923:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557823232:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444470.865982:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2403:x1870073557823104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444470.865991:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1088 00000100:00100000:3.0:1783444470.866005:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557822976 00000100:00100000:3.0:1783444470.866018:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557822976 00000100:00100000:3.0:1783444470.866048:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:3.0:1783444470.866054:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ebe2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+8:2403:x1870073557822976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444470.866148:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557823360 00000100:00100000:1.0:1783444470.866152:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557823360 00000100:00100000:1.0:1783444470.866184:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2494 00000100:00100000:1.0:1783444470.866192:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557823360:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444470.868943:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557823232:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 3007us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444470.868960:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1089 00000100:00080000:2.0:1783444470.869086:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444470.869092:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444470.869095:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444470.871463:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ebe2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+8:2403:x1870073557822976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 5395us (5668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444470.871480:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:1.0:1783444470.875041:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557823360:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 8837us (9281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444470.875056:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2494 00000001:00080000:1.0:1783444471.079314:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969457 is committed 00000100:00100000:1.0:1783444471.309615:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444471.309721:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557823488 00000100:00100000:2.0:1783444471.309731:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557823488 00000100:00100000:2.0:1783444471.309824:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:2.0:1783444471.309834:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ebe2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557823488:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444471.309852:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444471.309887:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d35 expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.309924:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 9 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.309936:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 9 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.309946:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030200, rc 0) 00000100:00100000:2.0:1783444471.310195:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ebe2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557823488:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 361us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444471.310203:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:0.0:1783444471.320948:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444471.325041:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557823616 00000100:00100000:2.0:1783444471.325062:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557823616 00000100:00100000:2.0:1783444471.325158:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:2.0:1783444471.325169:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557823616:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444471.325382:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557823616:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 214us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444471.325391:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:0.0:1783444471.330053:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444471.330174:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557823744 00000100:00100000:1.0:1783444471.330185:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557823744 00000100:00100000:1.0:1783444471.330253:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1783444471.330266:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557823744:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444471.330443:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557823744:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 178us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444471.330452:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:0.0:1783444471.336942:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444471.337065:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557823872 00000100:00100000:2.0:1783444471.337077:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557823872 00000100:00100000:2.0:1783444471.337134:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:2.0:1783444471.337145:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:71921:x1870073557823872:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783444471.337327:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:71921:x1870073557823872:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 183us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444471.337335:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:0.0:1783444471.354082:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444471.354216:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557824000 00000100:00100000:1.0:1783444471.354231:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557824000 00000100:00100000:1.0:1783444471.358812:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:1.0:1783444471.358842:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:71921:x1870073557824000:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783444471.359322:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:71921:x1870073557824000:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 493us (5331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444471.359332:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:0.0:1783444471.364908:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444471.365541:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557824128 00000100:00100000:2.0:1783444471.365553:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557824128 00000100:00100000:2.0:1783444471.365612:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:2.0:1783444471.365622:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557824128:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444471.365640:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444471.365660:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d3c expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.365702:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 10 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.365715:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 10 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.365725:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031000, rc 0) 00000100:00100000:2.0:1783444471.365818:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557824128:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 197us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444471.365825:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:0.0:1783444471.374133:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444471.374304:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557824256 00000100:00100000:2.0:1783444471.374316:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557824256 00000100:00100000:2.0:1783444471.374378:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:2.0:1783444471.374388:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557824256:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444471.374518:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557824256:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 131us (395us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783444471.374526:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00010000:00010000:0.0:1783444471.839116:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783444471.967377:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444471.967388:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff936901f97800 from 52 10000000:01000000:0.0:1783444471.967394:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444471.967448:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444471.967461:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444471.967473:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444471.967505:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575371392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444471.967581:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444471.967636:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9a81300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444471.967714:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575371392 00000100:00100000:2.0:1783444471.967722:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575371392 00000100:00100000:2.0:1783444471.967843:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783444471.967853:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575371392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444471.967867:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444471.967885:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38331b7 expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.967908:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 16 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.967919:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 16 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.967927:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031a00, rc 0) 00000100:00100000:2.0:1783444471.967973:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575371392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444471.967979:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783444471.968206:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575371392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444471.968228:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444471.968237:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444471.968303:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575371520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444471.968330:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444471.968362:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9a81300 going to sleep for 11 seconds 00000100:00100000:1.0:1783444471.968410:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575371520 00000100:00100000:1.0:1783444471.968415:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575371520 00000100:00100000:1.0:1783444471.968450:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783444471.968457:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575371520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444471.968583:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575371520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444471.968591:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783444471.968828:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575371520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444471.968857:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575371648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444471.968899:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444471.968928:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9a81300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444471.968979:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575371648 00000100:00100000:3.0:1783444471.968983:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575371648 00000100:00100000:3.0:1783444471.969029:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783444471.969037:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575371648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444471.969131:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575371648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444471.969149:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783444471.969302:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575371648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444471.969602:0:93071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93071:1870073575371776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444471.969642:0:93071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444471.969663:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575371776 00000100:00100000:1.0:1783444471.969668:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575371776 00000100:00100000:1.0:1783444471.969690:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783444471.969696:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:93071:x1870073575371776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444471.969806:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:93071:x1870073575371776:12345-0@lo:502:llog_process_th.0 Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444471.969813:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783444471.969846:0:93071:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef0ae6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444471.969860:0:93071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93071:1870073575371776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444471.969904:0:93071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93071:1870073575371904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444471.969937:0:93071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444471.969953:0:93071:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef0ae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444471.970065:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575371904 00000100:00100000:3.0:1783444471.970070:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575371904 00000100:00100000:3.0:1783444471.970101:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783444471.970107:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:93071:x1870073575371904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444471.970188:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:93071:x1870073575371904:12345-0@lo:502:llog_process_th.0 Request processed in 80us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444471.970194:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783444471.975203:0:93071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93071:1870073575371904:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444471.975264:0:93071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1783444471.975446:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1783444471.975477:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444471.975490:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.975501:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444471.975512:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783444471.975514:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:2.0:1783444471.975516:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783444471.975554:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.975576:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.975585:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444471.975606:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444471.975685:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444471.975726:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444471.975730:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575372032 00000100:00100000:3.0:1783444471.975737:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575372032 00000100:00100000:3.0:1783444471.975816:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783444471.975826:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575372032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444471.975839:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444471.975851:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38331c5 expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444471.975874:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 17 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444471.975883:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 17 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444471.975891:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513be00, rc 0) 00000100:00100000:3.0:1783444471.975938:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575372032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444471.975945:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783444471.976034:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444471.976047:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444471.976056:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444471.976109:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444471.976151:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444471.976176:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444471.976685:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575372160 00000100:00100000:0.0:1783444471.976695:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575372160 00000100:00100000:0.0:1783444471.976732:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783444471.976739:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575372160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444471.976880:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575372160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444471.976887:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783444471.977109:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444471.977154:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444471.977198:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444471.977222:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444471.980458:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575372288 00000100:00100000:3.0:1783444471.980474:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575372288 00000100:00100000:3.0:1783444471.980542:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783444471.980552:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c326dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575372288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444471.980747:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c326dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575372288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444471.980755:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783444471.980777:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444471.981637:0:93072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93072:1870073575372416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444471.981704:0:93072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444471.981753:0:93072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c67b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444471.981921:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575372416 00000100:00100000:3.0:1783444471.981927:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575372416 00000100:00100000:3.0:1783444471.981967:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783444471.981974:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690064fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93072:x1870073575372416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444471.982095:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690064fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93072:x1870073575372416:12345-0@lo:502:llog_process_th.0 Request processed in 120us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444471.982102:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783444471.982207:0:93072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93072:1870073575372416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444471.982233:0:93072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444471.982249:0:93072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444471.982252:0:93072:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:0.0:1783444471.982258:0:93072:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1783444471.982322:0:93072:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:0.0:1783444471.983052:0:93072:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:0.0:1783444471.993592:0:93072:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:10000000:0.0:1783444471.997376:0:93072:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000100:00100000:0.0:1783444472.000691:0:93072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93072:1870073575372544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.004022:0:93072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.004119:0:93072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177540 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.009290:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575372544 00000100:00100000:3.0:1783444472.009340:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575372544 00000100:00100000:3.0:1783444472.009403:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783444472.009414:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690064c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93072:x1870073575372544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444472.009595:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690064c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93072:x1870073575372544:12345-0@lo:502:llog_process_th.0 Request processed in 183us (5580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.009602:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783444472.009757:0:93072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93072:1870073575372544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.009843:0:93072:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93072:1870073575372672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.009889:0:93072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.009921:0:93072:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3203000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.010310:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575372672 00000100:00100000:3.0:1783444472.010316:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575372672 00000100:00100000:3.0:1783444472.010354:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783444472.010363:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690067a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93072:x1870073575372672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444472.010453:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690067a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93072:x1870073575372672:12345-0@lo:502:llog_process_th.0 Request processed in 91us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.010460:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783444472.010577:0:93072:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93072:1870073575372672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444472.010601:0:93072:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444472.010608:0:93072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444472.010611:0:93072:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:0.0:1783444472.010616:0:93072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:3.0:1783444472.010995:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:3.0:1783444472.011021:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783444472.011037:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.011049:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444472.011116:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444472.011120:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 52 10000000:01000000:3.0:1783444472.011123:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444472.011150:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.011160:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.011168:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444472.011183:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3efb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.011859:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444472.011895:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab03a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.012280:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575372800 00000100:00100000:0.0:1783444472.012288:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575372800 00000100:00100000:0.0:1783444472.012334:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783444472.012343:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575372800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.012358:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444472.012372:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38331d3 expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.012396:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 18 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.012418:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 18 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.012427:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91400, rc 0) 00000100:00100000:0.0:1783444472.012468:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575372800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.012475:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783444472.012520:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3efb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.012533:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.012556:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444472.012622:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.012649:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.012664:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3203e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.012676:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575372928 00000100:00100000:0.0:1783444472.012679:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575372928 00000100:00100000:0.0:1783444472.012702:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783444472.012708:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575372928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.013085:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575372928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.013092:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783444472.013568:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575372928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.013608:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575373056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.013652:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444472.013687:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.014016:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575373056 00000100:00100000:0.0:1783444472.014022:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575373056 00000100:00100000:0.0:1783444472.014070:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783444472.014078:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575373056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.014173:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575373056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.014181:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783444472.016129:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575373056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444472.017933:0:93074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93074:1870073575373184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444472.018028:0:93074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.018121:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575373184 00000100:00100000:0.0:1783444472.018129:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575373184 00000100:00100000:2.0:1783444472.018137:0:93074:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.018181:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783444472.018189:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:93074:x1870073575373184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.018332:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:93074:x1870073575373184:12345-0@lo:502:llog_process_th.0 Request processed in 142us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.018339:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783444472.020063:0:93074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93074:1870073575373184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444472.020148:0:93074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93074:1870073575373312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444472.020212:0:93074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444472.020255:0:93074:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.020289:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575373312 00000100:00100000:0.0:1783444472.020296:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575373312 00000100:00100000:0.0:1783444472.020360:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783444472.020370:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:93074:x1870073575373312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.020491:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:93074:x1870073575373312:12345-0@lo:502:llog_process_th.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.020498:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783444472.021015:0:93074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93074:1870073575373312:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783444472.021041:0:93074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1783444472.025920:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1783444472.025962:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444472.025975:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.026194:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444472.026206:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783444472.026208:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1783444472.026211:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444472.026249:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.026259:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.026270:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444472.026295:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575373440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.026479:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444472.026520:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab03d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.027933:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575373440 00000100:00100000:0.0:1783444472.027948:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575373440 00000100:00100000:0.0:1783444472.028253:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783444472.028264:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575373440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.028282:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444472.028298:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38331e1 expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.028412:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 19 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.028425:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 19 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.028433:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91a00, rc 0) 00000100:00100000:0.0:1783444472.028510:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575373440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.028518:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783444472.028618:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575373440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444472.028638:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444472.028650:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444472.029282:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575373568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444472.029330:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444472.030842:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.031056:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575373568 00000100:00100000:0.0:1783444472.031066:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575373568 00000100:00100000:0.0:1783444472.031122:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783444472.031132:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575373568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.031290:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575373568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.031298:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783444472.031435:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575373568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.031489:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3efb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575373696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.031541:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444472.031566:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab03d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.031619:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575373696 00000100:00100000:0.0:1783444472.031624:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575373696 00000100:00100000:0.0:1783444472.031656:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783444472.031663:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575373696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.031750:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575373696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.031756:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783444472.031934:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3efb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575373696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444472.032420:0:93076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93076:1870073575373824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444472.032459:0:93076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444472.032495:0:93076:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.032541:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575373824 00000100:00100000:3.0:1783444472.032546:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575373824 00000100:00100000:3.0:1783444472.032580:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783444472.032586:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93076:x1870073575373824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444472.035445:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93076:x1870073575373824:12345-0@lo:502:llog_process_th.0 Request processed in 2849us (2976us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.035467:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783444472.037560:0:93076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93076:1870073575373824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444472.037613:0:93076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444472.037626:0:93076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444472.037849:0:93076:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:2.0:1783444472.037857:0:93076:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1783444472.037910:0:93076:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1783444472.037946:0:93076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93076:1870073575373952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444472.038054:0:93076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444472.038141:0:93076:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.038236:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575373952 00000100:00100000:0.0:1783444472.038243:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575373952 00000100:00100000:0.0:1783444472.038293:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783444472.038301:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93076:x1870073575373952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.038456:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93076:x1870073575373952:12345-0@lo:502:llog_process_th.0 Request processed in 155us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.038464:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783444472.038525:0:93076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93076:1870073575373952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444472.038558:0:93076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93076:1870073575374080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444472.038589:0:93076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444472.038657:0:93076:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.038851:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575374080 00000100:00100000:0.0:1783444472.038856:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575374080 00000100:00100000:0.0:1783444472.038880:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783444472.038886:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93076:x1870073575374080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.039001:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93076:x1870073575374080:12345-0@lo:502:llog_process_th.0 Request processed in 113us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.039008:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783444472.039060:0:93076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93076:1870073575374080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444472.039080:0:93076:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444472.039085:0:93076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444472.039086:0:93076:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:2.0:1783444472.039090:0:93076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:3.0:1783444472.039482:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:3.0:1783444472.039505:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783444472.039517:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.039529:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444472.039540:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444472.039543:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 52 10000000:01000000:3.0:1783444472.039546:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444472.039577:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.039585:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.039596:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444472.039611:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3efb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.039653:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444472.039728:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab03a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.042130:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575374208 00000100:00100000:0.0:1783444472.042146:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575374208 00000100:00100000:0.0:1783444472.042215:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783444472.042225:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575374208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.042244:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444472.042261:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38331ef expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.042289:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38331ef expref: 20 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.042300:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331ef expref: 20 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.042308:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91c00, rc 0) 00000100:00100000:0.0:1783444472.042385:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575374208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.042404:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783444472.042466:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3efb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.042483:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.042492:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444472.042569:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.042603:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.042631:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.042760:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575374336 00000100:00100000:3.0:1783444472.042765:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575374336 00000100:00100000:3.0:1783444472.042819:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783444472.042827:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575374336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.042953:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575374336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.042968:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783444472.043203:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.043234:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.043273:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.043291:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.043305:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575374464 00000100:00100000:0.0:1783444472.043309:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575374464 00000100:00100000:0.0:1783444472.043331:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783444472.043337:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575374464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.043414:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575374464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.043420:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783444472.043457:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.043626:0:93077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93077:1870073575374592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.043736:0:93077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.043749:0:93077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177540 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.043813:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575374592 00000100:00100000:3.0:1783444472.043817:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575374592 00000100:00100000:3.0:1783444472.043843:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783444472.043849:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:93077:x1870073575374592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444472.043933:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:93077:x1870073575374592:12345-0@lo:502:llog_process_th.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.043940:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783444472.044045:0:93077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93077:1870073575374592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.044080:0:93077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93077:1870073575374720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.044247:0:93077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.044275:0:93077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c565a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.044316:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575374720 00000100:00100000:3.0:1783444472.044320:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575374720 00000100:00100000:3.0:1783444472.044351:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783444472.044357:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:93077:x1870073575374720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444472.044425:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:93077:x1870073575374720:12345-0@lo:502:llog_process_th.0 Request processed in 67us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.044432:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783444472.044510:0:93077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93077:1870073575374720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783444472.044531:0:93077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1783444472.044736:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1783444472.044757:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444472.044766:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.044777:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444472.044807:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783444472.044810:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783444472.044813:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444472.044839:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.044853:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.044861:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444472.044875:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.044901:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444472.044915:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4db7300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.044926:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575374848 00000100:00100000:3.0:1783444472.044929:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575374848 00000100:00100000:3.0:1783444472.044952:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783444472.044958:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575374848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444472.044967:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444472.044979:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38331fd expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.045021:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38331fd expref: 21 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.045031:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331fd expref: 21 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.045040:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513bc00, rc 0) 00000100:00100000:3.0:1783444472.045070:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575374848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.045076:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783444472.045220:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444472.045234:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444472.045243:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444472.045289:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.045315:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444472.045328:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4db7300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.045339:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575374976 00000100:00100000:3.0:1783444472.045343:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575374976 00000100:00100000:3.0:1783444472.045365:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783444472.045371:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575374976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.045471:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575374976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.045477:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783444472.045505:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575374976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.045531:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.045568:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444472.045581:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4db7300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444472.045591:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575375104 00000100:00100000:3.0:1783444472.045595:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575375104 00000100:00100000:3.0:1783444472.045615:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783444472.045622:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575375104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444472.045779:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575375104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444472.045814:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783444472.045856:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444472.047456:0:93078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1783444472.047754:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1783444472.047780:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783444472.047814:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.047827:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444472.047837:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783444472.047840:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 52 10000000:01000000:1.0:1783444472.047843:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783444472.047880:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.047888:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.047898:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444472.047922:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444472.047981:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444472.048219:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef0ae780 going to sleep for 11 seconds 00000100:00100000:1.0:1783444472.048250:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575375232 00000100:00100000:1.0:1783444472.048257:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575375232 00000100:00100000:1.0:1783444472.048347:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783444472.048357:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575375232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444472.048371:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444472.048383:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383320b expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.048408:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383320b expref: 22 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.048418:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383320b expref: 22 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.048426:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27e00, rc 0) 00000100:00100000:1.0:1783444472.048464:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575375232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444472.048471:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783444472.052892:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.052921:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.052935:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444472.053043:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.053104:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.053156:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c565a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444472.053354:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575375360 00000100:00100000:2.0:1783444472.053361:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575375360 00000100:00100000:2.0:1783444472.053402:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783444472.053411:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575375360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444472.053555:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575375360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444472.053563:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783444472.054103:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.054151:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.054197:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.054226:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c565a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.054241:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575375488 00000100:00100000:0.0:1783444472.054245:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575375488 00000100:00100000:0.0:1783444472.054275:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783444472.054289:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575375488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.054370:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575375488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.054377:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783444472.054415:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.054598:0:93080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93080:1870073575375616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.054650:0:93080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.054667:0:93080:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c565a000 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.056874:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575375616 00000100:00100000:0.0:1783444472.056885:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575375616 00000100:00100000:0.0:1783444472.056939:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783444472.056948:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:93080:x1870073575375616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.057255:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:93080:x1870073575375616:12345-0@lo:502:llog_process_th.0 Request processed in 306us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.057264:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783444472.057330:0:93080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93080:1870073575375616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.057396:0:93080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93080:1870073575375744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.057443:0:93080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.057471:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575375744 00000100:00100000:0.0:1783444472.057475:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575375744 00000100:00100000:0.0:1783444472.057501:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783444472.057507:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:93080:x1870073575375744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444472.057565:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:93080:x1870073575375744:12345-0@lo:502:llog_process_th.0 Request processed in 57us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.057580:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783444472.057614:0:93080:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.057626:0:93080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93080:1870073575375744:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783444472.058842:0:93080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1783444472.058924:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1783444472.058946:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444472.058957:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.058969:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444472.058979:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783444472.058982:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783444472.058998:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444472.059029:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.059037:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.059046:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444472.059065:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.059230:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.059266:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.059286:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575375872 00000100:00100000:0.0:1783444472.059306:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575375872 00000100:00100000:0.0:1783444472.059348:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783444472.059356:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575375872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.059369:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444472.059380:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833219 expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.059404:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833219 expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.059413:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833219 expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.059422:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91e00, rc 0) 00000100:00100000:0.0:1783444472.059458:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575375872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.059465:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783444472.059503:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575375872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.059516:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.059526:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444472.059574:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575376000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.059597:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.059609:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.059619:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575376000 00000100:00100000:0.0:1783444472.059628:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575376000 00000100:00100000:0.0:1783444472.059716:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783444472.059723:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575376000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.059839:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575376000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.059845:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783444472.059870:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575376000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.059896:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575376128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.059933:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.059945:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444472.059955:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575376128 00000100:00100000:0.0:1783444472.059958:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575376128 00000100:00100000:0.0:1783444472.059974:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783444472.059979:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575376128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.060061:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575376128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444472.060068:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783444472.060101:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575376128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444472.061355:0:93081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783444472.061509:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783444472.061530:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783444472.061540:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.061552:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444472.061572:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783444472.061575:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:0.0:1783444472.061577:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783444472.061603:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.061611:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.061620:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444472.061638:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575376256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.061749:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.061877:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:1.0:1783444472.061923:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575376256 00000100:00100000:1.0:1783444472.061930:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575376256 00000100:00100000:1.0:1783444472.062015:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783444472.062026:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575376256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444472.062038:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444472.062051:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833227 expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.062072:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833227 expref: 24 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.062092:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833227 expref: 24 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444472.062101:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27600, rc 0) 00000100:00100000:1.0:1783444472.062158:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6ac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575376256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444472.062165:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783444472.062230:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575376256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444472.062242:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.062251:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444472.062297:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575376384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444472.062321:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444472.062464:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444472.062500:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575376384 00000100:00100000:2.0:1783444472.062510:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575376384 00000100:00100000:2.0:1783444472.062571:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783444472.062578:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575376384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444472.062654:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575376384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (322us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783444472.062660:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783444472.062721:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575376384:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783444472.062742:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783444472.062752:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.062760:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444472.862045:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783444473.818027:0:93176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd95a5b100 20000000:00000080:0.0:1783444473.818047:0:93176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9368c712f400 uarg=0000000000000000 00000040:00100000:0.0:1783444473.819865:0:93176:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:0.0:1783444473.819876:0:93176:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:0.0:1783444473.819994:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:0.0:1783444473.820670:0:93176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783444473.820701:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:0.0:1783444473.820722:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:0.0:1783444473.820835:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:0.0:1783444473.820845:0:93176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783444473.820860:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:0.0:1783444473.820877:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:0.0:1783444473.820932:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:0.0:1783444473.820940:0:93176:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783444473.820964:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:0.0:1783444473.820981:0:93176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:0.0:1783444473.820991:0:93176:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783444473.821023:0:93176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821045:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 9 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821053:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 9 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821075:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 23 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821155:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821162:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821169:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 23 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821176:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331ef expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821184:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38331fd expref: 23 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821190:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383320b expref: 23 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821198:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833219 expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821205:0:93176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833227 expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821212:0:93176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821264:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833227 expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821279:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833227 expref: 23 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.821294:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575376512:0@lo:104: 00000100:00100000:0.0:1783444473.821705:0:93176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444473.821762:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833219 expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821772:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833219 expref: 23 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.821781:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575376640:0@lo:104: 00000100:00100000:0.0:1783444473.821826:0:93176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444473.821858:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e383320b expref: 23 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821867:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e383320b expref: 23 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.821875:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575376768:0@lo:104: 00000100:00100000:0.0:1783444473.821893:0:93176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444473.821908:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38331fd expref: 23 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821916:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38331fd expref: 23 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.821937:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575376896:0@lo:104: 00000100:00100000:0.0:1783444473.821968:0:93176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444473.821985:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38331ef expref: 23 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.821993:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38331ef expref: 23 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.822017:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377024:0@lo:104: 00000100:00100000:0.0:1783444473.822038:0:93176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444473.822055:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 23 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.822063:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 23 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.822072:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377152:0@lo:104: 00000100:00100000:0.0:1783444473.822519:0:93176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444473.822538:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.822547:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 23 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.822555:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377280:0@lo:104: 00000100:00100000:0.0:1783444473.822577:0:93176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444473.822592:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.822622:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 23 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.822631:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377408:0@lo:104: 00010000:00010000:0.0:1783444473.822658:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 23 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.822666:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 23 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.822673:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377536:0@lo:104: 00010000:00010000:0.0:1783444473.822696:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 9 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.822704:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 9 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.822714:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377664:192.168.204.20@tcp:104: 00010000:00010000:0.0:1783444473.822778:0:93176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 9 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.822809:0:93176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 9 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.822818:0:93176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd19a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377792:192.168.204.20@tcp:104: 00000100:00100000:0.0:1783444473.822839:0:93176:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444473.823229:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783444473.823249:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444473.823262:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444473.823270:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575376512 00000100:00100000:3.0:1783444473.823278:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575376512 00000100:00100000:3.0:1783444473.823333:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575376640 00000100:00100000:3.0:1783444473.823336:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575376640 00000100:00100000:3.0:1783444473.823345:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575376768 00000100:00100000:3.0:1783444473.823347:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575376768 00000100:00100000:3.0:1783444473.823368:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575376896 00000100:00100000:3.0:1783444473.823371:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575376896 00000100:00100000:3.0:1783444473.823379:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575377024 00000100:00100000:3.0:1783444473.823382:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575377024 00000100:00100000:3.0:1783444473.823390:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575377152 00000100:00100000:3.0:1783444473.823392:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575377152 00000100:00100000:3.0:1783444473.823400:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575377280 00000100:00100000:3.0:1783444473.823402:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575377280 00000100:00100000:3.0:1783444473.823410:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575377408 00000100:00100000:3.0:1783444473.823413:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575377408 00000100:00100000:3.0:1783444473.823420:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575377536 00000100:00100000:3.0:1783444473.823422:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575377536 00000100:00100000:3.0:1783444473.823433:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783444473.823441:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:93176:x1870073575376512:12345-0@lo:104: 00010000:00010000:3.0:1783444473.823454:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.823520:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783444473.823533:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:93176:x1870073575376512:12345-0@lo:104: Request processed in 92us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.823541:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783444473.823560:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783444473.823565:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:93176:x1870073575376640:12345-0@lo:104: 00010000:00010000:3.0:1783444473.823573:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.823617:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783444473.823623:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:93176:x1870073575376640:12345-0@lo:104: Request processed in 58us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.823629:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783444473.823642:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783444473.823648:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:93176:x1870073575376768:12345-0@lo:104: 00010000:00010000:3.0:1783444473.823655:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.823686:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783444473.823690:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:93176:x1870073575376768:12345-0@lo:104: Request processed in 44us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.823696:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783444473.823708:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783444473.823714:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:93176:x1870073575376896:12345-0@lo:104: 00010000:00010000:3.0:1783444473.823721:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.823749:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783444473.823760:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:93176:x1870073575376896:12345-0@lo:104: Request processed in 46us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.823766:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783444473.823780:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1783444473.823786:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:93176:x1870073575377024:12345-0@lo:104: 00010000:00010000:3.0:1783444473.823825:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.823853:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783444473.823857:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:93176:x1870073575377024:12345-0@lo:104: Request processed in 72us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.823863:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1783444473.823963:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1783444473.823971:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:93176:x1870073575377152:12345-0@lo:104: 00010000:00010000:3.0:1783444473.823978:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.824007:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1783444473.824012:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:93176:x1870073575377152:12345-0@lo:104: Request processed in 43us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.824016:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1783444473.824029:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1783444473.824035:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+5:93176:x1870073575377280:12345-0@lo:104: 00010000:00010000:3.0:1783444473.824041:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.824067:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00010000:00010000:2.0:1783444473.824244:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783444473.824251:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824258:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444473.824262:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824270:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444473.824276:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444473.824282:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444473.824319:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824326:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444473.824359:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824366:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf91600/0x42cb6883e3833227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383322e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824390:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783444473.824393:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824399:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444473.824401:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824409:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444473.824415:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444473.824420:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444473.824436:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824442:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444473.824468:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824475:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833220 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824484:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783444473.824487:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824502:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444473.824505:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824511:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444473.824517:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444473.824522:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444473.824536:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824542:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444473.824548:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824554:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26c00/0x42cb6883e383320b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833212 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824562:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783444473.824565:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824570:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444473.824572:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824589:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444473.824595:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444473.824599:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444473.824613:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824618:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444473.824624:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824630:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513b200/0x42cb6883e38331fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833204 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824640:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444473.824643:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824648:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ba00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444473.824650:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824656:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444473.824661:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444473.824673:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444473.824687:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824693:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444473.824698:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824704:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38331ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331f6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.824709:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575378048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444473.824712:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444473.824715:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824720:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444473.824722:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824728:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444473.824734:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444473.824739:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783444473.824745:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783444473.824750:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824756:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444473.824767:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824773:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e38331e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331e8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824781:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783444473.824783:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575378560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444473.824784:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824810:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444473.824813:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824819:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.824821:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1783444473.824826:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444473.824831:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783444473.824842:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1783444473.824845:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.824848:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575378176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444473.824851:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444473.824856:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.824863:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513b800/0x42cb6883e38331d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331da expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.824869:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783444473.824872:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444473.824879:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444473.824880:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1783444473.824881:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444473.824886:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575378688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444473.824898:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575378304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444473.824905:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444473.824923:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444473.824936:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575378048 00000100:00100000:2.0:1783444473.824940:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783444473.824942:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575378048 00000100:00100000:2.0:1783444473.824944:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575377920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444473.824979:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783444473.824980:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833219 expref: 24 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444473.824994:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575378432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444473.824999:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575378560 00000100:00100000:1.0:1783444473.825002:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575378560 00010000:00010000:1.0:1783444473.825012:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 25 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825034:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575378176 00000100:00100000:1.0:1783444473.825037:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575378176 00000100:00100000:2.0:1783444473.825038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783444473.825049:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383320b expref: 26 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825058:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575378688 00000100:00100000:2.0:1783444473.825059:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575378304 00000100:00100000:1.0:1783444473.825061:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575378688 00000100:00100000:2.0:1783444473.825062:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575378304 00010000:00010000:1.0:1783444473.825070:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 28 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.825074:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331fd expref: 28 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825080:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575377920 00000100:00100000:1.0:1783444473.825082:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575377920 00010000:00010000:1.0:1783444473.825091:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833227 expref: 29 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825107:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575378432 00000100:00100000:1.0:1783444473.825109:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575378432 00010000:00010000:1.0:1783444473.825119:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331ef expref: 30 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825130:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1783444473.825136:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+30:3635:x1870073575378048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444473.825148:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444473.825153:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833219 expref: 30 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.825174:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833219 expref: 30 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.825191:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444473.825217:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1783444473.825224:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+30:3635:x1870073575378560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444473.825232:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444473.825237:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 30 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825237:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+30:3635:x1870073575378048:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444473.825244:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00010000:00010000:2.0:1783444473.825246:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 30 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.825255:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444473.825261:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1783444473.825267:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+29:3635:x1870073575378176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444473.825274:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783444473.825276:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+29:3635:x1870073575378560:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (455us total) trans 0 rc 0/0 00010000:00010000:1.0:1783444473.825278:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383320b expref: 29 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444473.825282:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00010000:00010000:1.0:1783444473.825287:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e383320b expref: 29 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444473.825296:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00010000:00010000:1.0:1783444473.825296:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444473.825307:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+28:3635:x1870073575378688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444473.825314:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783444473.825315:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+28:3635:x1870073575378176:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (446us total) trans 0 rc 0/0 00010000:00010000:2.0:1783444473.825319:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 28 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825321:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00010000:00010000:2.0:1783444473.825327:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 27 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.825335:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444473.825357:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1783444473.825363:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+27:3633:x1870073575377920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444473.825369:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444473.825373:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833227 expref: 27 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.825383:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833227 expref: 27 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.825393:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444473.825419:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+27:3635:x1870073575378688:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444473.825421:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+27:3633:x1870073575377920:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444473.825425:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1783444473.825503:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1783444473.825531:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1783444473.825537:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3633:x1870073575378432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444473.825545:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444473.825549:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331ef expref: 25 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.825556:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38331ef expref: 25 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.825565:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444473.825587:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3633:x1870073575378432:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444473.825592:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1783444473.825605:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1783444473.825611:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575378304:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444473.825616:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+5:93176:x1870073575377280:12345-0@lo:104: Request processed in 43us (1500us total) trans 0 rc 0/0 00010000:00010000:1.0:1783444473.825618:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444473.825622:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331fd expref: 24 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444473.825625:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:1.0:1783444473.825629:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38331fd expref: 24 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.825638:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444473.825657:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575378304:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.825662:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783444473.825663:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1783444473.825668:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+4:93176:x1870073575377408:12345-0@lo:104: 00010000:00010000:3.0:1783444473.825676:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825700:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575377920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444473.825708:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575378432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444473.825714:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783444473.825718:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+4:93176:x1870073575377408:12345-0@lo:104: Request processed in 51us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.825723:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783444473.825723:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575378304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444473.825736:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783444473.825742:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:93176:x1870073575377536:12345-0@lo:104: 00010000:00010000:3.0:1783444473.825749:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.825752:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f973d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575378688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444473.825758:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575378176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444473.825765:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575378560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444473.825772:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575378048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444473.825774:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783444473.825778:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:93176:x1870073575377536:12345-0@lo:104: Request processed in 37us (2516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.825783:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:3.0:1783444473.825811:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444473.825816:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825822:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444473.825826:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825846:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444473.825853:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444473.825858:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783444473.825887:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825893:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444473.825905:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825911:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38331c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331cc expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825920:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444473.825924:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825929:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444473.825932:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825938:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444473.825944:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444473.825965:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783444473.825980:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825985:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444473.825991:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.825998:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf90600/0x42cb6883e38331b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38331be expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.826009:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444473.826011:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444473.826012:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444473.826020:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444473.826026:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444473.826035:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575378944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444473.826062:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444473.826175:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575378944 00000100:00100000:2.0:1783444473.826181:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575378944 00010000:00010000:2.0:1783444473.826197:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 24 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444473.826215:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1783444473.826221:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575378944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444473.826228:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444473.826231:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 24 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.826239:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 24 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.826249:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444473.826330:0:93176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27600/0x42cb6883e383322e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833227 expref: 24 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.826347:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575376512:0@lo:104: 00010000:00010000:0.0:1783444473.826374:0:93176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91e00/0x42cb6883e3833220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833219 expref: 23 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.826383:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575376640:0@lo:104: 00010000:00010000:0.0:1783444473.826392:0:93176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27e00/0x42cb6883e3833212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e383320b expref: 22 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.826400:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575376768:0@lo:104: 00010000:00010000:0.0:1783444473.826410:0:93176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513bc00/0x42cb6883e3833204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38331fd expref: 21 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.826419:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575376896:0@lo:104: 00010000:00010000:0.0:1783444473.826427:0:93176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91c00/0x42cb6883e38331f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38331ef expref: 20 pid: 92448 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.826434:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377024:0@lo:104: 00010000:00010000:0.0:1783444473.826443:0:93176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91a00/0x42cb6883e38331e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38331e1 expref: 19 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.826449:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377152:0@lo:104: 00010000:00010000:0.0:1783444473.826457:0:93176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91400/0x42cb6883e38331da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38331d3 expref: 18 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.826464:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377280:0@lo:104: 00000100:00100000:0.0:1783444473.826471:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377408:0@lo:104: 00010000:00010000:0.0:1783444473.826488:0:93176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031a00/0x42cb6883e38331be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38331b7 expref: 17 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.826496:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377536:0@lo:104: 00000100:00100000:2.0:1783444473.829596:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+16:3634:x1870073575378944:12345-0@lo:103:ldlm_bl.0 Request processed in 3364us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444473.829626:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00010000:00010000:2.0:1783444473.829715:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444473.829738:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575378816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444473.829781:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444473.829844:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575378816 00000100:00100000:1.0:1783444473.829853:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575378816 00010000:00010000:1.0:1783444473.829885:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 16 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.829921:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1783444473.829929:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+16:3633:x1870073575378816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444473.829943:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444473.829948:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 16 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.829972:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 16 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.829989:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513be00/0x42cb6883e38331cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38331c5 expref: 16 pid: 92445 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.830004:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444473.830051:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+15:3633:x1870073575378816:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444473.830057:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1783444473.830104:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575378816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444473.830582:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575378944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444473.830973:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444473.831069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444473.831198:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557824384 00000100:00100000:1.0:1783444473.831204:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557824384 00010000:00010000:1.0:1783444473.831236:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 10 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444473.831266:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557824512 00000100:00100000:1.0:1783444473.831269:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557824512 00000100:00100000:2.0:1783444473.831281:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377664:192.168.204.20@tcp:104: 00010000:00010000:1.0:1783444473.831281:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 11 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444473.831291:0:93176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd19a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93176:1870073575377792:192.168.204.20@tcp:104: 00000100:00100000:1.0:1783444473.831301:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2576 00000100:00100000:1.0:1783444473.831307:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28921b6e-3bc9-4a81-ae87-1992169ba754+11:2404:x1870073557824384:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444473.831316:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444473.831320:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 11 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.831330:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 11 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444473.831377:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2577 00000100:00100000:0.0:1783444473.831386:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28921b6e-3bc9-4a81-ae87-1992169ba754+11:2403:x1870073557824512:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444473.831395:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444473.831400:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 11 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444473.832859:0:93176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.833823:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031000/0x42cb6883e38331b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d3c expref: 11 pid: 92443 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444473.833844:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444473.833920:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557824384:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 2610us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444473.833930:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2576 00010000:00010000:0.0:1783444473.834252:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 9 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.834266:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0030200/0x42cb6883e38331a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d35 expref: 9 pid: 92444 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.834278:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.834286:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.838892:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.838917:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.838925:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.838932:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.838969:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444473.838973:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.838983:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.839357:0:93176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444473.839368:0:93176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.843690:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.843711:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf90400/0x42cb6883e3833235 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444473.843732:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444473.843969:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28921b6e-3bc9-4a81-ae87-1992169ba754+8:2403:x1870073557824512:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 12579us (12894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444473.843980:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2577 00010000:00010000:3.0:1783444473.886870:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444474.142768:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575379328:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.142876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.142910:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575379840:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.142937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.142966:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575380352:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.142986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.143010:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783444474.143017:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575379456:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.143060:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.143079:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575379968:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.143104:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.143119:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575380480:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.143139:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.143183:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575379200:0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.143274:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575379328 00000100:00100000:1.0:1783444474.143282:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575379328 00000100:00100000:1.0:1783444474.143336:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575379456 00000100:00100000:1.0:1783444474.143339:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575379456 00000100:00100000:1.0:1783444474.143371:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1783444474.143381:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575379328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444474.143510:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575379072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444474.143582:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1783444474.143594:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575379456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.144909:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575379328:12345-0@lo:400:kworker.0 Request processed in 1524us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444474.144921:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1783444474.144977:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575379968 00000100:00100000:1.0:1783444474.144983:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575379968 00000100:00100000:1.0:1783444474.145021:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575380480 00000100:00100000:1.0:1783444474.145024:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575380480 00000100:00100000:1.0:1783444474.145046:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1783444474.145052:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575379968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.145100:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575379968:12345-0@lo:400:kworker.0 Request processed in 48us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444474.145107:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1783444474.145119:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:1.0:1783444474.145125:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575380480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.145171:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575380480:12345-0@lo:400:kworker.0 Request processed in 39us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.145173:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444474.145182:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:1.0:1783444474.145225:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575380864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444474.145260:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444474.145304:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575379200 00000100:00100000:1.0:1783444474.145308:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575379200 00000100:00100000:1.0:1783444474.145335:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783444474.145341:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb78e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+15:3636:x1870073575379200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.145379:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb78e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+15:3636:x1870073575379200:12345-0@lo:400:kworker.0 Request processed in 38us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.145398:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575379200:0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.145400:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783444474.145413:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575379712:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145449:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444474.145455:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575379968:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145476:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575380224:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145499:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.145517:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575380736:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145551:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.145610:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575379712 00000100:00100000:0.0:1783444474.145615:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575379712 00000100:00100000:0.0:1783444474.145645:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575380224 00000100:00100000:0.0:1783444474.145649:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575380224 00000100:00100000:0.0:1783444474.145663:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575380736 00000100:00100000:0.0:1783444474.145666:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575380736 00000100:00100000:0.0:1783444474.145678:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1783444474.145684:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575379712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145741:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575379712:12345-0@lo:400:kworker.0 Request processed in 56us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.145748:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1783444474.145761:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1783444474.145766:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575380224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145813:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575380224:12345-0@lo:400:kworker.0 Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.145820:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1783444474.145832:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1783444474.145838:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575380736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145866:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575380736:12345-0@lo:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.145872:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1783444474.145905:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575379712:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145915:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575380224:0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.145924:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575380736:0@lo:400:kworker.0 00000100:00080000:0.0:1783444474.145979:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444474.145984:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444474.145993:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444474.146006:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575379840 00000100:00100000:0.0:1783444474.146010:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575379840 00000100:00100000:0.0:1783444474.146037:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575380352 00000100:00100000:0.0:1783444474.146041:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575380352 00000100:00100000:0.0:1783444474.146053:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575380864 00000100:00100000:0.0:1783444474.146056:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575380864 00000100:00100000:0.0:1783444474.146067:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:0.0:1783444474.146072:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3633:x1870073575379840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.146110:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3633:x1870073575379840:12345-0@lo:400:kworker.0 Request processed in 37us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.146116:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:0.0:1783444474.146128:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:0.0:1783444474.146133:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575380352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444474.146178:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575380352:12345-0@lo:400:kworker.0 Request processed in 44us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.146184:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:0.0:1783444474.146195:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:0.0:1783444474.146201:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575380864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444474.146693:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575380480:0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.146713:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575379328:0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.146726:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575379840:0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.146738:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575380352:0@lo:400:kworker.0 00000100:00100000:3.0:1783444474.149204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444474.149263:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575379584:0@lo:400:kworker.0 00000100:00100000:3.0:1783444474.149312:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444474.149355:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575379584 00000100:00100000:3.0:1783444474.149362:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575379584 00000100:00100000:3.0:1783444474.149421:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1783444474.149431:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575379584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.149612:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575379072 00000100:00100000:1.0:1783444474.149619:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575379072 00000100:00100000:1.0:1783444474.149655:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:1.0:1783444474.149662:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575379072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444474.149697:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445027840 avail 1298788352 00000100:00100000:1.0:1783444474.149742:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575379072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444474.149749:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00080000:1.0:1783444474.149840:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1783444474.151662:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444737024 avail 1298497536 00000100:00100000:0.0:1783444474.151835:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575380864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5631us (6570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.151845:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:2.0:1783444474.151996:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575379456:12345-0@lo:400:kworker.0 Request processed in 8404us (8934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444474.152006:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1783444474.152054:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575380096:0@lo:400:kworker.0 00000100:00100000:2.0:1783444474.152086:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444474.152116:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575380608:0@lo:400:kworker.0 00000100:00100000:2.0:1783444474.152136:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444474.152175:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575380096 00000100:00100000:2.0:1783444474.152182:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575380096 00000100:00100000:2.0:1783444474.152237:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575380608 00000100:00100000:2.0:1783444474.152240:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575380608 00000100:00100000:2.0:1783444474.152264:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:2.0:1783444474.152271:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575380096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444474.152304:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575380096:12345-0@lo:400:kworker.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444474.152325:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:2.0:1783444474.152339:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00080000:0.0:1783444474.152626:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444474.161271:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575380864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444474.161327:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575379456:0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.161435:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575379072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444474.161450:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575379584:0@lo:400:kworker.0 00000100:00100000:1.0:1783444474.161463:0:3635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969457 gen 2 00000004:00080000:1.0:1783444474.161467:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9368e3efaa00, transno 4294969457 00000100:00100000:1.0:1783444474.161522:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575380096:0@lo:400:kworker.0 00000100:00100000:2.0:1783444474.164839:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575380608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444474.164966:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575380608:12345-0@lo:400:kworker.0 Request processed in 12620us (12827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444474.164977:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1783444474.165838:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575380608:0@lo:400:kworker.0 00000020:00080000:1.0:1783444474.168919:0:75651:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444090 batchid updated 00000020:00080000:2.0:1783444474.168997:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000004:00080000:2.0:1783444474.169136:0:75671:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9368c595b000 with version 10 00000100:00100000:3.0:1783444474.169181:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575379584:12345-0@lo:400:kworker.0 Request processed in 6572us (6689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444474.169211:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000020:00080000:2.0:1783444474.169224:0:75671:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444090 cancel update log [0x20000cf21:0x1:0x0].2: rc = 0 00000020:00080000:2.0:1783444474.169317:0:75671:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444090 cancel update log [0x2400088d4:0x1:0x0].2: rc = 0 00000020:00080000:2.0:1783444474.169326:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000004:00080000:1.0:1783444474.179237:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 10 rpc_version 10 00000020:00100000:1.0:1783444474.179294:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783444474.179308:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367c71d0000 x1870073575381120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444474.179335:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575381120:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783444474.179413:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444474.179473:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c1254780 going to sleep for 11 seconds 00000100:00100000:2.0:1783444474.182323:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575381120 00000100:00100000:2.0:1783444474.182340:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575381120 00000100:00100000:2.0:1783444474.182430:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:2.0:1783444474.182442:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75656:x1870073575381120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783444474.182671:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575381120:12345-0@lo:1000:osp_up0-1.0 Request processed in 231us (3257us total) trans 120259084291 rc 0/0 00000100:00100000:2.0:1783444474.182680:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1783444474.183039:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575381120:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783444474.653104:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444474.653130:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575381248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444474.653177:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444474.653190:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575381376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444474.653210:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.653239:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444474.653296:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575381248 00000100:00100000:0.0:1783444474.653303:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575381248 00000100:00100000:0.0:1783444474.653361:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575381376 00000100:00100000:0.0:1783444474.653365:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575381376 00000100:00100000:0.0:1783444474.653384:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1783444474.653392:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575381248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444474.653426:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444474.653472:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575381248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.653493:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1783444474.653512:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1783444474.653519:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575381376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444474.653533:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444474.653562:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575381376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444474.653568:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1783444474.653606:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575381376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444474.653638:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575381248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783444474.909010:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444475.466929:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444475.467748:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557824640 00000100:00100000:2.0:1783444475.467759:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557824640 00000100:00100000:2.0:1783444475.467853:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:2.0:1783444475.467863:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb78e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557824640:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444475.467891:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444475.467909:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031200/0x42cb6883e383323c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d43 expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.468118:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031200/0x42cb6883e383323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d43 expref: 9 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.468131:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031200/0x42cb6883e383323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d43 expref: 9 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.468140:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031200, rc 0) 00000100:00100000:2.0:1783444475.468364:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb78e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557824640:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 501us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.468372:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:2.0:1783444475.476616:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444475.478198:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557824768 00000100:00100000:1.0:1783444475.478213:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557824768 00000100:00100000:1.0:1783444475.478465:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:1.0:1783444475.478476:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb78ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557824768:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.478728:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb78ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557824768:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 252us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.478735:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 10000000:01000000:1.0:1783444475.484969:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783444475.484977:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff936901f97800 from 55 10000000:01000000:1.0:1783444475.484983:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783444475.485035:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.485047:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.485074:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.485118:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575381504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.485190:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.485256:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e70283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.485556:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575381504 00000100:00100000:0.0:1783444475.485564:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575381504 00000100:00100000:0.0:1783444475.485622:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783444475.485632:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575381504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444475.485648:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444475.485662:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91c00/0x42cb6883e383324a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833243 expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.485686:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91c00/0x42cb6883e383324a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833243 expref: 16 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.485704:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91c00/0x42cb6883e383324a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833243 expref: 16 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.485712:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91c00, rc 0) 00000100:00100000:0.0:1783444475.485763:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575381504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.485780:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783444475.486003:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575381504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444475.486018:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.486027:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.486158:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575381632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.486188:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.486220:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e70283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444475.486286:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575381632 00000100:00100000:2.0:1783444475.486291:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575381632 00000100:00100000:2.0:1783444475.486326:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783444475.486333:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d42bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575381632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.486472:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d42bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575381632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.486479:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783444475.486607:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575381632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.486633:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575381760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.486668:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.486689:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e70283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444475.486738:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575381760 00000100:00100000:2.0:1783444475.486742:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575381760 00000100:00100000:2.0:1783444475.486771:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783444475.486777:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c22e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575381760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.486882:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c22e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575381760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.486894:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783444475.486960:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444475.486984:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557824896 00000100:00100000:0.0:1783444475.486989:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557824896 00000100:00100000:0.0:1783444475.487028:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:0.0:1783444475.487034:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557824896:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.487094:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557824896:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.487101:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:1.0:1783444475.487434:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575381760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.489767:0:93177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93177:1870073575381888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.489861:0:93177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.489964:0:93177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e70280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444475.494108:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575381888 00000100:00100000:2.0:1783444475.494123:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575381888 00000100:00100000:2.0:1783444475.494263:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783444475.494274:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:93177:x1870073575381888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444475.494478:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:93177:x1870073575381888:12345-0@lo:502:llog_process_th.0 Request processed in 205us (4616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.494486:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783444475.494600:0:93177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93177:1870073575381888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.494663:0:93177:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93177:1870073575382016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.494702:0:93177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.496295:0:93177:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e70280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.496463:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575382016 00000100:00100000:0.0:1783444475.496471:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575382016 00000100:00100000:0.0:1783444475.496528:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783444475.496537:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:93177:x1870073575382016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.496679:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:93177:x1870073575382016:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.496687:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783444475.497715:0:93177:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93177:1870073575382016:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444475.497759:0:93177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1783444475.498116:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1783444475.498281:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444475.498292:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.498320:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444475.498330:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783444475.498333:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:0.0:1783444475.498336:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444475.498442:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.498450:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.498459:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444475.498480:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.498534:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444475.508065:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575382144 00000100:00100000:3.0:1783444475.508081:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575382144 00000100:00100000:3.0:1783444475.508147:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783444475.508160:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575382144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444475.508179:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444475.508200:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513a800/0x42cb6883e3833258 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833251 expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.508229:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513a800/0x42cb6883e3833258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833251 expref: 17 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.508364:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513a800/0x42cb6883e3833258 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833251 expref: 17 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.508375:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a800, rc 0) 00000100:00100000:3.0:1783444475.508451:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575382144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 293us (9916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.508458:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783444475.508511:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08540 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.508536:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444475.508554:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.508564:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444475.508655:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.508691:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.508739:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08540 going to sleep for 11 seconds 00000100:00100000:2.0:1783444475.509064:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444475.509813:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575382272 00000100:00100000:0.0:1783444475.509820:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575382272 00000100:00100000:0.0:1783444475.509855:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557825024 00000100:00100000:0.0:1783444475.509859:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557825024 00000100:00100000:0.0:1783444475.509876:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783444475.510048:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368d42bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575382272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.510192:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368d42bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575382272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.511369:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:2.0:1783444475.511490:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:71964:x1870073557825024:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783444475.511668:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:71964:x1870073557825024:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 186us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.511678:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:0.0:1783444475.512534:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783444475.512600:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.512653:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.512711:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.512745:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08540 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.513053:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575382400 00000100:00100000:1.0:1783444475.513060:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575382400 00000100:00100000:1.0:1783444475.513233:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783444475.513254:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575382400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.513377:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575382400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.513385:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783444475.513467:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.513707:0:93178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93178:1870073575382528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.513743:0:93178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444475.515151:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575382528 00000100:00100000:2.0:1783444475.515162:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575382528 00000100:00100000:2.0:1783444475.515198:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783444475.515207:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93178:x1870073575382528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444475.515366:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93178:x1870073575382528:12345-0@lo:502:llog_process_th.0 Request processed in 158us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.515373:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783444475.515493:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444475.515509:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557825152 00000100:00100000:2.0:1783444475.515512:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557825152 00000100:00100000:2.0:1783444475.515527:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:2.0:1783444475.515541:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:71964:x1870073557825152:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783444475.515610:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb859850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:71964:x1870073557825152:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.515617:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:0.0:1783444475.516422:0:93178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa08540 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.516489:0:93178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93178:1870073575382528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444475.516526:0:93178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444475.516540:0:93178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444475.516543:0:93178:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1783444475.516550:0:93178:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1783444475.516571:0:93178:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:0.0:1783444475.518117:0:93178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93178:1870073575382656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.518204:0:93178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.518260:0:93178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.518317:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575382656 00000100:00100000:1.0:1783444475.518324:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575382656 00000100:00100000:1.0:1783444475.518369:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783444475.518379:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb85ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93178:x1870073575382656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.518516:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb85ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:93178:x1870073575382656:12345-0@lo:502:llog_process_th.0 Request processed in 139us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.518523:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783444475.519061:0:93178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93178:1870073575382656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444475.519094:0:93178:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444475.519102:0:93178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444475.519104:0:93178:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783444475.519108:0:93178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:1.0:1783444475.519281:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:1.0:1783444475.519316:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783444475.519328:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.519339:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444475.519359:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783444475.519361:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 55 10000000:01000000:1.0:1783444475.519364:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783444475.519391:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.519399:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.519408:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.519425:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.519460:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.519500:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e7028180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.519672:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575382784 00000100:00100000:0.0:1783444475.519678:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575382784 00000100:00100000:0.0:1783444475.519717:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783444475.519725:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ebe2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575382784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444475.519736:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444475.519748:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf90c00/0x42cb6883e3833266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383325f expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.519779:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf90c00/0x42cb6883e3833266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383325f expref: 18 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.519812:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf90c00/0x42cb6883e3833266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383325f expref: 18 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.519821:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90c00, rc 0) 00000100:00100000:0.0:1783444475.519853:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ebe2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575382784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.519860:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783444475.520226:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444475.520252:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833266 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.520263:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833266 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.520333:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.520365:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.520394:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e7028180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.520414:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575382912 00000100:00100000:1.0:1783444475.520418:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575382912 00000100:00100000:1.0:1783444475.520454:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783444475.520460:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ebe2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575382912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.520826:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ebe2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575382912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.520833:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783444475.520987:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575382912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.521017:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575383040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.521061:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.521095:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177600 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.521138:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575383040 00000100:00100000:1.0:1783444475.521142:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575383040 00000100:00100000:1.0:1783444475.521174:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783444475.521181:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575383040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.521399:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575383040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.521406:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783444475.521521:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575383040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.521851:0:93180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93180:1870073575383168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.521890:0:93180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.521908:0:93180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177300 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.522028:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575383168 00000100:00100000:1.0:1783444475.522033:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575383168 00000100:00100000:1.0:1783444475.522067:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783444475.522074:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:93180:x1870073575383168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.522159:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:93180:x1870073575383168:12345-0@lo:502:llog_process_th.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.522165:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783444475.522250:0:93180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93180:1870073575383168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.522286:0:93180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93180:1870073575383296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.522451:0:93180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.522478:0:93180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177300 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.522518:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575383296 00000100:00100000:1.0:1783444475.522522:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575383296 00000100:00100000:1.0:1783444475.522552:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783444475.522558:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:93180:x1870073575383296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.522622:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:93180:x1870073575383296:12345-0@lo:502:llog_process_th.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.522628:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783444475.522706:0:93180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93180:1870073575383296:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783444475.522725:0:93180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1783444475.522974:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1783444475.523003:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783444475.523014:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833266 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.523024:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833266 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444475.523033:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783444475.523036:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:1.0:1783444475.523039:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783444475.523062:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.523070:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.523079:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.523093:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575383424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.523121:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.523149:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c61b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.523190:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575383424 00000100:00100000:0.0:1783444475.523195:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575383424 00000100:00100000:0.0:1783444475.523392:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783444475.523401:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575383424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444475.523411:0:92444:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444475.523426:0:92444:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91800/0x42cb6883e3833274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383326d expref: -99 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.523451:0:92444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91800/0x42cb6883e3833274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383326d expref: 19 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.523463:0:92444:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91800/0x42cb6883e3833274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383326d expref: 19 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.523473:0:92444:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91800, rc 0) 00000100:00100000:0.0:1783444475.523518:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575383424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.523524:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000020:01000004:2.0:1783444475.523648:0:93179:0:(tgt_mount.c:153:server_get_mount()) get mount ffff936901f97800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783444475.523653:0:93179:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936901f97800 4 00000100:00100000:2.0:1783444475.523833:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575383424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444475.523846:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833274 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.523855:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833274 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444475.523898:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575383552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.523939:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444475.524170:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bfb300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.526609:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575383552 00000100:00100000:3.0:1783444475.526621:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575383552 00000100:00100000:3.0:1783444475.526670:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783444475.526678:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575383552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.526857:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575383552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.526880:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783444475.526947:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575383552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.526998:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575383680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.527036:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444475.527062:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef284840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.527074:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575383680 00000100:00100000:3.0:1783444475.527077:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575383680 00000100:00100000:3.0:1783444475.527091:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783444475.527096:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575383680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.527394:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575383680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.527401:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783444475.527543:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575383680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.527713:0:93181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93181:1870073575383808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444475.527745:0:93181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.528561:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575383808 00000100:00100000:1.0:1783444475.528569:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575383808 00000100:00100000:1.0:1783444475.528606:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783444475.528615:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eacc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93181:x1870073575383808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.528728:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eacc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93181:x1870073575383808:12345-0@lo:502:llog_process_th.0 Request processed in 114us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.528736:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783444475.528983:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444475.529004:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557825280 00000100:00100000:1.0:1783444475.529008:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557825280 00000100:00100000:1.0:1783444475.529025:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:1.0:1783444475.529031:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557825280:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444475.529040:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444475.529056:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27200/0x42cb6883e383327b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d4a expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.529080:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27200/0x42cb6883e383327b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d4a expref: 10 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.529090:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27200/0x42cb6883e383327b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d4a expref: 10 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.529100:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27200, rc 0) 00000100:00100000:1.0:1783444475.529141:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557825280:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 109us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.529148:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:2.0:1783444475.534783:0:93181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef284cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444475.534857:0:93181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93181:1870073575383808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444475.534928:0:93181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444475.534945:0:93181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444475.534947:0:93181:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1783444475.534954:0:93181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1783444475.534975:0:93181:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1783444475.535018:0:93181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93181:1870073575383936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444475.535101:0:93181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444475.535197:0:93181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bfb300 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.537531:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575383936 00000100:00100000:1.0:1783444475.537547:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575383936 00000100:00100000:1.0:1783444475.537684:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783444475.537696:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93181:x1870073575383936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.538142:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:93181:x1870073575383936:12345-0@lo:502:llog_process_th.0 Request processed in 447us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.538150:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783444475.538753:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444475.538909:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557825408 00000100:00100000:3.0:1783444475.538928:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557825408 00000100:00100000:3.0:1783444475.538969:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:3.0:1783444475.538977:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557825408:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.539075:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557825408:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 98us (324us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444475.539083:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:2.0:1783444475.541447:0:93181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93181:1870073575383936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444475.541564:0:93181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444475.541574:0:93181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444475.541576:0:93181:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783444475.541580:0:93181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:3.0:1783444475.541958:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:3.0:1783444475.541998:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783444475.542009:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833274 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.542021:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833274 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444475.542031:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444475.542033:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 55 10000000:01000000:3.0:1783444475.542036:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444475.542070:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.542079:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.542094:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444475.542118:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.542182:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444475.542263:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef2846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.542307:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575384064 00000100:00100000:0.0:1783444475.542316:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575384064 00000100:00100000:0.0:1783444475.542539:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783444475.542549:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575384064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444475.542562:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444475.542574:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833282 expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.542597:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833282 expref: 20 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.542607:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833282 expref: 20 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.542615:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91a00, rc 0) 00000100:00100000:0.0:1783444475.542663:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c21e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575384064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.542670:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783444475.542735:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444475.542756:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833289 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.542777:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833289 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.542859:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.542898:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.543388:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c61b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.543570:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575384192 00000100:00100000:3.0:1783444475.543576:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575384192 00000100:00100000:3.0:1783444475.543619:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783444475.543627:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575384192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.543777:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575384192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.543785:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783444475.544242:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.544286:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.544331:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.544365:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c61b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.544380:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575384320 00000100:00100000:1.0:1783444475.544384:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575384320 00000100:00100000:1.0:1783444475.544408:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783444475.544428:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575384320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.544514:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575384320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444475.544521:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783444475.544559:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.545304:0:93182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93182:1870073575384448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.548195:0:93182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444475.548406:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575384448 00000100:00100000:3.0:1783444475.548426:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575384448 00000100:00100000:3.0:1783444475.548477:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783444475.548487:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c326dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:93182:x1870073575384448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444475.548641:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c326dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:93182:x1870073575384448:12345-0@lo:502:llog_process_th.0 Request processed in 155us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.548649:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783444475.550241:0:93182:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c61b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.550339:0:93182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93182:1870073575384448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.550551:0:93182:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93182:1870073575384576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.550616:0:93182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.550690:0:93182:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef177600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.550776:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575384576 00000100:00100000:3.0:1783444475.550783:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575384576 00000100:00100000:0.0:1783444475.551091:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783444475.551100:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690064fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:93182:x1870073575384576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.551276:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690064fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:93182:x1870073575384576:12345-0@lo:502:llog_process_th.0 Request processed in 176us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.551285:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783444475.551423:0:93182:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93182:1870073575384576:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444475.551456:0:93182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1783444475.551744:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1783444475.551769:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444475.551782:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833289 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.551820:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833289 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444475.551830:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1783444475.551833:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1783444475.551836:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783444475.551865:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.551873:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.551893:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444475.551911:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.551957:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444475.553140:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.553224:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575384704 00000100:00100000:3.0:1783444475.553233:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575384704 00000100:00100000:3.0:1783444475.553294:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783444475.553304:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690064c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575384704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444475.553320:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444475.553336:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833297 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833290 expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.553376:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833290 expref: 21 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.553387:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833290 expref: 21 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.553397:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513aa00, rc 0) 00000100:00100000:3.0:1783444475.553657:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690064c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575384704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 353us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.553665:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783444475.553750:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444475.553780:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833297 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.553806:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833297 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444475.553967:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.554005:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444475.554029:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.554082:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575384832 00000100:00100000:3.0:1783444475.554087:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575384832 00000100:00100000:3.0:1783444475.554126:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783444475.554133:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93690067a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575384832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.554242:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93690067a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575384832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.554249:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783444475.554365:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.554396:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.554553:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444475.554578:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444475.554592:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575384960 00000100:00100000:2.0:1783444475.554595:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575384960 00000100:00100000:2.0:1783444475.554615:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783444475.554621:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575384960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.554711:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575384960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.554718:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783444475.554760:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575384960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444475.556845:0:93183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783444475.557249:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783444475.557282:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783444475.557293:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833297 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.557305:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833297 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444475.557315:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444475.557318:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 55 10000000:01000000:3.0:1783444475.557321:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444475.557365:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.557373:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.557383:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444475.557405:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.557624:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444475.557670:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783444475.557724:0:92443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575385088 00000100:00100000:2.0:1783444475.557731:0:92443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575385088 00000100:00100000:2.0:1783444475.557777:0:92443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783444475.557811:0:92443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575385088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444475.557838:0:92443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444475.557851:0:92443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031a00/0x42cb6883e38332a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383329e expref: -99 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.557873:0:92443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031a00/0x42cb6883e38332a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383329e expref: 22 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.557900:0:92443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031a00/0x42cb6883e38332a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383329e expref: 22 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444475.557909:0:92443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031a00, rc 0) 00000100:00100000:2.0:1783444475.557962:0:92443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575385088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.557970:0:92443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783444475.559324:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444475.559358:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332a5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.559370:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38332a5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444475.559466:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.559509:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.559546:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab03cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.560852:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575385216 00000100:00100000:3.0:1783444475.561547:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575385216 00000100:00100000:3.0:1783444475.561646:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783444475.561657:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575385216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.561859:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575385216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.561867:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783444475.563022:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.563088:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.563148:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.563184:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab03cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444475.563274:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575385344 00000100:00100000:2.0:1783444475.563282:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575385344 00000100:00100000:2.0:1783444475.563324:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783444475.563333:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c6d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575385344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444475.563453:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c6d5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575385344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.563460:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783444475.564311:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444475.566132:0:93184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93184:1870073575385472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.566214:0:93184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444475.566303:0:93184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cab03000 going to sleep for 11 seconds 00000100:00100000:1.0:1783444475.566640:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575385472 00000100:00100000:1.0:1783444475.566649:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575385472 00000100:00100000:0.0:1783444475.581226:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783444475.581263:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:93184:x1870073575385472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444475.581486:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:93184:x1870073575385472:12345-0@lo:502:llog_process_th.0 Request processed in 246us (15271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.581495:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783444475.581524:0:93184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93184:1870073575385472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.581596:0:93184:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93184:1870073575385600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444475.581639:0:93184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.581673:0:93184:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.581751:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575385600 00000100:00100000:3.0:1783444475.581759:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575385600 00000100:00100000:3.0:1783444475.581809:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783444475.581816:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:93184:x1870073575385600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444475.581900:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:93184:x1870073575385600:12345-0@lo:502:llog_process_th.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.581906:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783444475.582138:0:93184:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:93184:1870073575385600:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444475.582158:0:93184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1783444475.582569:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1783444475.582592:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444475.582603:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332a5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.582615:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332a5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444475.582625:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783444475.582628:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783444475.582630:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783444475.582658:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.582666:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.582683:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444475.582699:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.582731:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444475.582765:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff93690058c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444475.583143:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575385728 00000100:00100000:0.0:1783444475.583150:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575385728 00000100:00100000:0.0:1783444475.583190:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783444475.583198:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575385728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444475.583208:0:92445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444475.583222:0:92445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91400/0x42cb6883e38332b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38332ac expref: -99 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.583245:0:92445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91400/0x42cb6883e38332b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38332ac expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.583328:0:92445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91400/0x42cb6883e38332b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38332ac expref: 23 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444475.583340:0:92445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91400, rc 0) 00000100:00100000:0.0:1783444475.583515:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c712dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575385728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 316us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.583521:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783444475.584055:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444475.584072:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332b3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.584082:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38332b3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.584149:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.584186:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.584222:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.584361:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575385856 00000100:00100000:3.0:1783444475.584366:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575385856 00000100:00100000:3.0:1783444475.584392:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783444475.584398:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575385856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.584632:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368cd459050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575385856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.584639:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783444475.584748:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.584778:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.584840:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.584866:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.586188:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575385984 00000100:00100000:3.0:1783444475.586200:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575385984 00000100:00100000:3.0:1783444475.586264:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783444475.586272:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575385984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.586408:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575385984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.586425:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783444475.586557:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575385984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444475.587603:0:93185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1783444475.587845:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1783444475.587875:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783444475.587897:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332b3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.587910:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332b3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444475.587929:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783444475.587932:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:1.0:1783444475.587935:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783444475.587970:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.587978:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.587988:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.588012:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575386112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.588070:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.588109:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.588241:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575386112 00000100:00100000:3.0:1783444475.588249:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575386112 00000100:00100000:3.0:1783444475.588302:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783444475.588310:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575386112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444475.588323:0:92448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444475.588520:0:92448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513ac00/0x42cb6883e38332c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38332ba expref: -99 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.588546:0:92448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513ac00/0x42cb6883e38332c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38332ba expref: 24 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.588556:0:92448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513ac00/0x42cb6883e38332c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38332ba expref: 24 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444475.588575:0:92448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513ac00, rc 0) 00000100:00100000:3.0:1783444475.588622:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575386112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.588629:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783444475.589099:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575386112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444475.589115:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332c1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.589124:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38332c1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444475.589198:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575386240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444475.589227:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.589269:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c56f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444475.589364:0:92448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575386240 00000100:00100000:3.0:1783444475.589369:0:92448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575386240 00000100:00100000:3.0:1783444475.589404:0:92448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783444475.589520:0:92448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575386240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444475.589738:0:92448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575386240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (509us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444475.589745:0:92448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783444475.589830:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575386240:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1783444475.589856:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783444475.589861:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332c1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444475.589870:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38332c1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444475.677055:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444475.677080:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575386368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444475.677151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444475.677183:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575386496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444475.677221:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444475.677322:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575386368 00000100:00100000:2.0:1783444475.677331:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575386368 00000100:00100000:2.0:1783444475.677395:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575386496 00000100:00100000:2.0:1783444475.677399:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575386496 00000100:00100000:2.0:1783444475.677445:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:2.0:1783444475.677452:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575386368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444475.677475:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444475.677521:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575386368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.677529:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:2.0:1783444475.677563:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1783444475.677570:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575386496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444475.677581:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444475.677615:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575386496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444475.677620:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:2.0:1783444475.677663:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575386496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444475.677697:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575386368:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783444475.945926:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444475.981524:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444475.981633:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444475.981679:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557825664 00000100:00100000:0.0:1783444475.981692:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557825664 00000100:00100000:0.0:1783444475.981763:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1096 00000100:00100000:0.0:1783444475.981775:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557825664:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444475.981944:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557825536 00000100:00100000:3.0:1783444475.981950:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557825536 00000100:00100000:3.0:1783444475.981982:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:3.0:1783444475.981990:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557825536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444475.982119:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557825536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 61us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444475.982138:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:0.0:1783444475.982444:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557825664:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 671us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444475.982451:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1096 00000100:00080000:0.0:1783444475.982470:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444476.000480:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444476.000522:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444476.000552:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557825920 00000100:00100000:0.0:1783444476.000561:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557825920 00000100:00100000:0.0:1783444476.000635:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2499 00000100:00100000:0.0:1783444476.000647:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557825920:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444476.000738:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557825920:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444476.000746:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2499 00000100:00100000:0.0:1783444476.000774:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557825792 00000100:00100000:0.0:1783444476.000778:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557825792 00000100:00100000:0.0:1783444476.000881:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1097 00000100:00100000:0.0:1783444476.000888:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557825792:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444476.000932:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557825792:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 44us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444476.000938:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1097 00000100:00080000:0.0:1783444476.000957:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444476.000962:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783444476.958179:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444476.977253:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444476.977341:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557826048 00000100:00100000:3.0:1783444476.977350:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557826048 00000100:00100000:3.0:1783444476.977405:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1363 00000100:00100000:3.0:1783444476.977414:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71984:x1870073557826048:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:3.0:1783444476.977435:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444476.977453:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e38332c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d51 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444476.977515:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e38332cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444476.977528:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e38332cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444476.977543:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e38332cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444476.977718:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444476.977723:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444476.977764:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e38332cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444476.977822:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e38332c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d51 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444476.977838:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e38332cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d51 expref: 7 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444476.977848:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:3.0:1783444476.977858:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444476.977862:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a600, rc 0) 00000100:00100000:3.0:1783444476.977929:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557826048:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 515us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444476.977936:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1363 00000100:00100000:0.0:1783444476.985991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444476.992269:0:92310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557826176 00000100:00100000:2.0:1783444476.992284:0:92310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557826176 00000100:00100000:2.0:1783444476.992349:0:92310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:2.0:1783444476.992360:0:92310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557826176:12345-192.168.204.20@tcp:700:mkdir.0 00000100:00100000:2.0:1783444476.992455:0:92310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557826176:12345-192.168.204.20@tcp:700:mkdir.0 Request processed in 96us (6474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444476.992463:0:92310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:2.0:1783444477.001846:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444477.002104:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557826432 00000100:00100000:1.0:1783444477.002114:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557826432 00000100:00100000:1.0:1783444477.002222:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1364 00000100:00100000:1.0:1783444477.002233:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557826432:12345-192.168.204.20@tcp:36:mkdir.0 00010000:00010000:1.0:1783444477.002293:0:66223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444477.002321:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e38332cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d51 expref: 7 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.002338:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:1.0:1783444477.002342:0:66223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444477.002401:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.002428:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.002437:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.002451:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.002457:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.002463:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783444477.002744:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783444477.008081:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.008113:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.008133:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444477.009491:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d25d708b reply state 00000000e4476ac4 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009516:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009525:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860000) 00010000:00010000:0.0:1783444477.009528:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444477.009533:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783444477.009539:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783444477.009549:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009557:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009563:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009570:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009577:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444477.009583:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009591:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009618:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:0.0:1783444477.009620:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444477.009625:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009631:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e38332d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444477.009643:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d25d708b reply state 00000000e4476ac4 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009651:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.009657:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9368dccae200) 00010000:00010000:0.0:1783444477.009660:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444477.009661:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783444477.014396:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71984:x1870073557826432:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 12155us (12547us total) trans 120259084292 rc 0/0 00000100:00100000:0.0:1783444477.014409:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1364 00000100:00100000:2.0:1783444477.025858:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444477.029125:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557826560 00000100:00100000:1.0:1783444477.029138:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557826560 00000100:00100000:1.0:1783444477.029207:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1365 00000100:00100000:1.0:1783444477.029216:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71984:x1870073557826560:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:1.0:1783444477.029238:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444477.029257:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e38332eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d58 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.029324:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38332f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.029338:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38332f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.029349:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38332f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444477.029398:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783444477.029402:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444477.029424:0:71469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38332f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.029451:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e38332eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d58 expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.029466:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38332f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d58 expref: 9 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.029475:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:1.0:1783444477.029478:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444477.029481:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26200, rc 0) 00000100:00100000:1.0:1783444477.029546:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71984:x1870073557826560:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 331us (3697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.029555:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1365 00000100:00100000:1.0:1783444477.038371:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444477.039407:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557826816 00000100:00100000:3.0:1783444477.039419:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557826816 00000100:00100000:3.0:1783444477.039492:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1366 00000100:00100000:3.0:1783444477.039504:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71984:x1870073557826816:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:3.0:1783444477.039527:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444477.039552:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e38332f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d5f expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.039814:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.039829:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.039840:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.039852:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.039859:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.039865:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444477.040009:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783444477.040085:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040094:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040101:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040108:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040114:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444477.040118:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040125:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040137:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:3.0:1783444477.040140:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444477.040145:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040152:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a000/0x42cb6883e3833300 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040169:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040184:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040190:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040195:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444477.040198:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040204:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040212:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9368dccae200) 00010000:00010000:3.0:1783444477.040215:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444477.040218:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040223:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833307 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040259:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e38332f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d5f expref: 11 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040268:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:3.0:1783444477.040270:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783444477.040273:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e38332f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d5f expref: 11 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.040295:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513b400, rc 0) 00000100:00100000:3.0:1783444477.040363:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71984:x1870073557826816:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 861us (2400us total) trans 120259084293 rc 301/301 00000100:00100000:3.0:1783444477.040370:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1366 00000100:00100000:1.0:1783444477.043129:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444477.043322:0:66244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557826944 00000100:00100000:3.0:1783444477.043332:0:66244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557826944 00000100:00100000:3.0:1783444477.043381:0:66244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1783444477.043391:0:66244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:08efc25c-17e5-4d29-97d2-f1505f195a06+5:71984:x1870073557826944:12345-192.168.204.20@tcp:900:mkdir.0 00000100:00100000:3.0:1783444477.043471:0:66244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:08efc25c-17e5-4d29-97d2-f1505f195a06+5:71984:x1870073557826944:12345-192.168.204.20@tcp:900:mkdir.0 Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.043478:0:66244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1783444477.046104:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444477.046162:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557827200 00000100:00100000:1.0:1783444477.046170:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557827200 00000100:00100000:1.0:1783444477.046226:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 240 00000100:00100000:1.0:1783444477.046235:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71984:x1870073557827200:12345-192.168.204.20@tcp:35:mkdir.0 00000100:00100000:0.0:1783444477.046508:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+11:71984:x1870073557827200:12345-192.168.204.20@tcp:35:mkdir.0 Request processed in 273us (410us total) trans 120259084294 rc 0/0 00000100:00100000:0.0:1783444477.046516:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 240 00000100:00100000:1.0:1783444477.049853:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444477.049925:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557827456 00000100:00100000:3.0:1783444477.049935:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557827456 00000100:00100000:3.0:1783444477.049999:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1367 00000100:00100000:3.0:1783444477.050009:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+5:71984:x1870073557827456:12345-192.168.204.20@tcp:36:mkdir.0 00000100:00100000:3.0:1783444477.050351:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575386624:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783444477.050402:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444477.050430:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c349c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444477.050447:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575386624 00000100:00100000:3.0:1783444477.050451:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575386624 00000100:00100000:3.0:1783444477.050479:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:3.0:1783444477.050484:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66226:x1870073575386624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783444477.050552:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66226:x1870073575386624:12345-0@lo:1000:mdt00_002.0 Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.050568:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:3.0:1783444477.050610:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575386624:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783444477.050668:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575386752:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783444477.050691:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444477.050708:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6990f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444477.050721:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575386752 00000100:00100000:3.0:1783444477.050724:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575386752 00000100:00100000:3.0:1783444477.050748:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1783444477.050753:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66226:x1870073575386752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783444477.050898:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66226:x1870073575386752:12345-0@lo:1000:mdt00_002.0 Request processed in 136us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.050905:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:0.0:1783444477.056081:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575386752:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783444477.056453:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575386880:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783444477.056519:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.056687:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6990f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444477.060810:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575386880 00000100:00100000:1.0:1783444477.060823:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575386880 00000100:00100000:0.0:1783444477.061312:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1783444477.061323:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66226:x1870073575386880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783444477.061476:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66226:x1870073575386880:12345-0@lo:1000:mdt00_002.0 Request processed in 154us (4955us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444477.061484:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1783444477.061536:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575386880:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783444477.061701:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.061711:0:66226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.061721:0:66226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444477.061741:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387008:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1783444477.061775:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.061814:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bb7000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444477.062769:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575387008 00000100:00100000:3.0:1783444477.062777:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575387008 00000100:00100000:3.0:1783444477.062837:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:3.0:1783444477.062845:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66226:x1870073575387008:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783444477.062860:0:29151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444477.062877:0:29151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833315 expref: -99 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.062915:0:29151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 2/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.062925:0:29151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833315 expref: 9 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.062941:0:29151:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1783444477.067710:0:29151:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1783444477.067779:0:29151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833315 expref: 9 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.067808:0:29151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860000) 00010000:00010000:3.0:1783444477.067812:0:29151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444477.067816:0:29151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833315 expref: 9 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.067826:0:29151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513b400, rc 0) 00000100:00100000:3.0:1783444477.067914:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387008:12345-0@lo:101:mdt00_002.0 Request processed in 5068us (6137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.067924:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:3.0:1783444477.068003:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387008:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1783444477.068022:0:66226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.068032:0:66226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783444477.070494:0:92438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084294 is committed 00000001:00080000:1.0:1783444477.070523:0:92438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084291 is committed 00010000:00010000:0.0:1783444477.070574:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.070588:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088725:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088735:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444477.088740:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088768:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088814:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9368dccae200) 00010000:00010000:0.0:1783444477.088818:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444477.088823:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088830:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e38332dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088859:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088866:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088872:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088878:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444477.088880:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088885:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088905:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860000) 00010000:00010000:0.0:1783444477.088907:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444477.088915:0:3620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833315 expref: 7 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088932:0:3620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x42cb6883e3833315 expref: 7 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088941:0:3620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x42cb6883e3833315 expref: 7 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.088990:0:3620:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833315 expref: 7 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444477.089007:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3620:1870073575387136:0@lo:105: 00000100:00100000:0.0:1783444477.089075:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.089123:0:3620:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bb7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.089314:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575387136 00000100:00100000:2.0:1783444477.089322:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575387136 00000100:00100000:2.0:1783444477.089399:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1783444477.089409:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3620:x1870073575387136:12345-0@lo:105: 00010000:00010000:2.0:1783444477.089420:0:6488:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.089431:0:6488:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.089440:0:6488:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.089449:0:6488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.089457:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.089466:0:6488:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.089493:0:6488:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9367caf90200) 00000100:00100000:2.0:1783444477.089539:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3620:x1870073575387136:12345-0@lo:105: Request processed in 131us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.089546:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783444477.089875:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3620:1870073575387136:0@lo:105: 00010000:00010000:0.0:1783444477.089905:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.089912:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38332e4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.089936:0:66226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.089944:0:66226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783444477.089964:0:66226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1783444477.090003:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.090019:0:66226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.090029:0:66226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444477.090043:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387264:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1783444477.090217:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.090243:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bb7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.090390:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575387264 00000100:00100000:2.0:1783444477.090397:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575387264 00000100:00100000:2.0:1783444477.090434:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1783444477.090446:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66226:x1870073575387264:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1783444477.090463:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444477.090477:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e383332a lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833323 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.090497:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e383332a lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833323 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.090510:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e383332a lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833323 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.090517:0:8430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9368c59a7400) 00010000:00010000:2.0:1783444477.090520:0:8430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444477.090523:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030600, rc 0) 00000100:00100000:2.0:1783444477.090556:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387264:12345-0@lo:101:mdt00_002.0 Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.090563:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:0.0:1783444477.090875:0:66226:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084291 gen 3 00000004:00080000:0.0:1783444477.090882:0:66226:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084291 committed transno 120259084291 00000100:00100000:0.0:1783444477.090916:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387264:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1783444477.090929:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.090940:0:66226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783444477.090953:0:66226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:0.0:1783444477.090992:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387392:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783444477.091028:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.091047:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bb7000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.091194:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575387392 00000100:00100000:2.0:1783444477.091198:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575387392 00000100:00100000:2.0:1783444477.091237:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:2.0:1783444477.091243:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783444477.091323:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387392:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.091331:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:0.0:1783444477.091453:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387392:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783444477.091500:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387520:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783444477.091525:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.091579:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.092007:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575387520 00000100:00100000:2.0:1783444477.092012:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575387520 00000100:00100000:0.0:1783444477.092132:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:0.0:1783444477.092139:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783444477.092226:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387520:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (699us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444477.092233:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:1.0:1783444477.092284:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387520:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783444477.092359:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387648:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783444477.092394:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.092491:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.092519:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575387648 00000100:00100000:2.0:1783444477.092523:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575387648 00000100:00100000:2.0:1783444477.092811:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:2.0:1783444477.092820:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387648:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783444477.092899:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387648:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (493us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783444477.092907:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:2.0:1783444477.093043:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387648:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783444477.093096:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387776:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783444477.093125:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444477.093181:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d08bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444477.093232:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575387776 00000100:00100000:1.0:1783444477.093237:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575387776 00000100:00100000:1.0:1783444477.093270:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:1.0:1783444477.093277:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783444477.093325:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387776:12345-0@lo:1000:mdt00_002.0 Request processed in 47us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.093331:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:2.0:1783444477.093391:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387776:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783444477.093434:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387904:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783444477.093457:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444477.093480:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d08bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444477.093516:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575387904 00000100:00100000:1.0:1783444477.093520:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575387904 00000100:00100000:1.0:1783444477.093548:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:1.0:1783444477.093555:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783444477.093707:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575387904:12345-0@lo:1000:mdt00_002.0 Request processed in 152us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.093714:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:2.0:1783444477.093948:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575387904:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783444477.093987:0:66226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575388032:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783444477.094010:0:66226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444477.094035:0:66226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d08bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444477.094087:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575388032 00000100:00100000:1.0:1783444477.094092:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575388032 00000100:00100000:1.0:1783444477.094121:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1783444477.094127:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575388032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783444477.094180:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66226:x1870073575388032:12345-0@lo:1000:mdt00_002.0 Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.094186:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:2.0:1783444477.094340:0:66226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66226:1870073575388032:0@lo:1000:mdt00_002.0 00000040:00080000:2.0:1783444477.095034:0:66226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].3, 968 off35168 00000040:00080000:2.0:1783444477.095097:0:66226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].3, 1120 off35552 00000004:00080000:2.0:1783444477.095104:0:66226:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9368d08bd240 with version 11 00000004:00080000:1.0:1783444477.095201:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 11 rpc_version 11 00000020:00100000:1.0:1783444477.095226:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783444477.095234:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367c71d1500 x1870073575388288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444477.095250:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575388288:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783444477.095287:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.095306:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.095430:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575388288 00000100:00100000:2.0:1783444477.095435:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575388288 00000100:00100000:2.0:1783444477.095484:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:2.0:1783444477.095491:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75656:x1870073575388288:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1783444477.096265:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75656:x1870073575388288:12345-0@lo:1000:osp_up0-1.0 Request processed in 771us (974us total) trans 120259084295 rc 0/0 00000100:00100000:2.0:1783444477.096274:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:1.0:1783444477.096382:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575388288:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783444477.096488:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.096504:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.096518:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444477.096536:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b85f9b9f reply state 000000002fdd8a05 transno 77309411455 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.096547:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.096554:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368c59a7b00) 00010000:00010000:2.0:1783444477.096556:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444477.096560:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783444477.096565:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00080000:2.0:1783444477.096573:0:66226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1783444477.096583:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.096883:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.096903:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.096936:0:66226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1783444477.096943:0:66226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1783444477.096948:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.096956:0:66226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444477.097043:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557827456:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 47033us (47202us total) trans 77309411455 rc 0/0 00000100:00100000:2.0:1783444477.097051:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1367 00010000:00010000:1.0:1783444477.097209:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444477.097216:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.097224:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90200 already unused, calling callback (ffffffffc184ceb0) 00010000:00010000:1.0:1783444477.097229:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444477.097238:0:6494:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.097267:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.097274:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444477.097304:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.097311:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90200/0x42cb6883e3833315 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e383331c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.097343:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444477.097344:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444477.097346:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444477.097397:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575388416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444477.097441:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.097526:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575388416 00000100:00100000:1.0:1783444477.097534:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575388416 00000100:00100000:2.0:1783444477.097841:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1783444477.097851:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3634:x1870073575388416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444477.097867:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444477.097885:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e383331c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833315 expref: 10 pid: 29151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.097910:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860000) 00010000:00010000:2.0:1783444477.097918:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444477.097958:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3634:x1870073575388416:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.097964:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1783444477.098052:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575388416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444477.103307:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444477.103394:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557827712 00000100:00100000:0.0:1783444477.103404:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557827712 00000100:00100000:0.0:1783444477.103460:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1368 00000100:00100000:0.0:1783444477.103470:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557827712:12345-192.168.204.20@tcp:36:mkdir.0 00010000:00010000:0.0:1783444477.103536:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444477.103564:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38332f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d58 expref: 7 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.103579:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:0.0:1783444477.103585:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444477.103714:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71984:x1870073557827712:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 244us (415us total) trans 0 rc -17/-17 00000100:00100000:0.0:1783444477.103721:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1368 00000100:00100000:2.0:1783444477.107513:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444477.107635:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557827840 00000100:00100000:0.0:1783444477.107645:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557827840 00000100:00100000:0.0:1783444477.107704:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1369 00000100:00100000:0.0:1783444477.107714:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71984:x1870073557827840:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:0.0:1783444477.107736:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444477.107758:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d66 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.108239:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383333f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.108255:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383333f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.108269:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383333f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444477.108319:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444477.108324:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444477.108346:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383333f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.108385:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d66 expref: 8 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.108402:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383333f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d66 expref: 7 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.108410:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:2.0:1783444477.108413:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444477.108417:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031c00, rc 0) 00000100:00100000:2.0:1783444477.108521:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557827840:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 807us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.108529:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1369 00000100:00100000:1.0:1783444477.115908:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444477.115997:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557827968 00000100:00100000:0.0:1783444477.116017:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557827968 00000100:00100000:0.0:1783444477.116075:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1370 00000100:00100000:0.0:1783444477.116085:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557827968:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:0.0:1783444477.116120:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444477.116141:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d6d expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116218:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116232:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116243:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116256:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116263:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116269:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116345:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116354:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116361:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444477.116416:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444477.116420:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444477.116440:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116454:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116461:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116467:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116473:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116479:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444477.116483:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116491:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116504:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:0.0:1783444477.116507:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444477.116512:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116518:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383334d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116542:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116548:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116554:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116559:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444477.116562:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116568:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116576:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9368e7860100) 00010000:00010000:0.0:1783444477.116578:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444477.116581:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116587:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833354 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116615:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 9 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116628:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 8 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.116646:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860900) 00010000:00010000:0.0:1783444477.116649:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444477.116651:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90e00, rc 0) 00000100:00100000:0.0:1783444477.116716:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71984:x1870073557827968:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 632us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444477.116723:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1370 00000100:00100000:1.0:1783444477.125633:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444477.126916:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557828224 00000100:00100000:0.0:1783444477.126928:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557828224 00000100:00100000:0.0:1783444477.126994:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1371 00000100:00100000:0.0:1783444477.127003:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71984:x1870073557828224:12345-192.168.204.20@tcp:36:mkdir.0 00000100:00100000:0.0:1783444477.127268:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575388544:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444477.127328:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.127366:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bb7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.127446:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575388544 00000100:00100000:2.0:1783444477.127451:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575388544 00000100:00100000:2.0:1783444477.127485:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:2.0:1783444477.127492:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:80475:x1870073575388544:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783444477.127585:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:80475:x1870073575388544:12345-0@lo:1000:mdt00_005.0 Request processed in 93us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.127593:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:0.0:1783444477.127677:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575388544:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444477.127723:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575388672:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444477.127745:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.127769:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bb7000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.127866:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575388672 00000100:00100000:2.0:1783444477.127870:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575388672 00000100:00100000:2.0:1783444477.127906:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:2.0:1783444477.127913:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:80475:x1870073575388672:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783444477.127999:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:80475:x1870073575388672:12345-0@lo:1000:mdt00_005.0 Request processed in 86us (252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783444477.128006:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:2.0:1783444477.128031:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575388672:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1783444477.128087:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.128112:0:80475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.128124:0:80475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444477.128136:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575388800:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1783444477.128172:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444477.128188:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d08bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.128199:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575388800 00000100:00100000:2.0:1783444477.128203:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575388800 00000100:00100000:2.0:1783444477.128222:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:2.0:1783444477.128228:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:80475:x1870073575388800:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1783444477.128238:0:23687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444477.128263:0:23687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833369 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833362 expref: -99 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.128288:0:23687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 7 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.128298:0:23687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833369 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833362 expref: 10 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.128323:0:23687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 7 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.128337:0:23687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 7 pid: 66223 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444477.128351:0:23687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23687:1870073575388928:192.168.204.20@tcp:104: 00000100:00100000:2.0:1783444477.128415:0:23687:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4df9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444477.131676:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444477.131941:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557828352 00000100:00100000:1.0:1783444477.131950:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557828352 00010000:00010000:1.0:1783444477.132000:0:19646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 5/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 8 pid: 66223 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444477.132032:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2578 00000100:00100000:1.0:1783444477.132040:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557828352:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444477.132053:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444477.132059:0:19646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 5/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 8 pid: 66223 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.132072:0:19646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 8 pid: 66223 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.132104:0:19646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860900) 00010000:00010000:1.0:1783444477.132112:0:19646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833369 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833362 expref: 10 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.132122:0:19646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833369 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x42cb6883e3833362 expref: 10 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.132143:0:19646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833369 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x42cb6883e3833362 expref: 10 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.132376:0:19646:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833369 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833362 expref: 10 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444477.132389:0:19646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3809f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19646:1870073575389056:0@lo:105: 00000100:00100000:1.0:1783444477.132433:0:19646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.132482:0:19646:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444477.132526:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575389056 00000100:00100000:3.0:1783444477.132532:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575389056 00010000:00010000:2.0:1783444477.132576:0:23687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383335b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d6d expref: 8 pid: 66223 timeout: 3568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444477.132595:0:23687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23687:1870073575388928:192.168.204.20@tcp:104: 00000100:00100000:3.0:1783444477.132600:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1783444477.132611:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f973d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19646:x1870073575389056:12345-0@lo:105: 00010000:00010000:2.0:1783444477.132624:0:23687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833369 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833362 expref: 10 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.132629:0:6488:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.132633:0:23687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860900) 00010000:00010000:2.0:1783444477.132640:0:23687:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444477.132644:0:23687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030000, rc 0) 00010000:00010000:3.0:1783444477.132645:0:6488:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.132657:0:6488:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.132666:0:6488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.132673:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.132682:0:6488:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.132698:0:6488:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9368c0031400) 00000100:00100000:2.0:1783444477.132710:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:80475:x1870073575388800:12345-0@lo:101:mdt00_005.0 Request processed in 4479us (4535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.132718:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:3.0:1783444477.132746:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f973d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:19646:x1870073575389056:12345-0@lo:105: Request processed in 134us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.132753:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1783444477.132786:0:19646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3809f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19646:1870073575389056:0@lo:105: 00010000:00010000:3.0:1783444477.132826:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444477.132834:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575388800:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783444477.132853:0:80475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444477.132879:0:80475:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:3.0:1783444477.132884:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557828352:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 842us (1214us total) trans 0 rc 0/0 00010000:00010000:1.0:1783444477.132924:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.132932:0:80475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.132940:0:80475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444477.132957:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2578 00000100:00100000:1.0:1783444477.132957:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389184:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1783444477.133444:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.133470:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783444477.134122:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575389184 00000100:00100000:3.0:1783444477.134130:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575389184 00000100:00100000:3.0:1783444477.134178:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:3.0:1783444477.134187:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:80475:x1870073575389184:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1783444477.134205:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444477.134224:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833377 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833370 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.134247:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833377 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833370 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.134258:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833377 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833370 expref: 11 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.134267:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9368c3254f00) 00010000:00010000:3.0:1783444477.134270:0:8431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444477.134274:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a200, rc 0) 00000100:00100000:3.0:1783444477.134323:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389184:12345-0@lo:101:mdt00_005.0 Request processed in 136us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.134329:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00100000:1.0:1783444477.134683:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389184:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1783444477.134712:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.134723:0:80475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444477.134747:0:80475:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:1.0:1783444477.135315:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389312:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.135360:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.135457:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783444477.147764:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575389312 00000100:00100000:0.0:1783444477.147781:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575389312 00000100:00100000:0.0:1783444477.147874:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:0.0:1783444477.147897:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389312:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444477.148041:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389312:12345-0@lo:1000:mdt00_005.0 Request processed in 157us (12680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444477.148049:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:1.0:1783444477.149685:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389312:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.149775:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389440:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.149857:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.149899:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.149981:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575389440 00000100:00100000:2.0:1783444477.149988:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575389440 00000100:00100000:2.0:1783444477.150040:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:2.0:1783444477.150049:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389440:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783444477.150183:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389440:12345-0@lo:1000:mdt00_005.0 Request processed in 135us (326us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783444477.150191:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:1.0:1783444477.150482:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389440:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.150551:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389568:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.150576:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.150603:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783444477.150724:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575389568 00000100:00100000:0.0:1783444477.150728:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575389568 00000100:00100000:0.0:1783444477.150765:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:0.0:1783444477.150773:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389568:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444477.150868:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389568:12345-0@lo:1000:mdt00_005.0 Request processed in 96us (290us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444477.150876:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1783444477.150957:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389568:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.151015:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389696:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.151052:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.151080:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444477.151193:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575389696 00000100:00100000:3.0:1783444477.151199:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575389696 00000100:00100000:3.0:1783444477.151229:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:3.0:1783444477.151237:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389696:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1783444477.151308:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389696:12345-0@lo:1000:mdt00_005.0 Request processed in 71us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.151315:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:1.0:1783444477.151652:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389696:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.151699:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389824:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.151742:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.151768:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783444477.151826:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575389824 00000100:00100000:0.0:1783444477.151831:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575389824 00000100:00100000:0.0:1783444477.151864:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1783444477.151871:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389824:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1783444477.151953:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389824:12345-0@lo:1000:mdt00_005.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444477.151959:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:1.0:1783444477.152083:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cb239180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389824:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.152138:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389952:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444477.152377:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.152401:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c595b000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444477.152463:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575389952 00000100:00100000:2.0:1783444477.152468:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575389952 00000100:00100000:2.0:1783444477.152502:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:2.0:1783444477.152509:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389952:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783444477.152572:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:80475:x1870073575389952:12345-0@lo:1000:mdt00_005.0 Request processed in 64us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.152579:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:1.0:1783444477.152685:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:80475:1870073575389952:0@lo:1000:mdt00_005.0 00000040:00080000:1.0:1783444477.153507:0:80475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d4:0x1:0x0].4, 968 off36136 00000040:00080000:1.0:1783444477.153771:0:80475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000cf21:0x1:0x0].4, 1120 off36672 00000004:00080000:1.0:1783444477.153777:0:80475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9368c595b540 with version 12 00000004:00080000:3.0:1783444477.153933:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 12 rpc_version 12 00000020:00100000:3.0:1783444477.153974:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783444477.153983:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367ccd90a80 x1870073575390208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444477.154005:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575390208:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1783444477.154054:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444477.154086:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0286600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444477.154151:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575390208 00000100:00100000:0.0:1783444477.154158:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575390208 00000100:00100000:0.0:1783444477.154200:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:0.0:1783444477.154208:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75656:x1870073575390208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783444477.154558:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75656:x1870073575390208:12345-0@lo:1000:osp_up0-1.0 Request processed in 350us (503us total) trans 120259084296 rc 0/0 00000100:00100000:0.0:1783444477.154566:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1783444477.158266:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575390208:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1783444477.158762:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.158779:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.158826:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444477.158848:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006619480c reply state 00000000439a9bbd transno 77309411456 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.158882:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.158902:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c59a7d00) 00010000:00010000:2.0:1783444477.158905:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444477.158909:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783444477.158915:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00080000:2.0:1783444477.158926:0:80475:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1783444477.158941:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.158950:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.158957:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.159081:0:80475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783444477.159089:0:80475:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1783444477.159109:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.159117:0:80475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444477.159233:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71984:x1870073557828224:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 32227us (33606us total) trans 77309411456 rc 0/0 00000100:00100000:3.0:1783444477.159242:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1371 00010000:00010000:0.0:1783444477.159647:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444477.159656:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.159665:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031400 already unused, calling callback (ffffffffc184ceb0) 00010000:00010000:0.0:1783444477.159671:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444477.159688:0:10324:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.159723:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.159730:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444477.159765:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.159773:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368c0031400/0x42cb6883e3833362 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833369 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.159820:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444477.159822:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444477.159824:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444477.160003:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575390336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444477.160054:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444477.160472:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575390336 00000100:00100000:1.0:1783444477.160480:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575390336 00000100:00100000:1.0:1783444477.160543:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1783444477.160552:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3635:x1870073575390336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444477.160567:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444477.160586:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833369 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833362 expref: 12 pid: 23687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.160601:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860900) 00010000:00010000:1.0:1783444477.160609:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444477.160660:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3635:x1870073575390336:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.160667:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1783444477.160725:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575390336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444477.202118:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444477.202296:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557828480 00000100:00100000:2.0:1783444477.202308:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557828480 00000100:00100000:2.0:1783444477.202371:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1372 00000100:00100000:2.0:1783444477.202382:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71986:x1870073557828480:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444477.202405:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444477.202431:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031000/0x42cb6883e3833385 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d74 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.202496:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.202523:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.202537:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.202553:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.202561:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.202568:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.203061:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e383339a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.203072:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e383339a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.203080:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e383339a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444477.203125:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444477.203129:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444477.203172:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e383339a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206007:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206047:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206053:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206061:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206066:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444477.206071:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206078:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206104:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:2.0:1783444477.206108:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444477.206112:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206118:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e383338c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206135:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206141:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206147:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206158:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444477.206162:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206169:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206189:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9368c59a7f00) 00010000:00010000:2.0:1783444477.206192:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444477.206195:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206200:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030000/0x42cb6883e3833393 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206252:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031000/0x42cb6883e3833385 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d74 expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206266:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e383339a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d74 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.206273:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368c59a7a00) 00010000:00010000:2.0:1783444477.206276:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783444477.206278:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031400, rc 0) 00000100:00100000:3.0:1783444477.207039:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71986:x1870073557828480:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 4655us (4941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.207048:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1372 00000100:00100000:1.0:1783444477.212645:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444477.213175:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557828608 00000100:00100000:0.0:1783444477.213188:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557828608 00000100:00100000:0.0:1783444477.213259:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1373 00000100:00100000:0.0:1783444477.213269:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71986:x1870073557828608:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444477.213291:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444477.213314:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38333a1 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d7b expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.213384:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.213399:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.213425:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.213437:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.213447:0:66223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e383332a lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833323 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.213456:0:66223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.213488:0:66223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e383332a lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833323 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444477.213504:0:66223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575390464:0@lo:104: 00000100:00100000:0.0:1783444477.213552:0:66223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.213585:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bb7000 going to sleep for 11 seconds 00000100:00100000:1.0:1783444477.214281:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575390464 00000100:00100000:1.0:1783444477.214296:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575390464 00000100:00100000:1.0:1783444477.214345:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1783444477.214353:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66223:x1870073575390464:12345-0@lo:104: 00010000:00010000:1.0:1783444477.214366:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.214437:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444477.214443:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66223:x1870073575390464:12345-0@lo:104: Request processed in 92us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.214450:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00010000:1.0:1783444477.214474:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444477.214480:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.214487:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90000 already unused, calling callback (ffffffffc184ceb0) 00010000:00010000:1.0:1783444477.214492:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444477.214500:0:10323:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.214525:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.214531:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444477.214551:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.214559:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367caf90000/0x42cb6883e3833323 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383332a expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.214582:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444477.214584:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444477.214586:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444477.214598:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575390592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444477.214630:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444477.214943:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575390592 00000100:00100000:3.0:1783444477.214949:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575390592 00010000:00010000:3.0:1783444477.214980:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e383332a lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x42cb6883e3833323 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444477.215005:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1783444477.215019:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cb239180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3636:x1870073575390592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444477.215030:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783444477.216308:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66223:1870073575390464:0@lo:104: 00010000:00010000:2.0:1783444477.216334:0:66223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783444477.233920:0:92438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084296 is committed 00010000:00010000:3.0:1783444477.234165:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030600/0x42cb6883e383332a lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833323 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.234187:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9368c59a7400) 00010000:00010000:3.0:1783444477.234193:0:6492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.234202:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.234210:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.234245:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444477.234313:0:66223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.234323:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444477.234329:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cb239180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3636:x1870073575390592:12345-0@lo:103:ldlm_bl.0 Request processed in 19307us (19694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.234340:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:2.0:1783444477.234782:0:66223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66223:1870073575390720:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783444477.234880:0:66223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444477.234924:0:66223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0e5eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444477.235081:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575390592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444477.235541:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575390720 00000100:00100000:3.0:1783444477.235548:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575390720 00000100:00100000:3.0:1783444477.235595:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:3.0:1783444477.235604:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66223:x1870073575390720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783444477.235707:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66223:x1870073575390720:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.235715:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:1.0:1783444477.235970:0:66223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66223:1870073575390720:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783444477.236022:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38333b6 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236037:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38333b6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236048:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38333b6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444477.236072:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38333b6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236087:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236093:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236099:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236106:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236127:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444477.236131:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236139:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236153:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368c59a7a00) 00010000:00010000:1.0:1783444477.236156:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444477.236160:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236167:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e38333a8 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236180:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236186:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236191:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236196:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444477.236198:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236204:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236222:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9368c59a7400) 00010000:00010000:1.0:1783444477.236225:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444477.236228:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236233:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e38333af lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236271:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e38333a1 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d7b expref: 10 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236285:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38333b6 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d7b expref: 9 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.236292:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368dccae200) 00010000:00010000:1.0:1783444477.236294:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444477.236297:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27e00, rc 0) 00000100:00100000:1.0:1783444477.236354:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71986:x1870073557828608:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 23085us (23719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.236361:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1373 00000100:00100000:3.0:1783444477.242274:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444477.242914:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557828736 00000100:00100000:1.0:1783444477.242928:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557828736 00000100:00100000:1.0:1783444477.242992:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1374 00000100:00100000:1.0:1783444477.243002:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71986:x1870073557828736:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444477.243028:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444477.243049:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e38333bd lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d82 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.243131:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27400/0x42cb6883e38333c4 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.243144:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27400/0x42cb6883e38333c4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.243156:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27400/0x42cb6883e38333c4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444477.243205:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1783444477.243208:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1783444477.243241:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e38333bd lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d82 expref: 11 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.243258:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27400/0x42cb6883e38333c4 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d82 expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.243267:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368c59a7b00) 00010000:00010000:1.0:1783444477.243270:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783444477.243274:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27400, rc 0) 00000100:00100000:1.0:1783444477.243331:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71986:x1870073557828736:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 330us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.243337:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1374 00000100:00100000:3.0:1783444477.263007:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444477.263174:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557828992 00000100:00100000:0.0:1783444477.263185:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557828992 00000100:00100000:0.0:1783444477.263247:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1375 00000100:00100000:0.0:1783444477.263258:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71986:x1870073557828992:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444477.263279:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444477.263303:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf90a00/0x42cb6883e38333cb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d89 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444477.263432:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783444477.263537:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf90a00/0x42cb6883e38333cb lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d89 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.263565:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368e7860100) 00010000:00010000:0.0:1783444477.263568:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783444477.263574:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf90a00/0x42cb6883e38333cb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d89 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.263593:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90a00, rc 0) 00000100:00100000:0.0:1783444477.263875:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+11:71986:x1870073557828992:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 618us (877us total) trans 77309411457 rc 301/301 00000100:00100000:0.0:1783444477.263894:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1375 00000100:00100000:0.0:1783444477.298231:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444477.298319:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557829248 00000100:00100000:3.0:1783444477.298342:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557829248 00000100:00100000:3.0:1783444477.298410:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1376 00000100:00100000:3.0:1783444477.298420:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:71986:x1870073557829248:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:3.0:1783444477.298479:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444477.298506:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27400/0x42cb6883e38333c4 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d82 expref: 11 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.298525:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368c59a7b00) 00010000:00010000:3.0:1783444477.298530:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444477.298550:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.298562:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.298572:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444477.298731:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c719098c reply state 000000004ebb034c transno 77309411458 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.298744:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.298751:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368c59a7b00) 00010000:00010000:3.0:1783444477.298754:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1783444477.298756:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783444477.298763:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000100:00100000:3.0:1783444477.299282:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+12:71986:x1870073557829248:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 861us (1059us total) trans 77309411458 rc 0/0 00000100:00100000:3.0:1783444477.299290:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1376 00000100:00100000:0.0:1783444477.301014:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444477.301087:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557829504 00000100:00100000:3.0:1783444477.301095:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557829504 00000100:00100000:3.0:1783444477.301146:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 241 00000100:00100000:3.0:1783444477.301155:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+12:71986:x1870073557829504:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1783444477.301334:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+13:71986:x1870073557829504:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 180us (326us total) trans 77309411459 rc 0/0 00000100:00100000:3.0:1783444477.301342:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 241 00000100:00100000:1.0:1783444477.333172:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444477.333339:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557829632 00000100:00100000:0.0:1783444477.333349:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557829632 00000100:00100000:0.0:1783444477.333418:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1377 00000100:00100000:0.0:1783444477.333429:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71987:x1870073557829632:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444477.333451:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444477.333472:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90400/0x42cb6883e38333e0 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d90 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.333540:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.333554:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.333565:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.333595:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.333605:0:71469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833377 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833370 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.333612:0:71469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.333644:0:71469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833377 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833370 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444477.333657:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:71469:1870073575390848:0@lo:104: 00000100:00100000:0.0:1783444477.333701:0:71469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.333740:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c6bb7000 going to sleep for 11 seconds 00000100:00100000:1.0:1783444477.334000:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575390848 00000100:00100000:1.0:1783444477.334005:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575390848 00000100:00100000:1.0:1783444477.334055:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1783444477.334063:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:71469:x1870073575390848:12345-0@lo:104: 00010000:00010000:1.0:1783444477.334084:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.334216:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444477.334222:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:71469:x1870073575390848:12345-0@lo:104: Request processed in 160us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.334229:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00010000:3.0:1783444477.334291:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444477.334299:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.334307:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26c00 already unused, calling callback (ffffffffc184ceb0) 00010000:00010000:3.0:1783444477.334311:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444477.334319:0:6493:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.334345:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.334352:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783444477.334391:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.334398:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9367c6c26c00/0x42cb6883e3833370 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833377 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.334432:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444477.334434:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444477.334435:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444477.334443:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444477.334454:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575390976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444477.334487:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444477.334517:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575390976 00000100:00100000:3.0:1783444477.334520:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575390976 00010000:00010000:3.0:1783444477.334537:0:8436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833377 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x42cb6883e3833370 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444477.334558:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1783444477.334564:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3634:x1870073575390976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444477.334573:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783444477.335221:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:71469:1870073575390848:0@lo:104: 00010000:00010000:2.0:1783444477.335243:0:71469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.337580:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a200/0x42cb6883e3833377 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833370 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.337603:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9368c3254f00) 00010000:00010000:2.0:1783444477.337609:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.337618:0:8436:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.337627:0:8436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444477.337663:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444477.337747:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575390976:12345-0@lo:103:ldlm_bl.0 Request processed in 3181us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444477.337756:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00010000:00010000:0.0:1783444477.338180:0:71469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.338190:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444477.338308:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:71469:1870073575391104:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783444477.338359:0:71469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444477.338470:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444477.338567:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575390976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444477.338633:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575391104 00000100:00100000:1.0:1783444477.338640:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575391104 00000100:00100000:1.0:1783444477.338686:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:1.0:1783444477.338694:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:71469:x1870073575391104:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783444477.338773:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:71469:x1870073575391104:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444477.338780:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:0.0:1783444477.339359:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:71469:1870073575391104:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1783444477.339421:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e38333f5 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339449:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e38333f5 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339462:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e38333f5 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444477.339489:0:71469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e38333f5 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339503:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339509:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339515:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339522:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339527:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444477.339532:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339539:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339551:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368c59a7a00) 00010000:00010000:0.0:1783444477.339554:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444477.339559:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339572:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91000/0x42cb6883e38333e7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339584:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339591:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339597:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339602:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444477.339605:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339612:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339620:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9368c3254f00) 00010000:00010000:0.0:1783444477.339623:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444477.339626:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339632:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90600/0x42cb6883e38333ee lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339671:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90400/0x42cb6883e38333e0 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d90 expref: 11 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339697:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e38333f5 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d90 expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444477.339704:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368e7860100) 00010000:00010000:0.0:1783444477.339707:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783444477.339709:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90a00, rc 0) 00000100:00100000:0.0:1783444477.340064:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71987:x1870073557829632:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 6635us (6900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444477.340073:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1377 00000100:00100000:0.0:1783444477.359828:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444477.359980:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557829760 00000100:00100000:3.0:1783444477.359990:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557829760 00000100:00100000:3.0:1783444477.360055:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1378 00000100:00100000:3.0:1783444477.360065:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+13:71987:x1870073557829760:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1783444477.360090:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444477.360123:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e38333fc lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d97 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.360182:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833403 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.360214:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833403 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.360226:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833403 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444477.360274:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783444477.360277:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783444477.360315:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e38333fc lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d97 expref: 15 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.360337:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833403 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d97 expref: 14 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.360359:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c59a7d00) 00010000:00010000:3.0:1783444477.360363:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783444477.360367:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a600, rc 0) 00000100:00100000:3.0:1783444477.360560:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+14:71987:x1870073557829760:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 496us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444477.360568:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1378 00000100:00100000:3.0:1783444477.368907:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444477.373343:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557830016 00000100:00100000:1.0:1783444477.373361:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557830016 00000100:00100000:1.0:1783444477.373458:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1379 00000100:00100000:1.0:1783444477.373470:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+14:71987:x1870073557830016:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1783444477.373492:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444477.373520:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27400/0x42cb6883e383340a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939d9e expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444477.373650:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783444477.373760:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27400/0x42cb6883e383340a lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d9e expref: 16 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.373775:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368dccaef00) 00010000:00010000:1.0:1783444477.373786:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444477.373839:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27400/0x42cb6883e383340a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d9e expref: 16 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444477.373868:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27400, rc 0) 00000100:00100000:1.0:1783444477.373942:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+15:71987:x1870073557830016:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 474us (5045us total) trans 77309411460 rc 301/301 00000100:00100000:1.0:1783444477.373951:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1379 00000100:00100000:1.0:1783444477.380299:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444477.380488:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557830272 00000100:00100000:3.0:1783444477.380499:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557830272 00000100:00100000:3.0:1783444477.380561:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1380 00000100:00100000:3.0:1783444477.380571:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+15:71987:x1870073557830272:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:3.0:1783444477.380633:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444477.380659:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833403 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d97 expref: 15 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.380692:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c59a7d00) 00010000:00010000:3.0:1783444477.380697:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444477.380720:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.380732:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.380743:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444477.381086:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000000f096d2 reply state 000000003cc1198f transno 77309411461 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.381212:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444477.381222:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c59a7d00) 00010000:00010000:3.0:1783444477.381224:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1783444477.381228:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783444477.381235:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1783444477.381354:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+16:71987:x1870073557830272:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 784us (1062us total) trans 77309411461 rc 0/0 00000100:00100000:3.0:1783444477.381363:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1380 00000100:00100000:1.0:1783444477.399291:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444477.399390:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557830528 00000100:00100000:0.0:1783444477.399401:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557830528 00000100:00100000:0.0:1783444477.399463:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 242 00000100:00100000:0.0:1783444477.399474:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+16:71987:x1870073557830528:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:0.0:1783444477.399700:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+17:71987:x1870073557830528:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 227us (417us total) trans 77309411462 rc 0/0 00000100:00100000:0.0:1783444477.399708:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 242 00010000:00010000:1.0:1783444477.981178:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783444478.472024:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411462 is committed 00010000:00010000:2.0:1783444478.472334:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472347:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472362:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472369:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444478.472374:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472384:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472402:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368c59a7b00) 00010000:00010000:2.0:1783444478.472405:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444478.472410:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472416:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0030a00/0x42cb6883e3833331 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472436:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472442:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472467:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472472:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444478.472475:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472481:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472490:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c59a7d00) 00010000:00010000:2.0:1783444478.472492:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444478.472495:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472500:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031600/0x42cb6883e383337e lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472524:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472531:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472536:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472542:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444478.472545:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472561:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472570:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368c59a7b00) 00010000:00010000:2.0:1783444478.472572:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783444478.472575:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472581:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e38333d9 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472603:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472609:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472615:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472620:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444478.472623:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472629:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472636:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c59a7d00) 00010000:00010000:2.0:1783444478.472639:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783444478.472641:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444478.472657:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e3833418 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444478.582335:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444478.585425:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557830656 00000100:00100000:2.0:1783444478.585439:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557830656 00000100:00100000:2.0:1783444478.585505:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1381 00000100:00100000:2.0:1783444478.585515:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71996:x1870073557830656:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1783444478.585553:0:67017:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444724736 avail 1298485248 00000100:00100000:2.0:1783444478.585629:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71996:x1870073557830656:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 114us (3300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444478.585636:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1381 00000100:00100000:1.0:1783444478.602741:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444478.603165:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557830784 00000100:00100000:3.0:1783444478.603176:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557830784 00000100:00100000:3.0:1783444478.603249:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1382 00000100:00100000:3.0:1783444478.603260:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+5:71996:x1870073557830784:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:3.0:1783444478.603303:0:66223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:3.0:1783444478.603386:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+5:71996:x1870073557830784:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 127us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444478.603394:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1382 00000100:00080000:1.0:1783444478.603884:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444478.613565:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444478.614934:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557830912 00000100:00100000:0.0:1783444478.614946:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557830912 00000100:00100000:0.0:1783444478.615010:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5908 00000100:00100000:0.0:1783444478.615018:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2400:x1870073557830912:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:0.0:1783444478.615053:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp 0000000000000000 cur 3469 last 0 00000020:00000080:0.0:1783444478.615085:0:26209:0:(genops.c:1406:class_connect()) connect: client 08efc25c-17e5-4d29-97d2-f1505f195a06, cookie 0x42cb6883e383341f 00002000:00100000:0.0:1783444478.615097:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 08efc25c-17e5-4d29-97d2-f1505f195a06/ffff9368dd225800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783444478.615122:0:26209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783444478.615198:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783444478.615234:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9368c518a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444478.615304:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557830912:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 285us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444478.615312:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5908 00000100:00100000:2.0:1783444478.624490:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444478.624576:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557831040 00000100:00100000:0.0:1783444478.624586:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557831040 00000100:00100000:0.0:1783444478.624661:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1980 00000100:00100000:0.0:1783444478.624671:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71996:x1870073557831040:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1783444478.624697:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444478.624765:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:71996:x1870073557831040:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444478.624773:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1980 00000100:00080000:2.0:1783444478.625197:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444478.628826:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444478.629267:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557831168 00000100:00100000:2.0:1783444478.629277:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557831168 00000100:00100000:2.0:1783444478.629358:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1981 00000100:00100000:2.0:1783444478.629370:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+5:71996:x1870073557831168:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444478.629403:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444478.629468:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+5:71996:x1870073557831168:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 100us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444478.629476:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1981 00000100:00080000:3.0:1783444478.636657:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444478.746634:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444478.761136:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557831424 00000100:00100000:1.0:1783444478.761154:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557831424 00000100:00100000:1.0:1783444478.761220:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1383 00000100:00100000:1.0:1783444478.761231:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+10:72003:x1870073557831424:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00010000:1.0:1783444478.761294:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444478.761323:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031c00/0x42cb6883e383333f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d66 expref: 10 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.761340:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:1.0:1783444478.761345:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444478.761412:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.761437:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.761448:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.761465:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.761473:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.761479:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762176:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762188:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762195:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762202:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762208:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444478.762213:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762221:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762240:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:1.0:1783444478.762242:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444478.762246:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762253:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e3833426 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444478.762265:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000844c651d reply state 0000000019ec0b10 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762275:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.762282:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367cd15c300) 00010000:00010000:1.0:1783444478.762284:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444478.762287:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444478.762395:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:72003:x1870073557831424:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 1164us (15770us total) trans 120259084297 rc 0/0 00000100:00100000:1.0:1783444478.762404:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1383 00000100:00100000:2.0:1783444478.828455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444478.828596:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557831552 00000100:00100000:3.0:1783444478.828607:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557831552 00000100:00100000:3.0:1783444478.828740:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1384 00000100:00100000:3.0:1783444478.828751:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+11:72006:x1870073557831552:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444478.828776:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444478.828824:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939da5 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.828903:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e383343b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.828918:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e383343b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.828930:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e383343b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444478.828974:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444478.828978:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444478.828999:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e383343b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.829025:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939da5 expref: 13 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.829066:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e383343b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939da5 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.829075:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:3.0:1783444478.829078:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444478.829082:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513bc00, rc 0) 00000100:00100000:3.0:1783444478.829201:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+12:72006:x1870073557831552:12345-192.168.204.20@tcp:101:rm.0 Request processed in 451us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444478.829209:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1384 00000100:00100000:1.0:1783444478.842132:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444478.842212:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557831680 00000100:00100000:3.0:1783444478.842222:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557831680 00000100:00100000:3.0:1783444478.842282:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1385 00000100:00100000:3.0:1783444478.842292:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb1fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+12:72006:x1870073557831680:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1783444478.842316:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444478.842340:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939dac expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842411:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842426:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842439:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842450:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842472:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842480:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842557:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833457 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842565:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833457 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842572:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833457 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444478.842615:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x3:0x0]: returning size 0 00000004:00200000:3.0:1783444478.842619:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444478.842635:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833457 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842645:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833457 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842654:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842661:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842681:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842697:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842702:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444478.842706:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842714:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842727:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:3.0:1783444478.842730:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444478.842733:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842739:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842752:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842758:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842763:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842767:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444478.842770:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842785:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842823:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367cd15c300) 00010000:00010000:3.0:1783444478.842826:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444478.842829:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842835:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b600/0x42cb6883e3833450 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842878:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dac expref: 14 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842892:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833457 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dac expref: 13 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444478.842899:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9368c3254600) 00010000:00010000:3.0:1783444478.842901:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444478.842904:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513ba00, rc 0) 00000100:00100000:3.0:1783444478.843028:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb1fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+13:72006:x1870073557831680:12345-192.168.204.20@tcp:101:rm.0 Request processed in 736us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444478.843036:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1385 00000100:00100000:0.0:1783444478.858755:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444478.858909:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557831936 00000100:00100000:1.0:1783444478.858919:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557831936 00000100:00100000:1.0:1783444478.858976:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1386 00000100:00100000:1.0:1783444478.858987:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+13:72006:x1870073557831936:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1783444478.859042:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783444478.859068:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833457 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dac expref: 13 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859103:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9368c3254600) 00010000:00010000:1.0:1783444478.859121:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e383343b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939da5 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859130:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:1.0:1783444478.859134:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444478.859155:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859168:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859178:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859190:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859197:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859203:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859555:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859565:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859583:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859776:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859882:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859894:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859901:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859909:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859916:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859938:0:80475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444478.859957:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859963:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859969:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859974:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444478.859986:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.859993:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860004:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9367cd15cd00) 00010000:00010000:1.0:1783444478.860006:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783444478.860010:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860015:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e383346c lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860032:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860038:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860044:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860050:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860056:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444478.860059:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860065:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860081:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:1.0:1783444478.860084:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444478.860086:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860093:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26e00/0x42cb6883e383345e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444478.860101:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e346cf4 reply state 00000000728794a8 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860111:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444478.860116:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367cd15c300) 00010000:00010000:1.0:1783444478.860119:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444478.860121:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444478.860204:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+13:72006:x1870073557831936:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1217us (1456us total) trans 120259084298 rc 0/0 00000100:00100000:1.0:1783444478.860212:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1386 00010000:00010000:0.0:1783444478.860626:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444478.860633:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444478.860640:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444478.860643:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444478.860651:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444478.860661:0:10324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9367cd15cd00) 00010000:00010000:0.0:1783444478.860671:0:10324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783444478.860675:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444478.860680:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833473 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444478.860699:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444478.860701:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444478.860703:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444479.007758:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444479.261028:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575391360:0@lo:400:kworker.0 00000100:00100000:2.0:1783444479.261240:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444479.261274:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575391872:0@lo:400:kworker.0 00000100:00100000:2.0:1783444479.261313:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444479.261330:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575392384:0@lo:400:kworker.0 00000100:00100000:2.0:1783444479.261513:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444479.261537:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783444479.261544:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575391488:0@lo:400:kworker.0 00000100:00100000:2.0:1783444479.261565:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444479.261584:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575392000:0@lo:400:kworker.0 00000100:00100000:2.0:1783444479.261604:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444479.261620:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575392512:0@lo:400:kworker.0 00000100:00100000:2.0:1783444479.261637:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444479.261672:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575391360 00000100:00100000:2.0:1783444479.261680:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575391360 00000100:00100000:2.0:1783444479.261726:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575391488 00000100:00100000:2.0:1783444479.261730:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575391488 00000100:00100000:2.0:1783444479.261749:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1783444479.266707:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575391360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.266951:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575391232:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.266999:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444479.267047:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575391744:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.267088:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444479.267120:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575392256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.267141:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444479.267157:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575392768:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.267181:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444479.267199:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783444479.267205:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575391616:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.267227:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444479.267239:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575392128:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.267263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444479.267283:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575392640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.267308:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444479.267604:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575391360:12345-0@lo:400:kworker.0 Request processed in 918us (6361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444479.267614:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1783444479.267637:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575392000 00000100:00100000:2.0:1783444479.267641:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575391744 00000100:00100000:2.0:1783444479.267647:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575391744 00000100:00100000:1.0:1783444479.267647:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575392000 00000100:00100000:2.0:1783444479.267684:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575392256 00000100:00100000:2.0:1783444479.267687:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575392256 00000100:00100000:1.0:1783444479.267694:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575392512 00000100:00100000:1.0:1783444479.267699:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575392512 00000100:00100000:2.0:1783444479.267708:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575392768 00000100:00100000:2.0:1783444479.267713:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575392768 00000100:00100000:1.0:1783444479.267728:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575392128 00000100:00100000:1.0:1783444479.267733:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575392128 00000100:00100000:2.0:1783444479.267734:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575391616 00000100:00100000:2.0:1783444479.267739:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575391616 00000100:00100000:1.0:1783444479.267759:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575392640 00000100:00100000:1.0:1783444479.267763:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575392640 00000100:00100000:2.0:1783444479.267769:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1783444479.267803:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575391488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444479.267895:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:1.0:1783444479.267910:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575392000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444479.268054:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575392000:12345-0@lo:400:kworker.0 Request processed in 145us (6447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444479.268062:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:1.0:1783444479.268082:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1783444479.268093:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575392512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.268094:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1783444479.268109:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575391744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.268199:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575391744:12345-0@lo:400:kworker.0 Request processed in 94us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444479.268206:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1783444479.268222:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1783444479.268227:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575392256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.268254:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575392256:12345-0@lo:400:kworker.0 Request processed in 27us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444479.268260:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1783444479.268272:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1783444479.268278:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575392768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.268399:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575392768:12345-0@lo:400:kworker.0 Request processed in 121us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444479.268415:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1783444479.268429:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1783444479.268436:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575391616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.268464:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575391616:12345-0@lo:400:kworker.0 Request processed in 29us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444479.268469:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1783444479.268491:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:3.0:1783444479.268498:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575392128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.268526:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575392128:12345-0@lo:400:kworker.0 Request processed in 29us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444479.268532:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:3.0:1783444479.268545:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:3.0:1783444479.268551:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575392640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.268595:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575391872 00000100:00100000:0.0:1783444479.268601:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575391872 00000100:00100000:0.0:1783444479.268631:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575392384 00000100:00100000:0.0:1783444479.268634:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575392384 00000100:00100000:0.0:1783444479.268653:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:0.0:1783444479.268659:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575391872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.269575:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575391872:12345-0@lo:400:kworker.0 Request processed in 912us (8257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444479.269585:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:0.0:1783444479.269606:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1783444479.269614:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575392384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.269650:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575392384:12345-0@lo:400:kworker.0 Request processed in 38us (8138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444479.269656:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1783444479.269683:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575391232 00000100:00100000:0.0:1783444479.269688:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575391232 00000100:00100000:0.0:1783444479.269718:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783444479.269725:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575391232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.269756:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575391232:12345-0@lo:400:kworker.0 Request processed in 32us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444479.269773:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1783444479.269944:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444479.269949:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444479.269952:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444479.269955:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444479.272512:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575392640:12345-0@lo:400:kworker.0 Request processed in 3952us (5194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444479.272527:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00100000:3.0:1783444479.272608:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575391616:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.272622:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575392128:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.272633:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575392640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.272643:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575391232:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.272654:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575391744:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.272664:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575392256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.272696:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575392768:0@lo:400:kworker.0 00000100:00100000:3.0:1783444479.272776:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575393024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444479.272879:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444479.272912:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444479.272920:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575392896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444479.272943:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444479.275023:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575392512:12345-0@lo:400:kworker.0 Request processed in 6926us (13375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444479.275038:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00100000:3.0:1783444479.275584:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575393024 00000100:00100000:3.0:1783444479.275595:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575393024 00000100:00100000:3.0:1783444479.275640:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575392896 00000100:00100000:3.0:1783444479.275643:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575392896 00000100:00100000:3.0:1783444479.275665:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:3.0:1783444479.275673:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575393024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444479.275711:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:3.0:1783444479.275775:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575393024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (2896us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444479.275782:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:3.0:1783444479.275829:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:3.0:1783444479.275837:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575392896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444479.275863:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444724736 avail 1298485248 00000100:00100000:3.0:1783444479.275895:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575392896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444479.275900:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:3.0:1783444479.275939:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000004:00080000:3.0:1783444479.275947:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084295 committed transno 120259084296 00000020:00080000:3.0:1783444479.275953:0:3636:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9368d08bd180 refcount 2 committed 0 result 0 batchid 73014444091 00000020:00080000:3.0:1783444479.275972:0:3636:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9368c6bad300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9368d08bd240 00000020:00080000:3.0:1783444479.275975:0:3636:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].3 00000020:00080000:3.0:1783444479.275978:0:3636:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9368c595c800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9368f98ad800 00000020:00080000:3.0:1783444479.275980:0:3636:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].3 00000004:00080000:3.0:1783444479.276005:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084296 committed transno 120259084296 00000020:00080000:3.0:1783444479.276009:0:3636:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9368c595b000 refcount 2 committed 0 result 0 batchid 73014444092 00000020:00080000:3.0:1783444479.276012:0:3636:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9368c52a5600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9368c595b540 00000020:00080000:3.0:1783444479.276014:0:3636:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x20000cf21:0x1:0x0].4 00000020:00080000:3.0:1783444479.276016:0:3636:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9368c52a5200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9368ef2b5200 00000020:00080000:3.0:1783444479.276019:0:3636:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x2400088d4:0x1:0x0].4 00000100:00100000:3.0:1783444479.276037:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575392896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444479.276057:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575393024:0@lo:41:osp-pre-1-0.0 00000020:00080000:3.0:1783444479.276098:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444092 committed batchid 73014444090 00000020:00080000:3.0:1783444479.276165:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444090 00000100:00100000:0.0:1783444479.278303:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575391488:0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.278321:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575392000:0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.278333:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575392512:0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.278368:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575391360:0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.278381:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575391872:0@lo:400:kworker.0 00000100:00100000:0.0:1783444479.278391:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575392384:0@lo:400:kworker.0 00000100:00100000:2.0:1783444479.280008:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575391488:12345-0@lo:400:kworker.0 Request processed in 12215us (18433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444479.280023:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1783444479.777162:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575393152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444479.777229:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444479.777287:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575393152 00000100:00100000:0.0:1783444479.777294:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575393152 00000100:00100000:0.0:1783444479.777340:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1783444479.777349:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575393152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783444479.777371:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444479.777416:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575393152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444479.777423:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1783444479.777470:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575393152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444479.777620:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444479.777629:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575393280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444479.777658:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444479.777711:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575393280 00000100:00100000:2.0:1783444479.777715:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575393280 00000100:00100000:2.0:1783444479.777743:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1783444479.777749:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575393280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444479.777759:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444479.777872:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575393280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444479.777879:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:3.0:1783444479.777971:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575393280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783444480.043989:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444480.801079:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575393408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444480.801151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444480.801210:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575393408 00000100:00100000:2.0:1783444480.801217:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575393408 00000100:00100000:2.0:1783444480.801266:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:2.0:1783444480.801275:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575393408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444480.801305:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444480.801351:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575393408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444480.801358:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:2.0:1783444480.801407:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575393408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444480.801560:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575393536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444480.801592:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444480.805563:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575393536 00000100:00100000:3.0:1783444480.805580:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575393536 00000100:00100000:3.0:1783444480.805808:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:3.0:1783444480.805829:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575393536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444480.805877:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444480.805956:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575393536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (4362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444480.805963:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:3.0:1783444480.806119:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575393536:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783444481.054123:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444481.098167:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444481.098354:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557832064 00000100:00100000:3.0:1783444481.098366:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557832064 00000100:00100000:3.0:1783444481.098433:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:3.0:1783444481.098443:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557832064:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444481.098540:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557832064:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 97us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444481.098548:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:1.0:1783444481.123421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444481.123461:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444481.123482:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444481.123519:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444481.128348:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557832448 00000100:00100000:0.0:1783444481.128369:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557832448 00000100:00100000:0.0:1783444481.128426:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557832576 00000100:00100000:0.0:1783444481.128429:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557832576 00000100:00100000:0.0:1783444481.128457:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2504 00000100:00100000:0.0:1783444481.128467:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557832448:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444481.128553:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557832448:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 87us (5090us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444481.128560:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2504 00000100:00100000:0.0:1783444481.128575:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2505 00000100:00100000:0.0:1783444481.128581:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557832576:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444481.128603:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557832576:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (5084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444481.128608:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2505 00000100:00100000:0.0:1783444481.128624:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557832192 00000100:00100000:0.0:1783444481.128628:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557832192 00000100:00100000:0.0:1783444481.128655:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557832320 00000100:00100000:0.0:1783444481.128658:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557832320 00000100:00100000:0.0:1783444481.128693:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1104 00000100:00100000:0.0:1783444481.128700:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+13:2403:x1870073557832192:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000080:0.0:1783444481.128723:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c32f5f80 x1870073557832192/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:102/0 lens 224/224 e 0 to 0 dl 1783444492 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444481.128748:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+13:2403:x1870073557832192:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 48us (5337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444481.128754:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1104 00000100:00100000:0.0:1783444481.128766:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1105 00000100:00100000:0.0:1783444481.128772:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557832320:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444481.128880:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557832320:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 107us (5397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444481.128888:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1105 00000100:00080000:0.0:1783444481.128905:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444481.128909:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444481.128912:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444481.128914:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783444482.080241:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444483.101309:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783444483.880102:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00010000:00010000:0.0:1783444484.125043:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444484.382259:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575393664:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382356:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382397:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575394176:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382448:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575394688:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382468:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382483:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575395200:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382502:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382524:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783444484.382530:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575393792:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382550:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382566:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575394304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382589:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382606:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575394816:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382624:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382651:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575393920:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382675:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382692:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575394432:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382712:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382728:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575394944:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382747:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382774:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783444484.382780:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575394048:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382825:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382841:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575394560:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382870:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382887:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575395072:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.382905:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.382937:0:92445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575393664 00000100:00100000:2.0:1783444484.382945:0:92445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575393664 00000100:00100000:2.0:1783444484.382988:0:92445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783444484.382997:0:92445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575393664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.383047:0:92445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575393664:12345-0@lo:400:kworker.0 Request processed in 50us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383054:0:92445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783444484.383085:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575394176 00000100:00100000:2.0:1783444484.383088:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575394176 00000100:00100000:2.0:1783444484.383116:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575394688 00000100:00100000:2.0:1783444484.383119:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575394688 00000100:00100000:2.0:1783444484.383132:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575395200 00000100:00100000:2.0:1783444484.383134:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575395200 00000100:00100000:2.0:1783444484.383143:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575393792 00000100:00100000:2.0:1783444484.383145:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575393792 00000100:00100000:2.0:1783444484.383156:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575393920 00000100:00100000:2.0:1783444484.383159:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575393920 00000100:00100000:2.0:1783444484.383169:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575394048 00000100:00100000:2.0:1783444484.383172:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575394048 00000100:00100000:2.0:1783444484.383184:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1783444484.383190:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575394176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.383222:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575394176:12345-0@lo:400:kworker.0 Request processed in 32us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383229:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1783444484.383241:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1783444484.383246:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575394688:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444484.383266:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8f800 x1870073575394688/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:105/0 lens 224/224 e 0 to 0 dl 1783444495 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444484.383294:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575394688:12345-0@lo:400:kworker.0 Request processed in 48us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383301:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1783444484.383312:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1783444484.383318:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575395200:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444484.383327:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8e300 x1870073575395200/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:105/0 lens 224/224 e 0 to 0 dl 1783444495 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444484.383351:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575395200:12345-0@lo:400:kworker.0 Request processed in 33us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383357:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1783444484.383367:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1783444484.383372:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575393792:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444484.383382:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8ce00 x1870073575393792/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:105/0 lens 224/224 e 0 to 0 dl 1783444495 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444484.383404:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575393792:12345-0@lo:400:kworker.0 Request processed in 32us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383411:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1783444484.383421:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1783444484.383426:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575393920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.383456:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575393920:12345-0@lo:400:kworker.0 Request processed in 30us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383462:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1783444484.383478:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1783444484.383484:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575394048:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444484.383494:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8c000 x1870073575394048/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:105/0 lens 224/224 e 0 to 0 dl 1783444495 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444484.383520:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575394048:12345-0@lo:400:kworker.0 Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383526:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1783444484.383549:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575394304 00000100:00100000:2.0:1783444484.383553:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575394304 00000100:00100000:2.0:1783444484.383576:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575394816 00000100:00100000:2.0:1783444484.383580:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575394816 00000100:00100000:2.0:1783444484.383597:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:2.0:1783444484.383603:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575394304:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1783444484.383616:0:8431:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8fb80 x1870073575394304/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:105/0 lens 224/224 e 0 to 0 dl 1783444495 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444484.383643:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575394304:12345-0@lo:400:kworker.0 Request processed in 40us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383650:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:2.0:1783444484.383662:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:2.0:1783444484.383667:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575394816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.383693:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575394816:12345-0@lo:400:kworker.0 Request processed in 27us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.383699:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:2.0:1783444484.383719:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575394432 00000100:00100000:2.0:1783444484.383722:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575394432 00000100:00100000:2.0:1783444484.383745:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575394944 00000100:00100000:2.0:1783444484.383761:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575394944 00000100:00100000:2.0:1783444484.383808:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575394560 00000100:00100000:2.0:1783444484.383811:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575394560 00000100:00100000:2.0:1783444484.392350:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575395072 00000100:00100000:2.0:1783444484.392364:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575395072 00000100:00100000:1.0:1783444484.402864:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:1.0:1783444484.402892:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575394432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444484.402992:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575394432:12345-0@lo:400:kworker.0 Request processed in 115us (20279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444484.402999:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00100000:1.0:1783444484.403026:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:1.0:1783444484.403033:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575394944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444484.403065:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575394944:12345-0@lo:400:kworker.0 Request processed in 32us (20316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444484.403071:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:1.0:1783444484.403082:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:1.0:1783444484.403103:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575394560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444484.403137:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575394560:12345-0@lo:400:kworker.0 Request processed in 35us (20265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444484.403144:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:1.0:1783444484.403155:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1783444484.403162:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575395072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444484.403205:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575395072:12345-0@lo:400:kworker.0 Request processed in 44us (20298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444484.403211:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:0.0:1783444484.403372:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575395328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444484.403413:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444484.405391:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575393792:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405409:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575394304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405420:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575394816:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405430:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575393664:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405441:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575394176:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405452:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575394688:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405465:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575395200:0@lo:400:kworker.0 00000100:00080000:2.0:1783444484.405510:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444484.405515:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444484.405519:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444484.405522:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444484.405541:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575394048:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405552:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575394560:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405564:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575395072:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405575:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575393920:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405585:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575394432:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405595:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575394944:0@lo:400:kworker.0 00000100:00100000:2.0:1783444484.405625:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575395328 00000100:00100000:2.0:1783444484.405646:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575395328 00000100:00100000:2.0:1783444484.405685:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:2.0:1783444484.405692:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575395328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444484.405724:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444724736 avail 1298485248 00010000:00000080:2.0:1783444484.405866:0:29151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c68f1c00 x1870073575395328/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:105/0 lens 224/368 e 0 to 0 dl 1783444495 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444484.405929:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575395328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 236us (2515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444484.405936:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:2.0:1783444484.405990:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575395328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444484.407959:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575395456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444484.408015:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444484.408098:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575395456 00000100:00100000:0.0:1783444484.408106:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575395456 00000100:00100000:0.0:1783444484.408152:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:0.0:1783444484.408161:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575395456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444484.408190:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444484.408237:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575395456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444484.408244:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:0.0:1783444484.408284:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575395456:0@lo:41:osp-pre-1-0.0 00000020:00080000:0.0:1783444484.896777:0:75651:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444092 batchid updated 00000020:00080000:0.0:1783444484.896824:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444092 00000004:00080000:0.0:1783444484.896886:0:75671:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9368e70eb240 with version 13 00000020:00080000:0.0:1783444484.896904:0:75671:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444091 cancel update log [0x20000cf21:0x1:0x0].3: rc = 0 00000020:00080000:0.0:1783444484.896976:0:75671:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444091 cancel update log [0x2400088d4:0x1:0x0].3: rc = 0 00000004:00080000:0.0:1783444484.897009:0:75671:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9367c3203b40 with version 14 00000020:00080000:0.0:1783444484.897013:0:75671:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444092 cancel update log [0x20000cf21:0x1:0x0].4: rc = 0 00000020:00080000:0.0:1783444484.897034:0:75671:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444092 cancel update log [0x2400088d4:0x1:0x0].4: rc = 0 00000020:00080000:0.0:1783444484.897041:0:75671:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444092 00000004:00080000:0.0:1783444484.897061:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 13 rpc_version 13 00000020:00100000:0.0:1783444484.897094:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783444484.897104:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367c68f0000 x1870073575395712/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444484.897269:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575395840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444484.897333:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444484.897391:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575395840 00000100:00100000:1.0:1783444484.897398:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575395840 00000100:00100000:0.0:1783444484.897554:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f0000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575395712:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783444484.897589:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444484.897609:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3203480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444484.897624:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575395712 00000100:00100000:0.0:1783444484.897628:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575395712 00000100:00100000:0.0:1783444484.897663:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1783444484.897671:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75656:x1870073575395712:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783444484.897810:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:1.0:1783444484.897818:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575395840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444484.897839:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444484.897886:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575395840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444484.897893:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:1.0:1783444484.897945:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575395840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444484.898566:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575395968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444484.898599:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444484.899256:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575395968 00000100:00100000:0.0:1783444484.899262:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575395968 00000100:00100000:0.0:1783444484.899401:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:0.0:1783444484.899409:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575395968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444484.900330:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444484.900427:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575395968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1016us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444484.900437:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:1.0:1783444484.900597:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575395968:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1783444485.054761:0:92438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00010000:00010000:3.0:1783444485.054818:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054831:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054839:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054845:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444485.054850:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054858:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054889:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367cd15c300) 00010000:00010000:3.0:1783444485.054893:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444485.054897:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054903:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26a00/0x42cb6883e383342d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054923:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054930:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054935:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054941:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444485.054944:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054949:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054956:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9367cd15c300) 00010000:00010000:3.0:1783444485.054958:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444485.054960:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444485.054964:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e3833465 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1783444485.055886:0:23687:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c68f3800 x1870073575395712/t120259084299(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:105/0 lens 488/4320 e 0 to 0 dl 1783444495 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444485.055982:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575395712:12345-0@lo:1000:osp_up0-1.0 Request processed in 158310us (158390us total) trans 120259084299 rc 0/0 00000100:00100000:0.0:1783444485.055992:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1783444485.056112:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f0000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575395712:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1783444485.056128:0:75656:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9367c2ee2b40 version 14 rpc_version 14 00000020:00100000:1.0:1783444485.056161:0:75656:0:(genops.c:2446:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783444485.056167:0:75656:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9367c32f5880 x1870073575396224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444485.056187:0:75656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575396224:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1783444485.056223:0:75656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444485.056256:0:75656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c462f600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444485.057063:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575396224 00000100:00100000:0.0:1783444485.057072:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575396224 00000100:00100000:0.0:1783444485.057120:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:0.0:1783444485.057128:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75656:x1870073575396224:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:0.0:1783444485.057223:0:29151:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c32f7800 x1870073575396224/t120259084300(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:106/0 lens 488/4320 e 0 to 0 dl 1783444496 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444485.057272:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75656:x1870073575396224:12345-0@lo:1000:osp_up0-1.0 Request processed in 144us (1047us total) trans 120259084300 rc 0/0 00000100:00100000:0.0:1783444485.057279:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:1.0:1783444485.057419:0:75656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75656:1870073575396224:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1783444485.155034:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444485.917076:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575396352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444485.917193:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444485.917521:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575396352 00000100:00100000:3.0:1783444485.917542:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575396352 00000100:00100000:3.0:1783444485.917610:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:3.0:1783444485.917621:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575396352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444485.917651:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444485.918086:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444485.918103:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575396480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444485.918158:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444485.918207:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575396480 00000100:00100000:2.0:1783444485.918212:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575396480 00000100:00100000:2.0:1783444485.918244:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1783444485.918251:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575396480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444485.918266:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444485.918305:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575396480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444485.918313:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1783444485.918371:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575396480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444485.919324:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575396352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1700us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444485.919334:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:0.0:1783444485.919641:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7c8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575396352:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1783444486.066433:0:93633:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:0.0:1783444486.172982:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444486.190058:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444486.192646:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557832704 00000100:00100000:0.0:1783444486.192661:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557832704 00000100:00100000:0.0:1783444486.192764:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1387 00000100:00100000:0.0:1783444486.192774:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+9:72073:x1870073557832704:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444486.192816:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444486.192838:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383347a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939db3 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.192905:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833481 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.192919:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.192943:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444486.192994:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444486.192999:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444486.193037:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.193063:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e383347a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939db3 expref: 11 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.193084:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939db3 expref: 10 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.193093:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368dccaed00) 00010000:00010000:0.0:1783444486.193096:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444486.193099:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90800, rc 0) 00010000:00000080:0.0:1783444486.193106:0:66225:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7c8dc00 x1870073557832704/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:107/0 lens 576/688 e 0 to 0 dl 1783444497 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444486.193183:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+10:72073:x1870073557832704:12345-192.168.204.20@tcp:101:touch.0 Request processed in 410us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444486.193191:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1387 00000100:00080000:2.0:1783444486.193321:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444486.197445:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444486.197521:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557832832 00000100:00100000:1.0:1783444486.197531:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557832832 00000100:00100000:1.0:1783444486.197586:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1388 00000100:00100000:1.0:1783444486.197596:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+10:72073:x1870073557832832:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444486.197618:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444486.197639:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e3833488 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939dba expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197713:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197737:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197748:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197764:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197781:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197815:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197882:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e383349d lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197891:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e383349d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197897:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e383349d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444486.197921:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e383349d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197935:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197941:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197947:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197954:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197959:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444486.197963:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197976:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.197987:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368c59a7a00) 00010000:00010000:1.0:1783444486.197991:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444486.197995:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198000:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e383348f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198013:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198019:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198024:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198029:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444486.198031:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198036:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198042:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9368dccaef00) 00010000:00010000:1.0:1783444486.198044:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444486.198047:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198067:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e3833496 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198100:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e3833488 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dba expref: 12 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198113:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e383349d lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dba expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.198120:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368dccae200) 00010000:00010000:1.0:1783444486.198122:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444486.198124:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27800, rc 0) 00010000:00000080:1.0:1783444486.198131:0:66223:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c68f1180 x1870073557832832/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:107/0 lens 576/584 e 0 to 0 dl 1783444497 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444486.198197:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+11:72073:x1870073557832832:12345-192.168.204.20@tcp:101:touch.0 Request processed in 602us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444486.198204:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1388 00000100:00100000:0.0:1783444486.219101:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444486.219149:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444486.219182:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557832960 00000100:00100000:0.0:1783444486.219192:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557832960 00000100:00100000:0.0:1783444486.219262:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1389 00000100:00100000:0.0:1783444486.219271:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+5:72073:x1870073557832960:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444486.219293:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444486.219316:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf91000/0x42cb6883e38334a4 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939dc1 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.219375:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf90600/0x42cb6883e38334ab lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.219388:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf90600/0x42cb6883e38334ab lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.219400:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf90600/0x42cb6883e38334ab lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444486.219445:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1783444486.219448:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1783444486.219499:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf91000/0x42cb6883e38334a4 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dc1 expref: 7 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.219517:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf90600/0x42cb6883e38334ab lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dc1 expref: 6 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.219525:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368e7860500) 00010000:00010000:0.0:1783444486.219528:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1783444486.219531:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90600, rc 0) 00000100:00100000:0.0:1783444486.219584:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+6:72073:x1870073557832960:12345-192.168.204.20@tcp:101:touch.0 Request processed in 314us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444486.219592:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1389 00000100:00100000:0.0:1783444486.219624:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557833088 00000100:00100000:0.0:1783444486.219628:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557833088 00000100:00100000:0.0:1783444486.219659:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 742 00000100:00100000:0.0:1783444486.219667:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2402:x1870073557833088:12345-192.168.204.20@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783444486.221219:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1783444486.221785:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444486.221832:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27800/0x42cb6883e383349d lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dba expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.221848:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368dccae200) 00010000:00010000:0.0:1783444486.221854:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444486.221893:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2402:x1870073557833088:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 2226us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444486.221901:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 742 00000100:00080000:0.0:1783444486.221976:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444486.223531:0:92444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557833216 00000100:00100000:0.0:1783444486.223543:0:92444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557833216 00000100:00100000:0.0:1783444486.223598:0:92444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:0.0:1783444486.223607:0:92444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557833216:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444486.223662:0:92444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557833216:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 56us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444486.223670:0:92444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:3.0:1783444486.225756:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.225806:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.225835:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.225859:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557833472 00000100:00100000:3.0:1783444486.225866:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557833472 00000100:00100000:3.0:1783444486.225910:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557833344 00000100:00100000:3.0:1783444486.225913:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557833344 00000100:00100000:3.0:1783444486.225935:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2510 00000100:00100000:3.0:1783444486.225943:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557833472:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444486.225996:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557833472:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444486.226004:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2510 00000100:00100000:3.0:1783444486.226020:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2511 00000100:00100000:3.0:1783444486.226026:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557833344:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444486.226050:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557833344:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444486.226063:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2511 00000100:00080000:3.0:1783444486.226082:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444486.226086:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444486.226157:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557833728 00000100:00100000:3.0:1783444486.226162:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557833728 00000100:00100000:3.0:1783444486.226189:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1390 00000100:00100000:3.0:1783444486.226196:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:72073:x1870073557833728:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444486.226224:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444486.226244:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e38334b2 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939dc8 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.226346:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.226360:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.226372:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.226387:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.226395:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.226401:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444486.226548:0:66225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66225:1870073575396608:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783444486.226597:0:66225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444486.226622:0:66225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dcf3aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444486.226641:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575396608 00000100:00100000:3.0:1783444486.226645:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575396608 00000100:00100000:3.0:1783444486.226674:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:3.0:1783444486.226681:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66225:x1870073575396608:12345-0@lo:1000:mdt00_001.0 00010000:00000080:3.0:1783444486.226731:0:8431:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e69ff480 x1870073575396608/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:107/0 lens 328/4320 e 0 to 0 dl 1783444497 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444486.226770:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66225:x1870073575396608:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444486.226777:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:3.0:1783444486.226840:0:66225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66225:1870073575396608:0@lo:1000:mdt00_001.0 00000004:00080000:3.0:1783444486.227089:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x603:0x0], index 1: 0 00010000:00010000:3.0:1783444486.227244:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38334c7 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227254:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38334c7 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227263:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38334c7 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227296:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227304:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227310:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227322:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227328:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444486.227332:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227340:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227352:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368e7860500) 00010000:00010000:3.0:1783444486.227356:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444486.227360:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227367:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e38334b9 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444486.227381:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009073070d reply state 000000004ebb034c transno 77309411463 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227393:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227399:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff9368c3254200) 00010000:00010000:3.0:1783444486.227402:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444486.227404:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783444486.227437:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e38334b2 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dc8 expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227449:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38334c7 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dc8 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.227461:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9368c3254800) 00010000:00010000:3.0:1783444486.227464:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444486.227466:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513bc00, rc 0) 00000100:00100000:3.0:1783444486.227499:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+9:72073:x1870073557833728:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1303us (1663us total) trans 77309411463 rc 0/0 00000100:00100000:3.0:1783444486.227506:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1390 00000100:00100000:3.0:1783444486.235583:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444486.235650:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557833984 00000100:00100000:2.0:1783444486.235660:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557833984 00000100:00100000:2.0:1783444486.235735:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1391 00000100:00100000:2.0:1783444486.235746:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:72073:x1870073557833984:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:2.0:1783444486.235964:0:66223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444486.235992:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513bc00/0x42cb6883e38334c7 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dc8 expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444486.236011:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9368c3254800) 00010000:00010000:2.0:1783444486.236021:0:66223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444486.236078:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444486.236090:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444486.236099:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444486.236205:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000844c651d reply state 000000004b7642f4 transno 77309411464 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444486.236286:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444486.236293:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9368c59a7600) 00010000:00010000:2.0:1783444486.236295:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444486.236298:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444486.236672:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+10:72073:x1870073557833984:12345-192.168.204.20@tcp:36:touch.0 Request processed in 926us (1096us total) trans 77309411464 rc 0/0 00000100:00100000:2.0:1783444486.236699:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1391 00000100:00100000:3.0:1783444486.249900:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444486.250850:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557834112 00000100:00100000:0.0:1783444486.250861:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557834112 00000100:00100000:0.0:1783444486.250921:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1392 00000100:00100000:0.0:1783444486.250932:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+10:72073:x1870073557834112:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444486.250958:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444486.250989:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf91000/0x42cb6883e38334dc lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939dcf expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.251047:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf91000/0x42cb6883e38334dc lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dcf expref: 11 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.251062:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367caf91000/0x42cb6883e38334dc lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dcf expref: 11 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444486.251079:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9368c59a7600) 00010000:00010000:0.0:1783444486.251083:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783444486.251088:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91000, rc 0) 00000100:00100000:0.0:1783444486.251145:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:72073:x1870073557834112:12345-192.168.204.20@tcp:101:touch.0 Request processed in 216us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444486.251152:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1392 00000100:00100000:2.0:1783444486.254929:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444486.255130:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557834240 00000100:00100000:0.0:1783444486.255140:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557834240 00000100:00100000:0.0:1783444486.255198:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5909 00000100:00100000:0.0:1783444486.255215:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557834240:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:0.0:1783444486.255429:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557834240:12345-192.168.204.20@tcp:2:touch.0 Request processed in 222us (507us total) trans 4294969458 rc 0/0 00000100:00100000:0.0:1783444486.255437:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5909 00000100:00100000:0.0:1783444486.257858:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.257934:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557834496 00000100:00100000:3.0:1783444486.257942:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557834496 00000100:00100000:3.0:1783444486.257998:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 243 00000100:00100000:3.0:1783444486.258007:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+11:72073:x1870073557834496:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444486.258269:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+12:72073:x1870073557834496:12345-192.168.204.20@tcp:35:touch.0 Request processed in 263us (417us total) trans 77309411465 rc 0/0 00000100:00100000:3.0:1783444486.258277:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 243 00000100:00100000:3.0:1783444486.272006:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444486.272155:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557834624 00000100:00100000:1.0:1783444486.272167:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557834624 00000100:00100000:1.0:1783444486.272236:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1393 00000100:00100000:1.0:1783444486.272247:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+10:72074:x1870073557834624:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444486.272270:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444486.272293:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38334e3 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939dd6 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272361:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272389:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272401:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272418:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272426:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272432:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272485:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e38334f8 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272494:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e38334f8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272502:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e38334f8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444486.272523:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e38334f8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272537:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272543:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272560:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272567:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272574:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444486.272578:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272586:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272598:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368c59a7a00) 00010000:00010000:1.0:1783444486.272602:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444486.272606:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272612:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27600/0x42cb6883e38334ea lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272625:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272631:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272637:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272643:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444486.272652:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272659:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272667:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9368dccaef00) 00010000:00010000:1.0:1783444486.272669:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444486.272672:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272691:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e38334f1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272734:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27c00/0x42cb6883e38334e3 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dd6 expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272748:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e38334f8 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dd6 expref: 11 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444486.272755:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368e7860100) 00010000:00010000:1.0:1783444486.272758:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783444486.272897:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27400, rc 0) 00010000:00000080:1.0:1783444486.272906:0:67017:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e69fd500 x1870073557834624/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:107/0 lens 576/584 e 0 to 0 dl 1783444497 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444486.272969:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+11:72074:x1870073557834624:12345-192.168.204.20@tcp:101:touch.0 Request processed in 724us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444486.272977:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1393 00000100:00100000:2.0:1783444486.276196:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.276392:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557834752 00000100:00100000:3.0:1783444486.276401:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557834752 00000100:00100000:3.0:1783444486.276458:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1394 00000100:00100000:3.0:1783444486.276468:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+12:72074:x1870073557834752:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444486.276492:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444486.276515:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e38334ff lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ddd expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.276578:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e3833506 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.276607:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e3833506 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.276619:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e3833506 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444486.276664:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783444486.276667:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783444486.277062:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b800/0x42cb6883e38334ff lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ddd expref: 14 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.277082:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b200/0x42cb6883e3833506 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ddd expref: 13 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.277091:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c3254100) 00010000:00010000:3.0:1783444486.277094:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783444486.277098:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513b200, rc 0) 00000100:00100000:3.0:1783444486.277433:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+13:72074:x1870073557834752:12345-192.168.204.20@tcp:101:touch.0 Request processed in 965us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444486.277442:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1394 00000100:00100000:2.0:1783444486.280610:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.283072:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557834880 00000100:00100000:3.0:1783444486.283089:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557834880 00000100:00100000:3.0:1783444486.283351:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 743 00000100:00100000:3.0:1783444486.283362:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557834880:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783444486.283378:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444486.283404:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27400/0x42cb6883e38334f8 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939dd6 expref: 11 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.283445:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368e7860100) 00010000:00010000:3.0:1783444486.283450:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444486.283517:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2404:x1870073557834880:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 157us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444486.283524:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 743 00000100:00100000:3.0:1783444486.283594:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.283703:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557835136 00000100:00100000:3.0:1783444486.283707:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557835136 00000100:00100000:3.0:1783444486.283745:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1395 00000100:00100000:3.0:1783444486.283751:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+13:72074:x1870073557835136:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444486.283782:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444486.283821:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e383350d lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939de4 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.283919:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.283931:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.283940:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.283954:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.283959:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.283976:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444486.285438:0:80475:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x604:0x0], index 1: 0 00010000:00010000:3.0:1783444486.285617:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e3833522 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.285631:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e3833522 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.285641:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e3833522 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286000:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286009:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286015:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286022:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286028:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444486.286032:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286040:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286069:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c3254100) 00010000:00010000:3.0:1783444486.286072:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444486.286077:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286084:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a600/0x42cb6883e3833514 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444486.286098:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a264f608 reply state 000000005f1de61e transno 77309411466 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286109:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286115:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff9368c3254400) 00010000:00010000:3.0:1783444486.286118:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444486.286122:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783444486.286160:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b600/0x42cb6883e383350d lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939de4 expref: 16 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286174:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e3833522 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939de4 expref: 15 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.286181:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9368c3254c00) 00010000:00010000:3.0:1783444486.286183:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444486.286186:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a000, rc 0) 00000100:00100000:3.0:1783444486.286327:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+16:72074:x1870073557835136:12345-192.168.204.20@tcp:101:touch.0 Request processed in 2573us (2731us total) trans 77309411466 rc 0/0 00000100:00100000:3.0:1783444486.286336:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1395 00000100:00100000:1.0:1783444486.289938:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.290171:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557835392 00000100:00100000:3.0:1783444486.290182:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557835392 00000100:00100000:3.0:1783444486.290290:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1396 00000100:00100000:3.0:1783444486.290299:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+16:72074:x1870073557835392:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:3.0:1783444486.290359:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444486.290385:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a000/0x42cb6883e3833522 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939de4 expref: 16 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.290405:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9368c3254c00) 00010000:00010000:3.0:1783444486.290416:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444486.290467:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.290481:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.290490:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444486.290597:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db0369a2 reply state 000000003cc1198f transno 77309411467 ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.290611:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.290617:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9368c3254b00) 00010000:00010000:3.0:1783444486.290620:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444486.290622:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444486.290877:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+17:72074:x1870073557835392:12345-192.168.204.20@tcp:36:touch.0 Request processed in 577us (946us total) trans 77309411467 rc 0/0 00000100:00100000:3.0:1783444486.290896:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1396 00000100:00100000:2.0:1783444486.293458:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.293538:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557835520 00000100:00100000:3.0:1783444486.293549:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557835520 00000100:00100000:3.0:1783444486.293604:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1397 00000100:00100000:3.0:1783444486.293614:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+17:72074:x1870073557835520:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444486.293639:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444486.293658:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a200/0x42cb6883e3833537 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939deb expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.293732:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a200/0x42cb6883e3833537 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939deb expref: 18 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.293746:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513a200/0x42cb6883e3833537 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939deb expref: 18 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444486.293776:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9368c3254b00) 00010000:00010000:3.0:1783444486.293779:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444486.293782:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a200, rc 0) 00000100:00100000:3.0:1783444486.293866:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+18:72074:x1870073557835520:12345-192.168.204.20@tcp:101:touch.0 Request processed in 253us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444486.293872:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1397 00000100:00100000:2.0:1783444486.296672:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444486.296877:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557835648 00000100:00100000:0.0:1783444486.296887:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557835648 00000100:00100000:0.0:1783444486.296949:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5910 00000100:00100000:0.0:1783444486.296959:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557835648:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:0.0:1783444486.297176:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557835648:12345-192.168.204.20@tcp:2:touch.0 Request processed in 218us (509us total) trans 4294969459 rc 0/0 00000100:00100000:0.0:1783444486.297185:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5910 00000100:00100000:1.0:1783444486.299761:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444486.299864:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557835904 00000100:00100000:3.0:1783444486.299874:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557835904 00000100:00100000:3.0:1783444486.299918:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 244 00000100:00100000:3.0:1783444486.299926:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd129850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+18:72074:x1870073557835904:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444486.300216:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd129850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+19:72074:x1870073557835904:12345-192.168.204.20@tcp:35:touch.0 Request processed in 281us (453us total) trans 77309411468 rc 0/0 00000100:00100000:3.0:1783444486.300237:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 244 00010000:00010000:1.0:1783444487.207723:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444488.221115:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783444488.555401:0:93731:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783444488.555458:0:93731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.555472:0:93731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.555480:0:93731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.555487:0:93731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.555552:0:93731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783444488.555558:0:93731:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783444488.555586:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444488.555590:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783444488.555596:0:93731:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783444488.555621:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368c6bc8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783444488.557768:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575396736:0@lo:39:umount.0 00000100:00100000:3.0:1783444488.557891:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444488.558161:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575396736 00000100:00100000:0.0:1783444488.558170:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575396736 00000100:00100000:0.0:1783444488.558230:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1783444488.558240:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575396736:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783444488.558269:0:80475:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832ea7 00000100:00080000:0.0:1783444488.558299:0:80475:0:(import.c:65:import_set_state_nolock()) ffff9368c5188000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1783444488.559374:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444488.559385:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.559396:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444488.559401:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.559412:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444488.559418:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444488.559423:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444488.559426:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783444488.559429:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00000080:0.0:1783444488.560055:0:80475:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e69fd180 x1870073575396736/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:109/0 lens 224/224 e 0 to 0 dl 1783444499 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444488.560181:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3632:x1870073575396736:12345-0@lo:39:umount.0 Request processed in 1942us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444488.560191:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000020:00000080:0.0:1783444488.560206:0:80475:0:(genops.c:906:class_export_put()) final put ffff9368c518e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783444488.560254:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c518e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783444488.560297:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c5188000 for lustre-MDT0000 00010000:00010000:0.0:1783444488.560327:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.560335:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444488.560355:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.560362:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27a00/0x42cb6883e3833243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e383324a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.560374:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444488.560376:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444488.560420:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575396864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783444488.560457:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444488.560511:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575396864 00000100:00100000:2.0:1783444488.560517:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575396864 00000100:00100000:2.0:1783444488.560557:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1783444488.560566:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575396864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444488.560578:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444488.560608:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91c00/0x42cb6883e383324a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833243 expref: 24 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444488.560621:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444488.560663:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3636:x1870073575396864:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444488.560684:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1783444488.560722:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575396864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444488.561017:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783444488.561229:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368c6bc8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783444488.561451:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575396736:0@lo:39:umount.0 00010000:00010000:0.0:1783444488.561523:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783444488.561586:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783444488.561591:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783444488.561596:0:93731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783444488.563263:0:93731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.563283:0:93731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.563291:0:93731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.563298:0:93731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.563381:0:93731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444488.563389:0:93731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.563396:0:93731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.563402:0:93731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.563429:0:93731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564015:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444488.564024:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564033:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444488.564037:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564046:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444488.564063:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444488.564069:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444488.564072:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1783444488.564107:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564114:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444488.564146:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564154:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e3833251 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833258 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564167:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444488.564171:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564176:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70800 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444488.564179:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564185:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444488.564192:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444488.564197:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783444488.564205:0:10323:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1783444488.564218:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564224:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444488.564230:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564238:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444488.564239:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444488.564241:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444488.564259:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575397120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444488.564323:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444488.564371:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444488.564378:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575396992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444488.564398:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444488.564429:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575397120 00000100:00100000:1.0:1783444488.564436:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575397120 00000100:00100000:1.0:1783444488.564478:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575396992 00000100:00100000:1.0:1783444488.564481:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575396992 00000100:00100000:1.0:1783444488.564506:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1783444488.564514:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575397120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444488.564526:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444488.564540:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05600/0x42cb6883e3832db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832db2 expref: 24 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.564552:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444488.564585:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3634:x1870073575397120:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444488.564592:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1783444488.564620:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1783444488.564627:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3634:x1870073575396992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444488.564650:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444488.564660:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513a800/0x42cb6883e3833258 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833251 expref: 22 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.568042:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444488.568137:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3634:x1870073575396992:12345-0@lo:103:ldlm_bl.0 Request processed in 3505us (3732us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444488.568149:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1783444488.568221:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575396992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444488.568232:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575397120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444488.568474:0:93731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783444488.568485:0:93731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70800/0x42cb6883e3832db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832db9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444488.568503:0:93731:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783444488.568514:0:93731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.568522:0:93731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.568530:0:93731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.568537:0:93731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.568563:0:93731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444488.568569:0:93731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.568577:0:93731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.568584:0:93731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.568604:0:93731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444488.568618:0:93731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783444488.568622:0:93731:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783444488.568625:0:93731:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783444488.568682:0:93731:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783444488.568687:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1783444488.568692:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1783444488.568698:0:93731:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1783444488.569012:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444488.569019:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569027:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444488.569031:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569052:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444488.569060:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444488.569066:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783444488.569069:0:6493:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783444488.569071:0:6493:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783444488.569100:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569106:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444488.569133:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569140:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4c11000/0x42cb6883e3832d81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832d88 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569151:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444488.569154:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569161:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444488.569164:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569170:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444488.569187:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444488.569193:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783444488.569195:0:6493:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783444488.569197:0:6493:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783444488.569209:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569215:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444488.569221:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569227:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71e00/0x42cb6883e3832c9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3832ca1 expref: -99 pid: 92437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569235:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444488.569237:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444488.569239:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444488.569245:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444488.569255:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575397248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444488.569296:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444488.569330:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444488.569335:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575397376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444488.569352:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444488.569375:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575397248 00000100:00100000:0.0:1783444488.569380:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575397248 00000100:00100000:0.0:1783444488.569411:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575397376 00000100:00100000:0.0:1783444488.569414:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575397376 00000100:00100000:0.0:1783444488.569437:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1783444488.569444:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3635:x1870073575397248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444488.569456:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444488.569469:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04a00/0x42cb6883e3832d88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832d81 expref: 22 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569481:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444488.569508:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3635:x1870073575397248:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444488.569514:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1783444488.569527:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1783444488.569533:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3635:x1870073575397376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444488.569540:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444488.569547:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f04800/0x42cb6883e3832ca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832c9a expref: 20 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444488.569556:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444488.569577:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3635:x1870073575397376:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444488.569584:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1783444488.569620:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575397376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444488.569628:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575397248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444488.571772:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1783444488.572006:0:93731:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1783444488.581298:0:92438:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000020:00000080:3.0:1783444488.586457:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1783444488.586473:0:93731:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c5654800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444488.586480:0:93731:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c5118000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444488.586485:0:93731:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9367cae8d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783444488.586492:0:93731:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c9a17800 08efc25c-17e5-4d29-97d2-f1505f195a06 192.168.204.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 120259084298 stale:0 00000020:00080000:3.0:1783444488.586497:0:93731:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9368c9a10800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084300 stale:0 00000020:00080000:3.0:1783444488.586501:0:93731:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9368e7123380) has exports, disconnecting them 00000020:00080000:3.0:1783444488.586506:0:93731:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c5654800), last request at 1783444458 00000020:00000080:3.0:1783444488.586513:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832ea0 00000100:00080000:3.0:1783444488.586523:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368c518e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783444488.586592:0:93731:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c5654800): rc 0 00000020:00000080:3.0:1783444488.586595:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c5654800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783444488.586607:0:93731:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c5118000), last request at 1783444484 00000020:00000080:3.0:1783444488.586610:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832e99 00000100:00080000:3.0:1783444488.586615:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368c511b000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783444488.589567:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783444488.589775:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c5654800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783444488.589873:0:92306:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c518e800 for lustre-MDT0000 00010000:00010000:0.0:1783444488.590192:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783444488.590210:0:93731:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c5118000): rc 0 00000020:00000080:0.0:1783444488.590214:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c5118000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783444488.590225:0:93731:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9367cae8d000), last request at 1783444484 00000020:00000080:0.0:1783444488.590231:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832e92 00000100:00080000:0.0:1783444488.590274:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368c511d000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783444488.590386:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c5118000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1783444488.590411:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c511b000 for lustre-MDT0000 00000020:00080000:0.0:1783444488.590424:0:93731:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367cae8d000): rc 0 00000020:00000080:0.0:1783444488.590426:0:93731:0:(genops.c:906:class_export_put()) final put ffff9367cae8d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783444488.590436:0:93731:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.20@tcp (ffff9368c9a17800), last request at 1783444486 00000020:00000080:0.0:1783444488.590442:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832cfc 00000020:00010000:0.0:1783444488.590453:0:93731:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368c9a17800: total 1 00000100:00080000:0.0:1783444488.590456:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368ea60e000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1783444488.590481:0:6494:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368c9a17800: total 1 00010000:00010000:2.0:1783444488.590537:0:6494:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368c9a17800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1783444488.590569:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27e00/0x42cb6883e38333b6 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d7b expref: 8 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444488.590603:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e383339a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d74 expref: 7 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444488.590619:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90800/0x42cb6883e3833481 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939db3 expref: 6 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444488.590763:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e38333f5 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d90 expref: 5 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444488.590780:0:6494:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368c9a17800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1783444488.592897:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9367cae8d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783444488.594280:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c511d000 for lustre-MDT0000 00000020:00080000:0.0:1783444488.594319:0:93731:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368c9a17800): rc 0 00000020:00080000:0.0:1783444488.594326:0:93731:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9368c9a10800), last request at 1783444453 00000020:00000080:0.0:1783444488.594332:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832cf5 00000020:00010000:0.0:1783444488.594344:0:93731:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368c9a10800: total 0 00000100:00080000:0.0:1783444488.594349:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368c518c800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1783444488.595474:0:10324:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368c9a10800: total 0 00010000:00010000:1.0:1783444488.595541:0:10324:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368c9a10800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783444488.595579:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368e6f05800/0x42cb6883e3832ec3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832ebc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.595602:0:10324:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368c9a10800, canceled 1 locks, left on hash table 0. 00000020:00080000:0.0:1783444488.601776:0:93731:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c9a10800): rc 0 00000004:00000080:0.0:1783444488.601800:0:93731:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac1c40e33ae0 00000100:00080000:0.0:1783444488.601826:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783444488.601831:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1783444488.602019:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783444488.604997:0:93731:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783444488.605099:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368ef128000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783444488.605159:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575397504:0@lo:39:umount.0 00000100:00100000:0.0:1783444488.605230:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444488.605722:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575397504 00000100:00100000:3.0:1783444488.605731:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575397504 00000100:00100000:3.0:1783444488.605804:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:3.0:1783444488.605814:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575397504:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783444488.605842:0:29151:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d3b 00000100:00080000:3.0:1783444488.605850:0:29151:0:(import.c:65:import_set_state_nolock()) ffff9367c5620000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444488.605871:0:29151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411468 00000100:00100000:3.0:1783444488.606022:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3632:x1870073575397504:12345-0@lo:39:umount.0 Request processed in 209us (791us total) trans 77309411469 rc 0/0 00000100:00100000:3.0:1783444488.606030:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00010000:00010000:3.0:1783444488.606053:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783444488.606082:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ef128000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783444488.606089:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575397504:0@lo:39:umount.0 00000100:00080000:0.0:1783444488.607038:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783444488.607042:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 3 00000004:00080000:0.0:1783444488.607055:0:93731:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783444488.607116:0:93731:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783444488.607150:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368ff68c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783444488.607165:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783444488.607167:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969456 gen 3 00000004:00080000:0.0:1783444488.607176:0:93731:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783444488.607230:0:93731:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783444488.607239:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9368ead89800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783444488.607279:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368e7123380) has no exports 00000100:00100000:3.0:1783444488.607501:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575397632:0@lo:9:umount.0 00000100:00100000:3.0:1783444488.607547:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444488.607576:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575397760:0@lo:9:umount.0 00000100:00100000:3.0:1783444488.607597:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444488.608013:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575397632 00000100:00100000:3.0:1783444488.608020:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575397632 00000100:00100000:3.0:1783444488.608065:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575397760 00000100:00100000:3.0:1783444488.608068:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575397760 00000100:00100000:3.0:1783444488.608091:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:3.0:1783444488.608100:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575397632:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783444488.608123:0:26207:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d57 00000100:00080000:3.0:1783444488.608138:0:26207:0:(import.c:65:import_set_state_nolock()) ffff9368eb18b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444488.608173:0:26207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1783444488.608288:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575397632:12345-0@lo:9:umount.0 Request processed in 189us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444488.608295:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00100000:3.0:1783444488.608309:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:3.0:1783444488.608314:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575397760:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783444488.608325:0:26207:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d6c 00000100:00080000:3.0:1783444488.608330:0:26207:0:(import.c:65:import_set_state_nolock()) ffff9368ef0b1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444488.608348:0:26207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969459 00000100:00100000:3.0:1783444488.608417:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3632:x1870073575397760:12345-0@lo:9:umount.0 Request processed in 102us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444488.608423:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00000100:00080000:3.0:1783444488.608442:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444488.608446:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783444488.608457:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444488.608462:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783444488.608490:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ff68c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783444488.608500:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783444488.608502:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444488.608505:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575397632:0@lo:9:umount.0 00000100:00080000:3.0:1783444488.608516:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368ead89800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783444488.608519:0:3632:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783444488.608520:0:3632:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444488.608522:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575397760:0@lo:9:umount.0 00000020:00080000:0.0:1783444488.631122:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9368e7123380) has no exports 00000020:00000080:2.0:1783444488.646554:0:6494:0:(genops.c:906:class_export_put()) final put ffff9368c9a17800/08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:2.0:1783444488.646616:0:50586:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a17800/08efc25c-17e5-4d29-97d2-f1505f195a06 for lustre-MDT0000 00000020:00000080:2.0:1783444488.646688:0:50586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ea60e000 for lustre-MDT0000 00010000:00010000:3.0:1783444488.646863:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444488.646867:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444488.646871:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783444488.655388:0:10324:0:(genops.c:906:class_export_put()) final put ffff9368c9a10800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783444488.655453:0:92152:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a10800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783444488.655503:0:92152:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c518c800 for lustre-MDT0000 00010000:00010000:1.0:1783444488.662331:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444488.662340:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444488.662343:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783444488.714483:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d11 00000020:00000080:0.0:1783444488.714500:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368cb786800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783444488.714512:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783444488.714625:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368cb786800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783444488.714755:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444488.714769:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783444488.714774:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9367c1e80000) has no exports 00000020:00000080:1.0:1783444488.724036:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d0a 00000020:00000080:1.0:1783444488.724051:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368ff68f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444488.724072:0:92152:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff68f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783444488.724132:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444488.724147:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783444488.724150:0:93731:0:(genops.c:906:class_export_put()) final put ffff9367c17cc800/lustre-QMT0000_UUID 00000020:00000080:1.0:1783444488.724153:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17cc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783444488.724158:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1783444488.724333:0:93731:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9368e3843c00 - data ffff9368f63db360/ffff9368ea4e3c00 00000020:01000000:1.0:1783444488.724471:0:93731:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c4c3d0c0 - data ffff9368ffbc2360/ffff9367c7ac5000 00000100:00080000:3.0:1783444488.774148:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783444488.774173:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783444488.774188:0:93731:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9367c68f2a00 x1870073575397504/t77309411469(77309411469) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444498 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444488.774218:0:93731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783444488.776014:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783444488.776019:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 4 00000004:00080000:3.0:1783444488.776123:0:93731:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444488.776126:0:93731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783444488.780301:0:92456:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783444488.780309:0:92456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 1 count 1 00000040:00080000:0.0:1783444488.780320:0:92456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:3.0:1783444488.781063:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783444488.781069:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969456 gen 4 00000004:00080000:3.0:1783444488.781092:0:93731:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444488.781094:0:93731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783444488.781424:0:92458:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783444488.781429:0:92458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:0.0:1783444488.781436:0:92458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:3.0:1783444488.782298:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832cc4 00000020:00000080:3.0:1783444488.782309:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c88cf000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444488.782384:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88cf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783444488.783026:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832cd9 00000020:00000080:3.0:1783444488.783035:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c9a10000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783444488.783042:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783444488.783048:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a10000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1783444488.783058:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444488.783069:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783444488.783074:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9368e7120000) has no exports 00000004:01000000:3.0:1783444488.783270:0:93731:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783444488.783279:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d65 00000020:00000080:3.0:1783444488.783283:0:93731:0:(genops.c:906:class_export_put()) final put ffff936901db8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783444488.783290:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783444488.783297:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff936901db8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783444488.783307:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444488.783314:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783444488.783316:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9367c3334d40) has no exports 00000020:00000080:3.0:1783444488.783321:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d5e 00000020:00000080:3.0:1783444488.783338:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368ead8a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444488.783349:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ead8a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783444488.784166:0:93731:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783444488.784172:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783444488.784176:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969456 gen 5 00000004:00080000:3.0:1783444488.784181:0:93731:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444488.784183:0:93731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783444488.784207:0:92306:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ead89800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1783444488.784245:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783444488.784256:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444488.784260:0:93731:0:(genops.c:906:class_export_put()) final put ffff9367c765d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444488.784262:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c765d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1783444488.784267:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444488.784344:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d49 00000020:00000080:3.0:1783444488.784349:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368dd224000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783444488.784355:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783444488.784362:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd224000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783444488.784371:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444488.784376:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783444488.784378:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9367c3330000) has no exports 00000020:00000080:3.0:1783444488.784383:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d34 00000020:00000080:3.0:1783444488.784386:0:93731:0:(genops.c:906:class_export_put()) final put ffff9367c17cf800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444488.784396:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17cf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783444488.784967:0:93731:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783444488.784972:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783444488.784974:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 5 00000004:00080000:3.0:1783444488.784978:0:93731:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783444488.784980:0:93731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783444488.784995:0:92306:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff68c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1783444488.785023:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783444488.785040:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444488.785043:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c88ca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444488.785045:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88ca800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1783444488.785049:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783444488.785097:0:93731:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783444488.785102:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d26 00000020:00000080:3.0:1783444488.785107:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c88cb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783444488.785113:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783444488.785119:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88cb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783444488.785127:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783444488.785132:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783444488.785135:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9367c1e83380) has no exports 00000020:00000080:3.0:1783444488.785139:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d1f 00000020:00000080:3.0:1783444488.785142:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368eab70800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783444488.785150:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eab70800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1783444488.827863:0:93731:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1783444488.827873:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783444488.827878:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783444488.827887:0:93731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444488.827922:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef128000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783444488.827974:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444488.827993:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444488.827998:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c88cb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444488.828002:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88cb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783444488.828017:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444488.828129:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444488.828135:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444488.828148:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368dd220000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783444488.828150:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd220000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783444488.828155:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783444488.828212:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832ce0 00000020:00000080:0.0:1783444488.828220:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c9a11000/lustre-MDD0000_UUID 00000020:01000000:0.0:1783444488.828227:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783444488.828236:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a11000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783444488.828247:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444488.828253:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783444488.828258:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9368e7124d40) has no exports 00000020:00000080:0.0:1783444488.828277:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444488.828281:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444488.828283:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368dd221800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783444488.828285:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd221800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783444488.828289:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1783444488.828319:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832ce7 00000020:00000080:0.0:1783444488.828325:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c9a14000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444488.828337:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c9a14000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783444488.828349:0:93731:0:(tgt_mount.c:187:server_put_mount()) put mount ffff936901f97800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783444488.828353:0:93731:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936901f97800 3 00000020:01000004:0.0:1783444488.828357:0:93731:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff936901f97800 from lustre-MDT0000 00000020:00000080:0.0:1783444488.828378:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444488.828383:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783444488.828386:0:93731:0:(genops.c:906:class_export_put()) final put ffff9368c88ce000/lustre-MDT0000_UUID 00000020:00000080:0.0:1783444488.828388:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c88ce000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783444488.828397:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783444488.828427:0:93731:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1783444488.828431:0:93731:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783444488.828434:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783444488.828437:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444488.828440:0:93731:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783444488.828448:0:93731:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9367c5625800 28921b6e-3bc9-4a81-ae87-1992169ba754 192.168.204.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444488.828461:0:93731:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9367cae88000 c89ab73b-dbb2-4305-b221-37cc64d61227 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444488.828466:0:93731:0:(genops.c:1574:class_disconnect_exports()) OBD device 4 (ffff9367c2c619c0) has exports, disconnecting them 00000020:00080000:0.0:1783444488.828471:0:93731:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.204.20@tcp (ffff9367c5625800), last request at 1783444453 00000020:00000080:0.0:1783444488.828489:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832d42 00000020:00010000:0.0:1783444488.828495:0:93731:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9367c5625800: total 0 00000100:00080000:0.0:1783444488.828499:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9367c5626800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444488.828519:0:93731:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9367c5625800): rc 0 00000020:00080000:0.0:1783444488.828523:0:93731:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9367cae88000), last request at 1783444453 00000020:00000080:0.0:1783444488.828563:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832c8c 00000020:00010000:0.0:1783444488.828567:0:93731:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9367cae88000: total 0 00000100:00080000:0.0:1783444488.828569:0:93731:0:(import.c:65:import_set_state_nolock()) ffff9367cae8e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783444488.828585:0:93731:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367cae88000): rc 0 00000020:00080000:0.0:1783444488.828589:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9367c2c619c0) has no exports 00000100:00100000:0.0:1783444488.828677:0:92444:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9368c120b200:92444] 1 exiting: rc = 0 00000020:00010000:1.0:1783444488.828899:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9367c5625800: total 0 00010000:00010000:1.0:1783444488.828938:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9367c5625800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1783444488.828971:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27200/0x42cb6883e383327b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d4a expref: 5 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.828989:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4c10c00/0x42cb6883e3832e76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939cd3 expref: 4 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829003:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031200/0x42cb6883e383323c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939d43 expref: 3 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829016:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71600/0x42cb6883e3832e84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ce1 expref: 2 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829025:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9367c5625800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1783444488.829043:0:6493:0:(genops.c:906:class_export_put()) final put ffff9367c5625800/28921b6e-3bc9-4a81-ae87-1992169ba754 00000020:00010000:1.0:1783444488.829052:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9367cae88000: total 1 00010000:00010000:1.0:1783444488.829055:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444488.829072:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9367cae88000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783444488.829089:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833290 expref: 14 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829112:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf90c00/0x42cb6883e3833266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383325f expref: 13 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829123:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833289 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833282 expref: 12 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829134:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4750e00/0x42cb6883e3832e29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832e22 expref: 11 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829143:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513ac00/0x42cb6883e38332c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38332ba expref: 10 pid: 92448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829153:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0031a00/0x42cb6883e38332a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383329e expref: 9 pid: 92443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829162:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91800/0x42cb6883e3833274 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383326d expref: 8 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829171:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91400/0x42cb6883e38332b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e38332ac expref: 7 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829182:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70a00/0x42cb6883e3832e53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832e4c expref: 6 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829192:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4750a00/0x42cb6883e3832dd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832dce expref: 5 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829205:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751a00/0x42cb6883e3832e61 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832e5a expref: 4 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829231:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c4751400/0x42cb6883e3832df1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832dea expref: 3 pid: 92444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829242:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368e6f05400/0x42cb6883e3832dff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3832df8 expref: 2 pid: 92445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444488.829250:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9367cae88000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783444488.829263:0:6493:0:(genops.c:906:class_export_put()) final put ffff9367cae88000/c89ab73b-dbb2-4305-b221-37cc64d61227 00010000:00010000:1.0:1783444488.829267:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444488.829269:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444488.829271:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444488.829300:0:92448:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9368e78fe000:92448] 3 exiting: rc = 0 00000020:00000080:1.0:1783444488.829342:0:92152:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5625800/28921b6e-3bc9-4a81-ae87-1992169ba754 for MGS 00000020:00000080:1.0:1783444488.829359:0:92152:0:(genops.c:865:class_export_destroy()) destroying export ffff9367cae88000/c89ab73b-dbb2-4305-b221-37cc64d61227 for MGS 00000020:00000080:1.0:1783444488.829371:0:92152:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c5626800 for MGS 00000020:00000080:1.0:1783444488.829375:0:92152:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367cae8e800 for MGS 00010000:00010000:3.0:1783444488.830216:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444488.846877:0:92445:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9367c7640400:92445] 2 exiting: rc = 0 00000100:00100000:3.0:1783444488.848932:0:92443:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9368d4db1e00:92443] 0 exiting: rc = 1 00000100:00100000:0.0:1783444488.849066:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849075:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849082:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849089:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849096:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849101:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849107:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849113:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849119:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849124:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849129:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849135:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849141:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849157:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849165:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849170:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849175:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849193:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849199:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849204:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849211:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849217:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849223:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849228:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849234:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849239:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849244:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849248:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849254:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849258:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849263:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849269:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849273:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849278:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849283:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849289:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849294:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849299:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849304:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849309:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849314:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849320:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849325:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849330:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849336:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849340:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849345:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849350:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849356:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849361:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849366:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849388:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849400:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849406:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849411:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849416:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849422:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849427:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849432:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849437:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849442:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849447:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849453:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783444488.849458:0:93731:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1783444488.850689:0:93731:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c3803ba0 - data ffff9368f63d85e8/ffff9367c7ac5400 00000020:01000000:0.0:1783444488.850834:0:93731:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c46af8a0 - data ffff9368ff941af8/ffff9368f8cf9c00 00000020:00000080:0.0:1783444488.851247:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832c85 00000020:00000080:0.0:1783444488.851255:0:93731:0:(genops.c:906:class_export_put()) final put ffff9367c5621000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783444488.851268:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5621000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1783444488.851280:0:93731:0:(tgt_mount.c:187:server_put_mount()) put mount ffff936901f97800 from MGS, refs=2 00000020:01000004:0.0:1783444488.851284:0:93731:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936901f97800 2 00000020:01000004:0.0:1783444488.851287:0:93731:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff936901f97800 from MGS 00000020:00000080:0.0:1783444488.851307:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444488.851314:0:93731:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1783444488.851316:0:93731:0:(genops.c:906:class_export_put()) final put ffff9367c5622000/MGS 00000020:00000080:0.0:1783444488.851318:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5622000/MGS for MGS 00000020:01000000:0.0:1783444488.851324:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1783444488.851396:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1783444488.851400:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444488.851409:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783444488.851414:0:93731:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9367cae8e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444488.851420:0:93731:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9367c33319c0) has exports, disconnecting them 00000020:00080000:0.0:1783444488.851425:0:93731:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9367cae8e000), last request at 1783444453 00000020:00000080:0.0:1783444488.851429:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832da4 00000020:00080000:0.0:1783444488.851450:0:93731:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367cae8e000): rc 0 00000020:00000080:0.0:1783444488.851454:0:93731:0:(genops.c:906:class_export_put()) final put ffff9367cae8e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783444488.851472:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9367cae8e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1783444488.852930:0:93731:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1783444488.852938:0:93731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783444488.852942:0:93731:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783444488.852948:0:93731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783444488.852970:0:92152:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c6bc8000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783444488.853079:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444488.853090:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1783444488.853094:0:93731:0:(genops.c:906:class_export_put()) final put ffff93690069a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783444488.853097:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff93690069a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783444488.853108:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1783444488.853180:0:93731:0:(obd_mount.c:710:lustre_put_lsi()) put ffff936901f97800 1 00000020:00000080:1.0:1783444488.853185:0:93731:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832c77 00000020:00000080:1.0:1783444488.853199:0:93731:0:(genops.c:906:class_export_put()) final put ffff9367c5621800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1783444488.853207:0:93731:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1783444488.853214:0:92152:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5621800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783444488.853223:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444488.853228:0:93731:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783444488.853231:0:93731:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9368dd0eb380) has no exports 00000020:00000080:1.0:1783444488.975882:0:93731:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444488.975899:0:93731:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783444488.975905:0:93731:0:(genops.c:906:class_export_put()) final put ffff936901f90000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783444488.975910:0:93731:0:(genops.c:865:class_export_destroy()) destroying export ffff936901f90000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783444488.975922:0:93731:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783444488.976042:0:93731:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff936901f97000 00000020:02000400:1.0:1783444488.976111:0:93731:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783444489.248211:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444489.502044:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575398016:0@lo:400:kworker.0 00000400:00000100:2.0:1783444489.502100:0:3634:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575398016 offset 0 length 224: 4 00000100:00100000:2.0:1783444489.502136:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575398528:0@lo:400:kworker.0 00000100:00100000:2.0:1783444489.502163:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444489.502817:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575399040:0@lo:400:kworker.0 00000100:00100000:2.0:1783444489.502847:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444489.502875:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783444489.502881:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575397888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444489.502909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444489.502927:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575398400:0@lo:400:kworker.0 00000100:00100000:2.0:1783444489.502944:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444489.503077:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575398144:0@lo:400:kworker.0 00000100:00100000:0.0:1783444489.503112:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575398272:0@lo:400:kworker.0 00000100:00100000:0.0:1783444489.503142:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575398528 00000100:00100000:0.0:1783444489.503150:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575398528 00000100:00100000:0.0:1783444489.503215:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575399040 00000100:00100000:0.0:1783444489.503218:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575399040 00000100:00100000:0.0:1783444489.503241:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1783444489.503250:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575398528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444489.503302:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575398528:12345-0@lo:400:kworker.0 Request processed in 53us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444489.503309:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1783444489.503327:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1783444489.503331:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1870073575399040:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444489.503336:0:66225:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783444489.503361:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1870073575399040:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444489.503366:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00080000:0.0:1783444489.503382:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444489.503521:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575398912:0@lo:400:kworker.0 00000100:00100000:2.0:1783444489.503546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444489.503583:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575398528:0@lo:400:kworker.0 00000100:00080000:2.0:1783444489.503594:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783444489.503599:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783444489.503603:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783444489.503608:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444489.503612:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3449 00000100:00080000:2.0:1783444489.503618:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444489.503643:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e68f6a00 x1870073575399168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444489.504069:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575399040:0@lo:400:kworker.0 00000100:00100000:2.0:1783444489.504101:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575398400 00000100:00100000:2.0:1783444489.504106:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575398400 00000100:00100000:2.0:1783444489.504129:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:2.0:1783444489.504135:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1870073575398400:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783444489.504140:0:67017:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783444489.505291:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1870073575398400:12345-0@lo:400:kworker.0 Request processed in 1150us (2340us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783444489.505302:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:2.0:1783444489.505338:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575397888 00000100:00100000:2.0:1783444489.505344:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575397888 00000100:00100000:2.0:1783444489.505376:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1783444489.505382:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3634:x1870073575397888:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1783444489.505389:0:8431:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783444489.505436:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3634:x1870073575397888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (2526us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783444489.505444:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1783444489.505463:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575398912 00000100:00100000:2.0:1783444489.505466:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575398912 00000100:00100000:2.0:1783444489.505502:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512 00000100:00100000:2.0:1783444489.505508:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575398912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444489.505545:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575398912:12345-0@lo:400:kworker.0 Request processed in 38us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444489.505552:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512 00000100:00100000:2.0:1783444489.505574:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575399168:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783444489.505606:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:2.0:1783444489.505683:0:3634:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1783444489.505688:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783444489.505692:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783444489.505696:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783444489.505702:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444489.505707:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3449 00000100:00080000:2.0:1783444489.505712:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444489.505736:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e68f4380 x1870073575399296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444489.505761:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783444489.505764:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783444489.505767:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783444489.505771:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444489.505781:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3449 00000100:00080000:2.0:1783444489.505785:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444489.505815:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e68f4e00 x1870073575399424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444489.505827:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575398400:0@lo:400:kworker.0 00000100:00100000:2.0:1783444489.505845:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575398912:0@lo:400:kworker.0 00000100:00100000:2.0:1783444489.505875:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575399296:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783444489.505901:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444489.505919:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e68f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575399424:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783444489.505939:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444489.506076:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575399168 00000100:00100000:0.0:1783444489.506081:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575399168 00000100:00100000:0.0:1783444489.506103:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575399424 00000100:00100000:0.0:1783444489.506106:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575399424 00000100:00100000:0.0:1783444489.506123:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1783444489.506128:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575399168:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1783444489.506146:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444489.506196:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575399168:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 65us (588us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444489.506203:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1783444489.506217:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1783444489.506221:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575399424:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1783444489.506231:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444489.506254:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575399424:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31us (314us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444489.506260:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1783444489.506280:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444489.506302:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575398784:0@lo:400:kworker.0 00000100:00100000:0.0:1783444489.506327:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444489.506362:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444489.506377:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:0:1870073575398656:0@lo:400:kworker.0 00000100:00100000:0.0:1783444489.506399:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575398272 00000100:00100000:0.0:1783444489.506403:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575398272 00000100:00100000:0.0:1783444489.506426:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575398144 00000100:00100000:0.0:1783444489.506429:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575398144 00000100:00100000:0.0:1783444489.506439:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1783444489.506445:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575398272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444489.506484:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575398272:12345-0@lo:400:kworker.0 Request processed in 38us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444489.506490:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1783444489.506503:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1783444489.506507:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3635:x1870073575398144:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783444489.506511:0:80475:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783444489.506546:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3635:x1870073575398144:12345-0@lo:400:kworker.0 Request processed in 37us (183us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444489.506552:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00080000:0.0:1783444489.506568:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444489.506572:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444489.506590:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575398784 00000100:00100000:0.0:1783444489.506593:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575398784 00000100:00100000:0.0:1783444489.506622:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1783444489.506629:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575398784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444489.506673:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575398784:12345-0@lo:400:kworker.0 Request processed in 45us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444489.506680:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1783444489.506707:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575398272:0@lo:400:kworker.0 00000100:00100000:0.0:1783444489.506718:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575398784:0@lo:400:kworker.0 00000100:00080000:0.0:1783444489.506743:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783444489.506747:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783444489.506750:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783444489.506753:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444489.506757:0:3635:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3449 00000100:00080000:0.0:1783444489.506762:0:3635:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444489.506779:0:3635:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9369018a8a80 x1870073575399552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444489.506815:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575398144:0@lo:400:kworker.0 00000100:00080000:0.0:1783444489.506834:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444489.508058:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575399552:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783444489.508102:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783444489.508146:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444489.508151:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444489.508155:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575399424:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1783444489.508284:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444489.508289:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444489.508293:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575399168:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783444489.508332:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575399296 00000100:00100000:2.0:1783444489.508338:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575399296 00000100:00100000:2.0:1783444489.508369:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:2.0:1783444489.508375:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575399296:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1783444489.508394:0:29151:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444489.508443:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575399296:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 66us (2540us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444489.508449:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00080000:2.0:1783444489.508478:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444489.508482:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444489.508485:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e68f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575399296:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1783444489.509186:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575399552 00000100:00100000:0.0:1783444489.509199:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575399552 00000100:00100000:0.0:1783444489.509235:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1783444489.509241:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575399552:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1783444489.509256:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444489.509301:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575399552:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 58us (1198us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444489.509308:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00080000:0.0:1783444489.509336:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444489.509341:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444489.509344:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575399552:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1783444490.271661:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444491.038054:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444491.038150:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575399680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444491.038222:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444491.038275:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575399680 00000100:00100000:3.0:1783444491.038283:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575399680 00000100:00080000:0.0:1783444491.038362:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444491.039512:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:3.0:1783444491.039527:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575399680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444491.039558:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444491.039654:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575399680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444491.039661:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:3.0:1783444491.039712:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575399680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444491.042396:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444491.042423:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575399808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444491.042596:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444491.042748:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575399808 00000100:00100000:1.0:1783444491.042755:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575399808 00000100:00100000:1.0:1783444491.042843:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:1.0:1783444491.042853:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575399808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444491.042893:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444491.042939:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575399808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444491.043134:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00080000:3.0:1783444491.043232:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444491.043272:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575399808:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1783444491.045734:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783444491.045750:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411469 is committed 00000020:00000080:0.0:1783444491.045755:0:75651:0:(genops.c:906:class_export_put()) final put ffff9367c5624000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783444491.045783:0:75651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411468 is committed 00000020:00000080:0.0:1783444491.045831:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c5624000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783444491.048110:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c5620000 for lustre-MDT0001 00010000:00010000:2.0:1783444491.049711:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.049727:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.049736:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.049742:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513be00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444491.049747:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.049755:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.049775:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff9368c3254200) 00010000:00010000:2.0:1783444491.049778:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444491.049783:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.050690:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513be00/0x42cb6883e38334c0 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.050739:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.050745:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.050751:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.050757:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444491.050761:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.050767:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.050778:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9368c59a7600) 00010000:00010000:2.0:1783444491.050781:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444491.050785:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051518:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c0031c00/0x42cb6883e38334d5 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051537:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051543:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051550:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051563:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444491.051567:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051573:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051659:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff9368c3254400) 00010000:00010000:2.0:1783444491.051662:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444491.051666:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051671:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513b400/0x42cb6883e383351b lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051690:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051696:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051700:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051704:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ba00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444491.051707:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051712:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051730:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9368c3254b00) 00010000:00010000:2.0:1783444491.051732:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444491.051735:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444491.051740:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9368c513ba00/0x42cb6883e3833530 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444491.296534:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1783444491.338181:0:3628:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557836032 offset 0 length 224: 4 00000100:00100000:2.0:1783444491.338234:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444491.338267:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444491.338300:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444491.338324:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444491.338350:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557836288 00000100:00100000:2.0:1783444491.338359:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557836288 00000100:00100000:2.0:1783444491.338414:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557836160 00000100:00100000:2.0:1783444491.338417:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557836160 00000100:00100000:2.0:1783444491.338437:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1114 00000100:00100000:2.0:1783444491.338447:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557836288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444491.338522:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557836288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444491.338530:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1114 00000100:00100000:2.0:1783444491.338546:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1405 00000100:00100000:2.0:1783444491.338551:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1870073557836160:12345-192.168.204.20@tcp:400:kworker.0 00000020:00080000:2.0:1783444491.338558:0:66223:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.20@tcp 00000100:00100000:2.0:1783444491.338582:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2404:x1870073557836160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (281us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783444491.338598:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1405 00000100:00100000:2.0:1783444491.338615:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557836544 00000100:00100000:2.0:1783444491.338629:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557836544 00000100:00100000:2.0:1783444491.338654:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557836416 00000100:00100000:2.0:1783444491.338656:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557836416 00000100:00100000:2.0:1783444491.338678:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2514 00000100:00100000:2.0:1783444491.338684:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557836544:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444491.338710:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557836544:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444491.338716:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2514 00000100:00100000:2.0:1783444491.338726:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2515 00000100:00100000:2.0:1783444491.338732:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557836416:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444491.338753:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557836416:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444491.338759:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2515 00000100:00080000:3.0:1783444491.338950:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444491.338956:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444491.338959:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444491.344976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444491.345051:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557836672 00000100:00100000:3.0:1783444491.345060:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557836672 00000100:00100000:3.0:1783444491.345101:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1406 00000100:00100000:3.0:1783444491.345110:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557836672:12345-192.168.204.20@tcp:38:ptlrpcd_01_01.0 00010000:00020000:3.0:1783444491.345142:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444491.345220:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557836672:12345-192.168.204.20@tcp:38:ptlrpcd_01_01.0 Request processed in 109us (256us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444491.345227:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1406 00000001:00100000:1.0:1783444492.066494:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783444492.066507:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368ef0b2800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783444492.066537:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969459 is committed 00000020:00000080:1.0:1783444492.066559:0:92152:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0b2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783444492.066639:0:92152:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ef0b1000 for lustre-OST0001 00010000:00010000:3.0:1783444492.318460:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444493.341259:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783444494.112727:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444494.112737:0:8415:0:(genops.c:906:class_export_put()) final put ffff9368eb18d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783444494.112778:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368eb18d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783444494.112849:0:92306:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368eb18b000 for lustre-OST0000 00010000:00010000:1.0:1783444494.365048:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444494.621614:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444494.621622:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444494.621626:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444494.621636:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3480 00000100:00080000:2.0:1783444494.621643:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444494.621650:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444494.621665:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575399936:0@lo:400:kworker.0 00000100:00100000:2.0:1783444494.621677:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c56f5880 x1870073575400064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1783444494.621719:0:3633:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575399936 offset 0 length 224: 4 00000100:00080000:2.0:1783444494.624856:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444494.624863:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444494.624865:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444494.624873:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3480 00000100:00080000:2.0:1783444494.624879:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444494.624885:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444494.624906:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69aed80 x1870073575400320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444494.624940:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444494.624943:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444494.624945:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444494.624950:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3480 00000100:00080000:2.0:1783444494.624952:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444494.624955:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444494.624968:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69adc00 x1870073575400576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444494.624991:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444494.624995:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444494.624996:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444494.624999:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3480 00000100:00080000:2.0:1783444494.625002:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783444494.625005:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444494.625015:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4369180 x1870073575400960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444494.625068:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575400448:0@lo:400:kworker.0 00000100:00100000:2.0:1783444494.625131:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444494.625170:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444494.625176:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575400704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444494.625201:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444494.625236:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575400448 00000100:00100000:2.0:1783444494.625242:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575400448 00000100:00100000:2.0:1783444494.625295:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1783444494.625305:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575400448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444494.625357:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575400448:12345-0@lo:400:kworker.0 Request processed in 54us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444494.625364:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00080000:2.0:1783444494.625384:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444494.625417:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575400448:0@lo:400:kworker.0 00000100:00100000:0.0:1783444494.625876:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575400064:0@lo:38:kworker.0 00000100:00100000:0.0:1783444494.625913:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444494.625939:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575400320:0@lo:38:kworker.0 00000100:00100000:0.0:1783444494.625988:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444494.626004:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575400704 00000100:00100000:3.0:1783444494.626011:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575400704 00000100:00100000:0.0:1783444494.626012:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575400576:0@lo:38:kworker.0 00000100:00100000:0.0:1783444494.626045:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444494.626060:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1783444494.626064:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575400960:0@lo:38:kworker.0 00000100:00100000:3.0:1783444494.626073:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575400704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444494.626087:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444494.626132:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575400064 00000100:00100000:0.0:1783444494.626136:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575400064 00000100:00100000:3.0:1783444494.626143:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575400704:12345-0@lo:400:kworker.0 Request processed in 74us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444494.626156:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575400320 00000100:00100000:0.0:1783444494.626160:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575400320 00000100:00100000:3.0:1783444494.626163:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1783444494.626175:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575400960 00000100:00100000:0.0:1783444494.626179:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575400960 00000100:00100000:0.0:1783444494.626197:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1783444494.626202:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575400192:0@lo:400:kworker.0 00000100:00100000:0.0:1783444494.626204:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575400064:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444494.626226:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444494.626237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444494.626259:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444494.626267:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575400832:0@lo:400:kworker.0 00000100:00100000:0.0:1783444494.626273:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575400064:12345-0@lo:38:kworker.0 Request processed in 67us (357us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444494.626281:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1783444494.626295:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575400192 00000100:00100000:3.0:1783444494.626300:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444494.626300:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575400192 00000100:00100000:0.0:1783444494.626326:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1783444494.626335:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575400192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444494.626338:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575400832 00000100:00100000:3.0:1783444494.626344:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575400832 00000100:00100000:3.0:1783444494.626374:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:3.0:1783444494.626382:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575400832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444494.626394:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575400192:12345-0@lo:400:kworker.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444494.626402:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1783444494.626419:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1783444494.626424:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575400832:12345-0@lo:400:kworker.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444494.626427:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575400320:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444494.626442:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444494.626451:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1783444494.626478:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575400320:12345-0@lo:38:kworker.0 Request processed in 50us (488us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444494.626486:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1783444494.626491:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575400832:0@lo:400:kworker.0 00000100:00100000:0.0:1783444494.626502:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1783444494.626508:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575400192:0@lo:400:kworker.0 00000100:00100000:0.0:1783444494.626509:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575400960:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444494.626524:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444494.626773:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575400960:12345-0@lo:38:kworker.0 Request processed in 263us (685us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444494.626780:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:0.0:1783444494.626841:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444494.626846:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444494.626850:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575400064:0@lo:38:kworker.0 00000100:00080000:0.0:1783444494.626860:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444494.626863:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444494.626866:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575400320:0@lo:38:kworker.0 00000100:00080000:0.0:1783444494.626874:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444494.626877:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444494.626880:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575400960:0@lo:38:kworker.0 00000100:00100000:2.0:1783444494.627259:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575400576 00000100:00100000:2.0:1783444494.627264:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575400576 00000100:00100000:2.0:1783444494.627334:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:2.0:1783444494.627339:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575400576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444494.627353:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444494.627398:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575400576:12345-0@lo:38:kworker.0 Request processed in 57us (1352us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783444494.627404:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444494.627406:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00080000:1.0:1783444494.627418:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444494.627420:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444494.627456:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575400704:0@lo:400:kworker.0 00000100:00080000:0.0:1783444494.627723:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444494.627729:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444494.627732:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575400576:0@lo:38:kworker.0 00010000:00010000:1.0:1783444495.389023:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444496.157616:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444496.157633:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444496.157639:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575401088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444496.157642:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575401216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444496.160304:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444496.160413:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575401088 00000100:00100000:0.0:1783444496.160428:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575401088 00000100:00100000:0.0:1783444496.160508:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:0.0:1783444496.160519:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575401088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444496.160561:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1783444496.160687:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444496.160765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444496.160866:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575401216 00000100:00100000:3.0:1783444496.160871:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575401216 00000100:00100000:3.0:1783444496.160909:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:3.0:1783444496.160916:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575401216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444496.160933:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444496.160971:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575401216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444496.160978:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00080000:1.0:1783444496.161119:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444496.161155:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575401216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444496.161363:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575401088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 846us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444496.161370:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:2.0:1783444496.161436:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575401088:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783444496.413429:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1783444496.460032:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557836800 offset 0 length 224: 4 00000100:00100000:2.0:1783444496.460067:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444496.460210:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444496.460286:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557836928 00000100:00100000:3.0:1783444496.460295:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557836928 00000100:00100000:3.0:1783444496.460345:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1410 00000100:00100000:3.0:1783444496.460353:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557836928:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:3.0:1783444496.460377:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444496.460437:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2400:x1870073557836928:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 84us (226us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444496.460445:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1410 00000100:00100000:3.0:1783444496.463370:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444496.463414:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444496.463471:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557837056 00000100:00100000:2.0:1783444496.463480:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557837056 00000100:00100000:2.0:1783444496.463564:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1117 00000100:00100000:2.0:1783444496.463573:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557837056:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444496.463641:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557837056:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 70us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444496.463648:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1117 00000100:00080000:1.0:1783444496.463829:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444496.465334:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557837184 00000100:00100000:0.0:1783444496.465346:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557837184 00000100:00100000:0.0:1783444496.465455:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557837312 00000100:00100000:0.0:1783444496.465459:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557837312 00000100:00100000:2.0:1783444496.465530:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2518 00000100:00100000:2.0:1783444496.465543:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557837184:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1783444496.465550:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444496.465556:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444496.465602:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557837184:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 63us (5534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444496.465611:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2518 00000100:00100000:0.0:1783444496.465666:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2519 00000100:00100000:0.0:1783444496.465675:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557837312:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444496.465706:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557837312:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 33us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444496.465714:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2519 00010000:00010000:3.0:1783444497.437240:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444498.461854:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444499.485558:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444499.741011:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444499.741018:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444499.741022:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444499.741034:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3485 00000100:00080000:2.0:1783444499.741040:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444499.741048:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444499.741074:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4368a80 x1870073575401472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444499.741120:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444499.741139:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444499.741141:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444499.741145:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3485 00000100:00080000:2.0:1783444499.741147:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444499.741152:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444499.741167:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4369180 x1870073575401728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444499.741182:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444499.741186:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444499.741187:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444499.741191:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3485 00000100:00080000:2.0:1783444499.741194:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444499.741197:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444499.741209:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69adc00 x1870073575401984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444499.741229:0:50586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444499.741232:0:50586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444499.741233:0:50586:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444499.741236:0:50586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3485 00000100:00080000:2.0:1783444499.741239:0:50586:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783444499.741243:0:50586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444499.741252:0:50586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e69ace00 x1870073575402368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444499.741284:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575401600:0@lo:400:kworker.0 00000100:00100000:2.0:1783444499.741356:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444499.741400:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444499.741405:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575401856:0@lo:400:kworker.0 00000100:00100000:2.0:1783444499.741429:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444499.741541:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575401472:0@lo:38:kworker.0 00000100:00100000:0.0:1783444499.741570:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444499.741599:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575401728:0@lo:38:kworker.0 00000100:00100000:0.0:1783444499.741617:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444499.741640:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575401984:0@lo:38:kworker.0 00000100:00100000:0.0:1783444499.741661:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444499.741673:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575402368:0@lo:38:kworker.0 00000100:00100000:0.0:1783444499.741688:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444499.741728:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575401600 00000100:00100000:0.0:1783444499.741735:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575401600 00000100:00100000:0.0:1783444499.741783:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575401856 00000100:00100000:0.0:1783444499.741786:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575401856 00000100:00100000:0.0:1783444499.741816:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575401472 00000100:00100000:0.0:1783444499.741818:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575401472 00000100:00100000:0.0:1783444499.741825:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575401728 00000100:00100000:0.0:1783444499.741827:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575401728 00000100:00100000:0.0:1783444499.741833:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575402368 00000100:00100000:0.0:1783444499.741835:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575402368 00000100:00100000:0.0:1783444499.741844:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1783444499.741852:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575401600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444499.741899:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575401600:12345-0@lo:400:kworker.0 Request processed in 47us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444499.741906:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1783444499.741921:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1783444499.741926:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575401856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444499.741949:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575401856:12345-0@lo:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444499.741954:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1783444499.741964:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:0.0:1783444499.741968:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575401472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444499.741988:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444499.741990:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1783444499.741998:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575401728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444499.742012:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444499.742017:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575401472:12345-0@lo:38:kworker.0 Request processed in 46us (445us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444499.742024:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:0.0:1783444499.742037:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1783444499.742041:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575402368:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1783444499.742049:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575401728:12345-0@lo:38:kworker.0 Request processed in 50us (429us total) trans 0 rc -19/-19 00010000:00020000:0.0:1783444499.742052:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444499.742058:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00080000:3.0:1783444499.742086:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444499.742091:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575402368:12345-0@lo:38:kworker.0 Request processed in 47us (399us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444499.742098:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1783444499.742101:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575402112:0@lo:400:kworker.0 00000100:00080000:0.0:1783444499.742132:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1783444499.742139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444499.742140:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444499.742146:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575401472:0@lo:38:kworker.0 00000100:00080000:0.0:1783444499.742161:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444499.742165:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444499.742166:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783444499.742170:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575401728:0@lo:38:kworker.0 00000100:00100000:3.0:1783444499.742176:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575401344:0@lo:400:kworker.0 00000100:00080000:0.0:1783444499.742183:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444499.742188:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444499.742192:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575402368:0@lo:38:kworker.0 00000400:00000100:3.0:1783444499.742198:0:3635:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575401344 offset 0 length 224: 4 00000100:00100000:2.0:1783444499.742214:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575402112 00000100:00100000:2.0:1783444499.742221:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575402112 00000100:00100000:3.0:1783444499.742231:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575402240:0@lo:400:kworker.0 00000100:00100000:0.0:1783444499.742242:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575401856:0@lo:400:kworker.0 00000100:00100000:0.0:1783444499.742259:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575401600:0@lo:400:kworker.0 00000100:00100000:3.0:1783444499.742267:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444499.742271:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:2.0:1783444499.742282:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575402112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444499.742300:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575402240 00000100:00100000:0.0:1783444499.742305:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575402240 00000100:00080000:3.0:1783444499.742309:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444499.742314:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444499.742339:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575402112:12345-0@lo:400:kworker.0 Request processed in 58us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444499.742341:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:3.0:1783444499.742350:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575402112:0@lo:400:kworker.0 00000100:00100000:2.0:1783444499.742353:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1783444499.742354:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575402240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444499.742398:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575402240:12345-0@lo:400:kworker.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444499.742406:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:3.0:1783444499.742426:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575402240:0@lo:400:kworker.0 00000100:00100000:1.0:1783444499.743813:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575401984 00000100:00100000:1.0:1783444499.743821:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575401984 00000100:00100000:1.0:1783444499.743859:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:1.0:1783444499.743865:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575401984:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444499.743882:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444499.743937:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575401984:12345-0@lo:38:kworker.0 Request processed in 71us (2275us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444499.743944:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00080000:0.0:1783444499.744582:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444499.744597:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444499.744601:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575401984:0@lo:38:kworker.0 00010000:00010000:3.0:1783444500.509977:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444501.278481:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575402624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444501.278498:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575402496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444501.278982:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444501.279093:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444501.279226:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575402496 00000100:00100000:3.0:1783444501.279236:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575402496 00000100:00100000:3.0:1783444501.279296:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575402624 00000100:00100000:3.0:1783444501.279300:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575402624 00000100:00100000:3.0:1783444501.279327:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:3.0:1783444501.279337:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575402496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444501.279370:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444501.279408:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:2.0:1783444501.279419:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575402624:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444501.279424:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575402496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (441us total) trans 0 rc 0/0 00002000:00000024:2.0:1783444501.279452:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444501.279530:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00080000:3.0:1783444501.279554:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444501.279559:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444501.279598:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575402496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444501.306331:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575402624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 26898us (27221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444501.306352:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:1.0:1783444501.307595:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369018a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575402624:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444501.541181:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444501.583969:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:2.0:1783444501.584019:0:3627:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557837440 offset 0 length 224: 4 00000100:00100000:2.0:1783444501.584049:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444501.584055:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557837696 00000100:00100000:3.0:1783444501.584075:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557837696 00000100:00100000:2.0:1783444501.584109:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444501.584178:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557837568 00000100:00100000:3.0:1783444501.584184:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557837568 00000100:00100000:2.0:1783444501.584199:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444501.584215:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1120 00000100:00100000:3.0:1783444501.584227:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557837696:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:1.0:1783444501.584347:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444501.584398:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1414 00000100:00100000:1.0:1783444501.584405:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557837568:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:1.0:1783444501.584442:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444501.584491:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557837696:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 266us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444501.584516:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1120 00000100:00100000:0.0:1783444501.585349:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557837952 00000100:00100000:0.0:1783444501.585364:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557837952 00000100:00100000:0.0:1783444501.585453:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557837824 00000100:00100000:0.0:1783444501.585457:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557837824 00000100:00100000:0.0:1783444501.585493:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2522 00000100:00100000:0.0:1783444501.585504:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557837952:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444501.589666:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5913 00000100:00100000:2.0:1783444501.589701:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2400:x1870073557837824:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:2.0:1783444501.589766:0:26200:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e383341f 00000100:00080000:2.0:1783444501.589781:0:26200:0:(import.c:65:import_set_state_nolock()) ffff9368c518a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783444501.589878:0:26200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:2.0:1783444501.590070:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+2:2400:x1870073557837824:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 386us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444501.590711:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5913 00010000:00010000:2.0:1783444501.590814:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444501.590827:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444501.590833:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444501.594853:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557837568:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 10435us (10732us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444501.594884:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1414 00000100:00100000:0.0:1783444501.603188:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557837952:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 17667us (19119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444501.603324:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2522 00010000:00010000:3.0:1783444502.558925:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444503.582085:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444504.605096:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444504.863077:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444504.863084:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444504.863087:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444504.863095:0:93851:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3490 00000100:00080000:2.0:1783444504.863101:0:93851:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444504.863107:0:93851:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444504.863127:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c509b100 x1870073575402880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444504.863155:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444504.863158:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444504.863160:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444504.863163:0:93851:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3490 00000100:00080000:2.0:1783444504.863165:0:93851:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444504.863168:0:93851:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444504.863176:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5099f80 x1870073575403136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444504.863217:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444504.863220:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444504.863222:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444504.863226:0:93851:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3490 00000100:00080000:2.0:1783444504.863228:0:93851:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444504.863231:0:93851:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444504.863240:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5098380 x1870073575403392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444504.863258:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444504.863262:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444504.863263:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444504.863266:0:93851:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3490 00000100:00080000:2.0:1783444504.863268:0:93851:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783444504.863271:0:93851:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444504.863279:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c509ad80 x1870073575403776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444504.863305:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575402880:0@lo:38:kworker.0 00000100:00100000:2.0:1783444504.863380:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444504.863418:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575403136:0@lo:38:kworker.0 00000100:00100000:2.0:1783444504.863437:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444504.863448:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575403392:0@lo:38:kworker.0 00000100:00100000:2.0:1783444504.863468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444504.863481:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575403776:0@lo:38:kworker.0 00000100:00100000:2.0:1783444504.863505:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444504.863538:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575403264:0@lo:400:kworker.0 00000100:00100000:2.0:1783444504.863557:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444504.863572:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444504.863577:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575403520:0@lo:400:kworker.0 00000100:00100000:2.0:1783444504.863595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444504.863627:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575402880 00000100:00100000:2.0:1783444504.863633:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575402880 00000100:00100000:2.0:1783444504.863658:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575403136 00000100:00100000:2.0:1783444504.863660:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575403136 00000100:00100000:2.0:1783444504.863669:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575403776 00000100:00100000:2.0:1783444504.863671:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575403776 00000100:00100000:2.0:1783444504.863677:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575403264 00000100:00100000:2.0:1783444504.863679:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575403264 00000100:00100000:2.0:1783444504.863705:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1783444504.863713:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575403264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444504.863754:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575403264:12345-0@lo:400:kworker.0 Request processed in 42us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444504.863761:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1783444504.863808:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1783444504.863813:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575402880:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444504.863832:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444504.863960:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575403008:0@lo:400:kworker.0 00000100:00100000:3.0:1783444504.864044:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575402752:0@lo:400:kworker.0 00000100:00100000:1.0:1783444504.864115:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1783444504.864120:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575403136:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444504.864130:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444504.865414:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1783444504.866499:0:3635:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575402752 offset 0 length 224: 4 00000100:00100000:3.0:1783444504.866548:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575403648:0@lo:400:kworker.0 00000100:00100000:3.0:1783444504.866591:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444504.866886:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575403520 00000100:00100000:0.0:1783444504.866896:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575403520 00000100:00100000:0.0:1783444504.866988:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575403648 00000100:00100000:0.0:1783444504.866992:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575403648 00000100:00100000:1.0:1783444504.867118:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575403136:12345-0@lo:38:kworker.0 Request processed in 2981us (3664us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444504.867129:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1783444504.867149:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575403008 00000100:00100000:1.0:1783444504.867152:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575403008 00000100:00100000:1.0:1783444504.867176:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1783444504.867182:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575403008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444504.867235:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575403008:12345-0@lo:400:kworker.0 Request processed in 53us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444504.867240:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1783444504.867270:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1783444504.867275:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575403776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444504.867292:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444504.867645:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3632:x1870073575403776:12345-0@lo:38:kworker.0 Request processed in 367us (4137us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444504.867652:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1783444504.867702:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575403008:0@lo:400:kworker.0 00000100:00100000:3.0:1783444504.867780:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:3.0:1783444504.867812:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575403520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444504.867959:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575403520:12345-0@lo:400:kworker.0 Request processed in 66us (4256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444504.867966:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:3.0:1783444504.867982:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1783444504.867988:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575403648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444504.868025:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575403648:12345-0@lo:400:kworker.0 Request processed in 37us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444504.868032:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1783444504.868059:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575403648:0@lo:400:kworker.0 00000100:00100000:1.0:1783444504.868505:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575403392 00000100:00100000:1.0:1783444504.868512:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575403392 00000100:00100000:1.0:1783444504.868550:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:1.0:1783444504.868554:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575403392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444504.868583:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444504.868620:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575403392:12345-0@lo:38:kworker.0 Request processed in 64us (5151us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444504.868627:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:0.0:1783444504.868988:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575403520:0@lo:400:kworker.0 00000100:00100000:0.0:1783444504.869004:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575403264:0@lo:400:kworker.0 00000100:00080000:0.0:1783444504.869041:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444504.869046:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444504.869049:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575402880:0@lo:38:kworker.0 00000100:00080000:0.0:1783444504.869059:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444504.869063:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444504.869066:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575403136:0@lo:38:kworker.0 00000100:00080000:0.0:1783444504.869089:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444504.869093:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444504.869095:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575403392:0@lo:38:kworker.0 00000100:00080000:3.0:1783444504.869192:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444504.869198:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444504.869202:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444504.869236:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444504.869240:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444504.869405:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575403776:0@lo:38:kworker.0 00000100:00100000:2.0:1783444504.869485:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575402880:12345-0@lo:38:kworker.0 Request processed in 5667us (6103us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444504.869495:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00000400:2.0:1783444505.437225:0:3634:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444489/real 1783444489] req@ffff9367c56f7800 x1870073575398016/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444505 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444505.437281:0:3634:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9367c56f7800 x1870073575398016/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444505.437291:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783444505.437295:0:3634:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1783444505.437299:0:3634:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783444505.437301:0:3634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783444505.437305:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c56f7800 x1870073575398016/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1783444505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444505.437324:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c56f6300 x1870073575399936/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444510 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444505.437356:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c4369f80 x1870073575401344/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444505.437391:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575399936:0@lo:400:kworker.0 00000100:00100000:2.0:1783444505.437422:0:3634:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9367c509b800 x1870073575402752/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444520 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783444505.437431:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783444505.437434:0:3634:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783444505.437436:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783444505.437438:0:3634:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1783444505.437462:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575398016:0@lo:400:kworker.0 00000100:00100000:1.0:1783444505.438862:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575401344:0@lo:400:kworker.0 00000100:00080000:2.0:1783444505.442187:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444505.442198:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1783444505.442202:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444505.442210:0:93851:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3444 00000100:00080000:2.0:1783444505.442219:0:93851:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444505.442249:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e6300 x1870073575403904/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444505.442289:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444505.442293:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444505.442295:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444505.442298:0:93851:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3495 00000100:00080000:2.0:1783444505.442301:0:93851:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444505.442305:0:93851:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444505.442335:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e5880 x1870073575404032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444505.442376:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444505.442380:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444505.442382:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444505.442385:0:93851:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3495 00000100:00080000:2.0:1783444505.442387:0:93851:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444505.442390:0:93851:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444505.442401:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e7480 x1870073575404288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444505.442425:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444505.442428:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444505.442430:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444505.442433:0:93851:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3495 00000100:00080000:2.0:1783444505.442436:0:93851:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444505.442439:0:93851:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444505.442451:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e4a80 x1870073575404544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444505.442479:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444505.442482:0:93851:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444505.442484:0:93851:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444505.442488:0:93851:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3495 00000100:00080000:2.0:1783444505.442490:0:93851:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444505.442494:0:93851:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444505.442505:0:93851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e6a00 x1870073575404928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444505.442529:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575404416:0@lo:400:kworker.0 00000100:00100000:2.0:1783444505.442588:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444505.442621:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444505.442627:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575404672:0@lo:400:kworker.0 00000100:00100000:2.0:1783444505.442649:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444505.442676:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575404416 00000100:00100000:2.0:1783444505.442683:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575404416 00000100:00100000:2.0:1783444505.442727:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1783444505.442736:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575404416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444505.442803:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575404416:12345-0@lo:400:kworker.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444505.442811:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1783444505.442836:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575404672 00000100:00100000:2.0:1783444505.442839:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575404672 00000100:00100000:2.0:1783444505.442864:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:2.0:1783444505.442870:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575404672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444505.442900:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575404672:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444505.442911:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:2.0:1783444505.442949:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575404672:0@lo:400:kworker.0 00000100:00100000:2.0:1783444505.442958:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575404416:0@lo:400:kworker.0 00000100:00100000:1.0:1783444505.443673:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575404800:0@lo:400:kworker.0 00000100:00100000:1.0:1783444505.443708:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444505.443743:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575402752:0@lo:400:kworker.0 00000100:00100000:1.0:1783444505.443756:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444505.443762:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575404160:0@lo:400:kworker.0 00000100:00100000:1.0:1783444505.443783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444505.443829:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575404160 00000100:00100000:1.0:1783444505.443833:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575404160 00000100:00100000:1.0:1783444505.443860:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1783444505.443866:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575404160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444505.443899:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575404160:12345-0@lo:400:kworker.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444505.443905:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1783444505.443947:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575404160:0@lo:400:kworker.0 00000100:00100000:2.0:1783444505.444425:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575404800 00000100:00100000:2.0:1783444505.444430:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575404800 00000100:00100000:2.0:1783444505.444454:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:2.0:1783444505.444460:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575404800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444505.444546:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575404800:12345-0@lo:400:kworker.0 Request processed in 85us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444505.444552:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1783444505.444604:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575403904:0@lo:250:kworker.0 00000400:00000100:0.0:1783444505.444631:0:3632:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870073575403904 offset 0 length 520: 4 00000100:00100000:0.0:1783444505.444655:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575404032:0@lo:38:kworker.0 00000100:00100000:0.0:1783444505.444677:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444505.444705:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575404288:0@lo:38:kworker.0 00000100:00100000:0.0:1783444505.444725:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444505.444748:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575404544:0@lo:38:kworker.0 00000100:00100000:0.0:1783444505.444772:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444505.444812:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575404032 00000100:00100000:1.0:1783444505.444817:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575404032 00000100:00100000:1.0:1783444505.444834:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575404288 00000100:00100000:1.0:1783444505.444836:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575404288 00000100:00100000:1.0:1783444505.444846:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1783444505.444851:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575404032:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783444505.444861:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575404928:0@lo:38:kworker.0 00000100:00100000:0.0:1783444505.444883:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1783444505.444891:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444505.444926:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575404032:12345-0@lo:38:kworker.0 Request processed in 74us (248us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444505.444932:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1783444505.444942:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575404928 00000100:00100000:1.0:1783444505.444945:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575404928 00000100:00100000:1.0:1783444505.444973:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1783444505.444977:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575404288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444505.444987:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444505.445012:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575404288:12345-0@lo:38:kworker.0 Request processed in 33us (286us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444505.445019:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1783444505.445031:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1783444505.445035:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575404928:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444505.445044:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444505.445066:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575404928:12345-0@lo:38:kworker.0 Request processed in 29us (182us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444505.445073:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1783444505.445089:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575404544 00000100:00100000:1.0:1783444505.445093:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575404544 00000100:00100000:1.0:1783444505.445114:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1783444505.445118:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575404544:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444505.445141:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444505.445164:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575404544:12345-0@lo:38:kworker.0 Request processed in 45us (392us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444505.445179:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00080000:1.0:1783444505.445207:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444505.445212:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444505.445215:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575404032:0@lo:38:kworker.0 00000100:00080000:1.0:1783444505.445222:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444505.445225:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444505.445228:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575404288:0@lo:38:kworker.0 00000100:00080000:1.0:1783444505.445234:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444505.445237:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444505.445240:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575404544:0@lo:38:kworker.0 00000100:00080000:1.0:1783444505.445246:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444505.445248:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444505.445251:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575404928:0@lo:38:kworker.0 00000100:00100000:3.0:1783444505.446387:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575404800:0@lo:400:kworker.0 00010000:00010000:2.0:1783444505.629054:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444506.397113:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444506.397154:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575405056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444506.397415:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444506.397513:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575405056 00000100:00100000:2.0:1783444506.397521:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575405056 00000100:00100000:2.0:1783444506.397584:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1783444506.397595:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575405056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444506.397623:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444506.397675:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575405056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444506.397682:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1783444506.397730:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575405056:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783444506.398887:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444506.402692:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444506.405110:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575405184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444506.405188:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444506.405502:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575405184 00000100:00100000:2.0:1783444506.405512:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575405184 00000100:00100000:1.0:1783444506.405671:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:1.0:1783444506.405685:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575405184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444506.405720:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444506.405774:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575405184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444506.405813:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00080000:0.0:1783444506.406133:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444506.406174:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575405184:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783444506.653084:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444506.699944:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444506.700019:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000400:00000100:2.0:1783444506.700051:0:3626:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557838080 offset 0 length 224: 4 00000100:00100000:2.0:1783444506.700151:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444506.700202:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557838464 00000100:00100000:3.0:1783444506.700218:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557838464 00000100:00100000:3.0:1783444506.700318:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5914 00000100:00100000:3.0:1783444506.700337:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2400:x1870073557838464:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:3.0:1783444506.700370:0:17653:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3832ee6 00000100:00080000:3.0:1783444506.700430:0:17653:0:(import.c:65:import_set_state_nolock()) ffff9368ea60a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783444506.700498:0:17653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969459 00000100:00100000:3.0:1783444506.700709:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+2:2400:x1870073557838464:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 381us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444506.700717:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5914 00000100:00080000:3.0:1783444506.700758:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783444506.700772:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444506.708556:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557838208 00000100:00100000:1.0:1783444506.708575:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557838208 00000100:00100000:1.0:1783444506.708643:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557838336 00000100:00100000:1.0:1783444506.708646:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557838336 00000100:00100000:1.0:1783444506.708717:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1125 00000100:00100000:1.0:1783444506.708729:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557838336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444506.709036:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557838336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 307us (8882us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444506.709045:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1125 00000100:00100000:1.0:1783444506.709067:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1421 00000100:00100000:1.0:1783444506.709073:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557838208:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:1.0:1783444506.709096:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444506.709127:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557838208:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 53us (9194us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444506.709134:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1421 00000100:00080000:1.0:1783444506.709158:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1783444506.910851:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:2.0:1783444506.910861:0:8415:0:(genops.c:906:class_export_put()) final put ffff9368dd225800/08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:2.0:1783444506.910886:0:93851:0:(genops.c:865:class_export_destroy()) destroying export ffff9368dd225800/08efc25c-17e5-4d29-97d2-f1505f195a06 for lustre-OST0000 00000020:00000080:2.0:1783444506.910924:0:93851:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c518a800 for lustre-OST0000 00010000:00010000:2.0:1783444507.677782:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1783444507.722074:0:3626:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-192.168.204.20@tcp portal 26 match 1870073557838592 offset 0 length 520: 4 00000100:00100000:2.0:1783444507.722194:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444507.722227:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444507.722315:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557838848 00000100:00100000:1.0:1783444507.722326:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557838848 00000100:00100000:1.0:1783444507.722472:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557838720 00000100:00100000:1.0:1783444507.722476:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557838720 00000100:00100000:2.0:1783444507.722517:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1126 00000100:00100000:2.0:1783444507.722531:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557838848:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444507.722562:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1422 00000100:00100000:0.0:1783444507.722570:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557838720:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444507.722597:0:66225:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444507.722609:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557838848:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 81us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444507.722619:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1126 00000100:00100000:0.0:1783444507.722827:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870073557838720:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 254us (597us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444507.722836:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1422 00010000:00010000:2.0:1783444508.700974:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444509.724914:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444510.501166:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444510.501177:0:93852:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444510.501180:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444510.501184:0:93852:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444510.501189:0:93852:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444510.501200:0:93852:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3496 00000100:00080000:2.0:1783444510.501205:0:93852:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444510.501213:0:93852:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444510.501265:0:93852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd172680 x1870073575405312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444510.501395:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1783444510.501411:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444510.501415:0:93852:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444510.501417:0:93852:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444510.501421:0:93852:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3496 00000100:00080000:2.0:1783444510.501424:0:93852:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444510.501428:0:93852:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444510.501443:0:93852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd170380 x1870073575405568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444510.501468:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444510.501472:0:93852:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444510.501474:0:93852:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444510.501478:0:93852:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3496 00000100:00080000:2.0:1783444510.501480:0:93852:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444510.501485:0:93852:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444510.501497:0:93852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e4700 x1870073575405824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444510.503984:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444510.504008:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575406080:0@lo:400:kworker.0 00000100:00100000:3.0:1783444510.504105:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444510.504171:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575406080 00000100:00100000:3.0:1783444510.504181:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575406080 00000100:00100000:3.0:1783444510.504241:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:3.0:1783444510.504250:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575406080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444510.504317:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575406080:12345-0@lo:400:kworker.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444510.504325:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00080000:3.0:1783444510.504346:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444510.504377:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575406080:0@lo:400:kworker.0 00000100:00100000:3.0:1783444510.505828:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575405696:0@lo:400:kworker.0 00000100:00100000:3.0:1783444510.505885:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444510.505924:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444510.505931:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575405952:0@lo:400:kworker.0 00000100:00100000:3.0:1783444510.505952:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444510.507145:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575405440:0@lo:400:kworker.0 00000100:00100000:0.0:1783444510.507198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444510.507249:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575405696 00000100:00100000:0.0:1783444510.507271:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575405696 00000100:00100000:0.0:1783444510.507332:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1783444510.507342:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575405696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444510.507409:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575405696:12345-0@lo:400:kworker.0 Request processed in 69us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444510.507418:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1783444510.507440:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575405440 00000100:00100000:0.0:1783444510.507445:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575405440 00000100:00100000:0.0:1783444510.507474:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:0.0:1783444510.507481:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575405440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444510.507514:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575405440:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444510.507520:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:0.0:1783444510.507535:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444510.507570:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575405696:0@lo:400:kworker.0 00000100:00100000:0.0:1783444510.507605:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575405440:0@lo:400:kworker.0 00000100:00100000:1.0:1783444510.508963:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575405312:0@lo:38:kworker.0 00000100:00100000:1.0:1783444510.509010:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444510.509034:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575405568:0@lo:38:kworker.0 00000100:00100000:1.0:1783444510.509054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444510.509072:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575405824:0@lo:38:kworker.0 00000100:00100000:1.0:1783444510.509093:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444510.509125:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575405312 00000100:00100000:1.0:1783444510.509130:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575405312 00000100:00100000:1.0:1783444510.509156:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575405568 00000100:00100000:1.0:1783444510.509158:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575405568 00000100:00100000:1.0:1783444510.509185:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1783444510.509190:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575405312:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444510.509209:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444510.509245:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575405312:12345-0@lo:38:kworker.0 Request processed in 54us (234us total) trans 0 rc -19/-19 00000100:00080000:2.0:1783444510.510885:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444510.510898:0:93852:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444510.510903:0:93852:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444510.510910:0:93852:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3496 00000100:00080000:2.0:1783444510.510915:0:93852:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444510.510923:0:93852:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444510.512319:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1783444510.517639:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1783444510.519108:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575405824 00000100:00100000:1.0:1783444510.519121:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575405824 00000100:00100000:1.0:1783444510.519160:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:1.0:1783444510.519169:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575405824:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444510.519193:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444510.519287:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575405824:12345-0@lo:38:kworker.0 Request processed in 118us (10192us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444510.519295:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00080000:1.0:1783444510.519348:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444510.519353:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444510.519357:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575405312:0@lo:38:kworker.0 00000100:00080000:1.0:1783444510.519368:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444510.519372:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444510.519375:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575405824:0@lo:38:kworker.0 00000100:00100000:2.0:1783444510.519480:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575405568:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783444510.519494:0:80475:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444510.519554:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575405568:12345-0@lo:38:kworker.0 Request processed in 1894us (10497us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444510.519561:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1783444510.519594:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575405952 00000100:00100000:2.0:1783444510.519598:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575405952 00000100:00100000:2.0:1783444510.519648:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1783444510.519654:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575405952:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783444510.520620:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444510.520626:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444510.520630:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575405568:0@lo:38:kworker.0 00000100:00100000:2.0:1783444510.520842:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575405952:12345-0@lo:400:kworker.0 Request processed in 1186us (14887us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444510.520850:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1783444510.520932:0:93852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e7480 x1870073575406208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444510.521025:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444510.521319:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575405952:0@lo:400:kworker.0 00000100:00100000:1.0:1783444510.521355:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575406208:0@lo:38:kworker.0 00000100:00100000:1.0:1783444510.521394:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444510.521592:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575406208 00000100:00100000:0.0:1783444510.521599:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575406208 00000100:00100000:0.0:1783444510.521637:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1783444510.521644:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575406208:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783444510.521721:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444510.521759:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575406208:12345-0@lo:38:kworker.0 Request processed in 114us (365us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444510.521979:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00080000:1.0:1783444510.522049:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444510.522054:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444510.522057:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575406208:0@lo:38:kworker.0 00010000:00010000:0.0:1783444510.752092:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783444510.859031:0:94353:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783444510.859038:0:94353:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783444510.859039:0:94353:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783444510.859178:0:94353:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9368dd221800 00000020:01000004:1.0:1783444510.859194:0:94353:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783444510.859220:0:94353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783444510.859236:0:94353:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9368dd0eb380) 00000020:00000080:1.0:1783444510.859262:0:94353:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783444511.065529:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783444511.066968:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.075300:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.075678:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.076100:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.076329:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.076531:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.078303:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.078881:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.079105:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.079338:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.079538:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.079731:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.079971:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.080417:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.080623:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.081104:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.081464:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.081683:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.081908:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.082148:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.082396:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.082612:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.082824:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.083011:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.083308:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.084741:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.085333:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.085643:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.085930:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.086129:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.086336:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783444511.086525:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1783444511.086888:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783444511.092959:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.093454:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1783444511.093940:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.094147:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.094447:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1783444511.094687:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783444511.095076:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.095328:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783444511.095589:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.095908:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1783444511.096928:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.097957:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783444511.098255:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.098901:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.099306:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.099501:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.105956:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.106356:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.106564:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.106647:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.106680:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:1.0:1783444511.106709:0:94353:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00080000:01000000:1.0:1783444511.112230:0:94353:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783444511.112756:0:94353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783444511.112768:0:94353:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783444511.112779:0:94353:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3833545 00000020:01000004:1.0:1783444511.112786:0:94353:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1783444511.112831:0:94353:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783444511.112837:0:94353:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9368dd221800 from MGS 00000020:01000004:1.0:1783444511.112842:0:94353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783444511.112852:0:94353:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9368dd0e99c0) 00000020:00000080:1.0:1783444511.112864:0:94353:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mgs with refcount 2 00000020:01000004:1.0:1783444511.112925:0:94353:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368dd221800 from MGS, refs=2 00080000:01000000:1.0:1783444511.112931:0:94353:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783444511.112935:0:94353:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3833553 00010000:00010000:1.0:1783444511.113061:0:94353:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1783444511.127074:0:94353:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783444511.134854:0:94357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783444511.135457:0:94353:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783444511.135541:0:94353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444511.139762:0:94353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783444511.140416:0:94353:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783444511.140569:0:94353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783444511.140575:0:94353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783444511.144965:0:94353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783444511.144982:0:94353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783444511.145616:0:94353:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783444511.145623:0:94353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783444511.146268:0:94353:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783444511.146294:0:94353:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1783444511.146295:0:94353:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1783444511.146298:0:94353:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1783444511.146304:0:94353:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 84, was 0): CONNECTING 00000100:00100000:3.0:1783444511.146310:0:94353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1783444511.516999:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575406336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444511.517069:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444511.517113:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575406464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444511.517136:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444511.517185:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575406336 00000100:00100000:3.0:1783444511.517194:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575406336 00000100:00100000:2.0:1783444511.517247:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575406464 00000100:00100000:2.0:1783444511.517253:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575406464 00000100:00100000:3.0:1783444511.517278:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:3.0:1783444511.517291:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575406336:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444511.517299:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:2.0:1783444511.517311:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575406464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444511.517321:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1783444511.517332:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444511.517388:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575406336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444511.517396:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575406464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444511.517399:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:2.0:1783444511.517409:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:0.0:1783444511.518817:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575406336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444511.518836:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575406464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444511.757423:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444511.757527:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444511.757589:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557839104 00000100:00100000:0.0:1783444511.757598:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557839104 00000100:00100000:0.0:1783444511.757671:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557838976 00000100:00100000:0.0:1783444511.757675:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557838976 00000100:00100000:0.0:1783444511.757698:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1129 00000100:00100000:0.0:1783444511.757718:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557839104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444511.757822:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557839104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 106us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444511.757829:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1129 00000100:00100000:0.0:1783444511.757847:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1426 00000100:00100000:0.0:1783444511.757852:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557838976:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444511.757873:0:71469:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444511.757899:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1870073557838976:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 45us (371us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444511.757905:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1426 00000100:00080000:1.0:1783444511.758399:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783444511.773774:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444512.785323:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444512.785370:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444512.785484:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557839232 00000100:00100000:0.0:1783444512.785494:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557839232 00000100:00100000:0.0:1783444512.785542:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557839360 00000100:00100000:0.0:1783444512.785545:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557839360 00000100:00100000:0.0:1783444512.785579:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1130 00000100:00100000:0.0:1783444512.785589:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2403:x1870073557839360:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444512.785662:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2403:x1870073557839360:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444512.785670:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1130 00000100:00100000:0.0:1783444512.785686:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1427 00000100:00100000:0.0:1783444512.785690:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557839232:12345-192.168.204.20@tcp:38:kworker.0 00010000:00020000:0.0:1783444512.785712:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444512.785736:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1870073557839232:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 45us (429us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444512.785759:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1427 00010000:00010000:2.0:1783444512.797493:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783444513.061065:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:0.0:1783444513.061076:0:9499:0:(genops.c:906:class_export_put()) final put ffff9368ea60a000/08efc25c-17e5-4d29-97d2-f1505f195a06 00000020:00000080:0.0:1783444513.061119:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ea60a000/08efc25c-17e5-4d29-97d2-f1505f195a06 for lustre-OST0001 00000020:00000080:0.0:1783444513.061175:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ea60a800 for lustre-OST0001 00010000:00010000:2.0:1783444513.822093:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444514.847769:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444515.612910:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444515.612922:0:93852:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783444515.612925:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444515.612929:0:93852:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444515.612933:0:93852:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444515.612943:0:93852:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3501 00000100:00080000:2.0:1783444515.612948:0:93852:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444515.612955:0:93852:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444515.612996:0:93852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e4380 x1870073575406592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444515.613061:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444515.613065:0:93852:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444515.613067:0:93852:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444515.613072:0:93852:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3501 00000100:00080000:2.0:1783444515.613074:0:93852:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444515.613077:0:93852:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444515.613089:0:93852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e7480 x1870073575406848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444515.613121:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444515.613124:0:93852:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444515.613126:0:93852:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444515.613130:0:93852:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3501 00000100:00080000:2.0:1783444515.613132:0:93852:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444515.613136:0:93852:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444515.613147:0:93852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c45e4700 x1870073575407104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444515.613209:0:93852:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444515.613213:0:93852:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783444515.613226:0:93852:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444515.613229:0:93852:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3501 00000100:00080000:2.0:1783444515.613232:0:93852:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783444515.613235:0:93852:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444515.613247:0:93852:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4ac9c00 x1870073575407488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444515.613302:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575406976:0@lo:400:kworker.0 00000100:00100000:2.0:1783444515.613372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444515.613409:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444515.613415:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575406720:0@lo:400:kworker.0 00000100:00100000:2.0:1783444515.613435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444515.613526:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575406592:0@lo:38:kworker.0 00000100:00100000:1.0:1783444515.613556:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444515.613584:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575406848:0@lo:38:kworker.0 00000100:00100000:1.0:1783444515.613604:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444515.613639:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575407104:0@lo:38:kworker.0 00000100:00100000:1.0:1783444515.613664:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444515.613695:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575407488:0@lo:38:kworker.0 00000100:00100000:1.0:1783444515.613715:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444515.613750:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575407104 00000100:00100000:1.0:1783444515.613757:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575407104 00000100:00100000:1.0:1783444515.613812:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1783444515.613820:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575407104:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444515.613842:0:8430:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444515.616895:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575407232:0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.616958:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444515.616996:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444515.617003:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575407360:0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.617040:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444515.617084:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575407232 00000100:00100000:3.0:1783444515.617091:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575407232 00000100:00100000:3.0:1783444515.617139:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575407360 00000100:00100000:3.0:1783444515.617142:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575407360 00000100:00100000:3.0:1783444515.617181:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:3.0:1783444515.617190:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575407232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.617241:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575407232:12345-0@lo:400:kworker.0 Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444515.617248:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:3.0:1783444515.617265:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:3.0:1783444515.617271:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575407360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.617295:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575407360:12345-0@lo:400:kworker.0 Request processed in 25us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444515.617301:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00080000:3.0:1783444515.617317:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444515.617321:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444515.617332:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575406976 00000100:00100000:3.0:1783444515.617335:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575406976 00000100:00100000:3.0:1783444515.617362:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575406720 00000100:00100000:3.0:1783444515.617364:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575406720 00000100:00100000:3.0:1783444515.617375:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575406592 00000100:00100000:3.0:1783444515.617377:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575406592 00000100:00100000:3.0:1783444515.617385:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575406848 00000100:00100000:3.0:1783444515.617387:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575406848 00000100:00100000:3.0:1783444515.617393:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575407488 00000100:00100000:3.0:1783444515.617395:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575407488 00000100:00100000:3.0:1783444515.617403:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1783444515.617408:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575406976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.617456:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575406976:12345-0@lo:400:kworker.0 Request processed in 47us (4084us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444515.617462:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1783444515.617473:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1783444515.617479:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575406720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.617504:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575406720:12345-0@lo:400:kworker.0 Request processed in 26us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444515.617510:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1783444515.617522:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1783444515.617526:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575406592:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444515.617543:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444515.617583:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575406592:12345-0@lo:38:kworker.0 Request processed in 55us (4027us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444515.617589:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1783444515.617599:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1783444515.617603:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575406848:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444515.617612:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444515.617634:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575406848:12345-0@lo:38:kworker.0 Request processed in 30us (4030us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444515.617640:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1783444515.617650:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1783444515.617654:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575407488:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783444515.617663:0:66226:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444515.617767:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3632:x1870073575407488:12345-0@lo:38:kworker.0 Request processed in 110us (4050us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444515.617778:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00080000:3.0:1783444515.617827:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444515.617878:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575406720:0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.617895:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575406976:0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.617928:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575407360:0@lo:400:kworker.0 00000100:00100000:3.0:1783444515.617938:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575407232:0@lo:400:kworker.0 00000100:00080000:3.0:1783444515.617992:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444515.617998:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444515.618002:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575406592:0@lo:38:kworker.0 00000100:00080000:3.0:1783444515.618012:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444515.618015:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444515.618018:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575406848:0@lo:38:kworker.0 00000100:00080000:3.0:1783444515.618027:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444515.618030:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444515.618033:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575407488:0@lo:38:kworker.0 00000100:00100000:1.0:1783444515.652499:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575407104:12345-0@lo:38:kworker.0 Request processed in 38669us (38824us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444515.652513:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00080000:2.0:1783444515.653329:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444515.653339:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783444515.653343:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575407104:0@lo:38:kworker.0 00010000:00010000:0.0:1783444515.873426:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444516.637364:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444516.637384:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575407616:0@lo:13:osp-pre-0-1.0 00000100:00020000:0.0:1783444516.637462:0:94353:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) 00000100:00100000:3.0:1783444516.637464:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.637523:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575407616 00000100:00100000:3.0:1783444516.637529:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575407616 00000100:00100000:3.0:1783444516.637577:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:3.0:1783444516.637586:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575407616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444516.637617:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444516.637676:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575407616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.637683:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:3.0:1783444516.637964:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575407616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444516.639677:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444516.639695:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575407744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444516.639747:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444516.639807:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575407744 00000100:00100000:2.0:1783444516.639813:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575407744 00000100:00100000:2.0:1783444516.639970:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1783444516.639979:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575407744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444516.640005:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444516.640046:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575407744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.640053:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:3.0:1783444516.641147:0:3632:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783444505/real 1783444505] req@ffff9367c45e6300 x1870073575403904/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444516.641173:0:3632:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9367c45e6300 x1870073575403904/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783444515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444516.641192:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444516.641207:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783444516.641211:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575403904:0@lo:250:kworker.0 00000100:00100000:2.0:1783444516.642823:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575407744:0@lo:13:osp-pre-1-1.0 10000000:01000000:0.0:1783444516.645562:0:94353:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1783444516.645589:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.645602:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.645609:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1783444516.646841:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.646857:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3832e5a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832e61 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.646881:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3833266 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.646888:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3833266 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.646893:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:3.0:1783444516.651070:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444516.651081:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783444516.651084:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444516.651092:0:92306:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3496 00000100:00080000:3.0:1783444516.651107:0:92306:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783444516.651115:0:92306:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444516.651166:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5802300 x1870073575407872/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444516.651189:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444516.651192:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444516.651194:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444516.651198:0:92306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3506 00000100:00080000:3.0:1783444516.651201:0:92306:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444516.651221:0:92306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444516.651238:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5800000 x1870073575408000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444516.651459:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444516.651464:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444516.651465:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444516.651469:0:92306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3506 00000100:00080000:3.0:1783444516.651472:0:92306:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444516.651476:0:92306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444516.651490:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5802d80 x1870073575408256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444516.651508:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1783444516.651511:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575408128:0@lo:400:kworker.0 00000100:00080000:3.0:1783444516.651513:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444516.651516:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444516.651523:0:92306:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3506 00000100:00080000:3.0:1783444516.651525:0:92306:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444516.651528:0:92306:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444516.651544:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5800e00 x1870073575408512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444516.651555:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444516.651559:0:92306:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783444516.651560:0:92306:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444516.651564:0:92306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3506 00000100:00080000:3.0:1783444516.651567:0:92306:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783444516.651579:0:92306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444516.651585:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.651608:0:92306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5803800 x1870073575408640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444516.651630:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00020000:3.0:1783444516.651635:0:3632:0:(client.c:1391:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9367c5802300 x1870073575407872/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444516.651639:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575408384:0@lo:400:kworker.0 00000100:00100000:1.0:1783444516.651663:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444516.651690:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575408128 00000100:00100000:1.0:1783444516.651697:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575408128 00000100:00080000:3.0:1783444516.651717:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444516.651730:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1783444516.651735:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:0:1870073575407872:0@lo:250:kworker.0 00000100:00100000:3.0:1783444516.651742:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575408000:0@lo:38:kworker.0 00000100:00100000:1.0:1783444516.651751:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575408384 00000100:00100000:1.0:1783444516.651755:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575408384 00000100:00100000:3.0:1783444516.651776:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444516.651780:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1783444516.651817:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575408128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444516.651868:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575408128:12345-0@lo:400:kworker.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.651875:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00010000:00010000:0.0:1783444516.652080:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652485:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26600/0x42cb6883e383325f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3833266 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652512:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3833274 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652520:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3833274 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652526:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.652552:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652558:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26400/0x42cb6883e383326d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3833274 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652568:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3833289 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652574:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3833289 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652580:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.652583:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652597:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e3833282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3833289 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652607:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3833297 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652613:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3833297 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652617:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.652626:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652630:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c0030200/0x42cb6883e3833290 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3833297 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652639:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38332a5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652645:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38332a5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652758:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.652762:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652766:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e383329e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38332a5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652775:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38332b3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652781:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38332b3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652785:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.652808:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652811:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e38332ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38332b3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652819:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e38332c1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652824:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e38332c1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652849:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.652852:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652856:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e38332ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e38332c1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652873:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832dd5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652879:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832dd5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652883:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.652886:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652889:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3832dce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832dd5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652900:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832df1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652905:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832df1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652909:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.652912:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652914:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3832dea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832df1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652923:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832dff expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652936:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832dff expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652941:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444516.652943:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652947:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71400/0x42cb6883e3832df8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832dff expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652954:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652959:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652964:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444516.652966:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652968:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3832e22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832e29 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.652974:0:94353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x42cb6883e3832e53 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.652979:0:94353:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x42cb6883e3832e53 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.652984:0:94353:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783444516.652987:0:94353:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783444516.652990:0:94353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e3832e4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x42cb6883e3832e53 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783444516.653012:0:94353:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9368eb774000 already not connected (conn 85, was 0): DISCONN 00000100:00080000:0.0:1783444516.653018:0:94353:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444516.653024:0:94353:0:(import.c:510:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 3507 00000100:00080000:0.0:1783444516.653027:0:94353:0:(import.c:589:import_select_connection()) MGC192.168.204.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783444516.653031:0:94353:0:(import.c:624:import_select_connection()) MGC192.168.204.120@tcp: import ffff9368eb774000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444516.653051:0:94353:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd171880 x1870073575408768/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444516.653064:0:94353:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1783444516.653466:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575408256:0@lo:38:kworker.0 00000100:00100000:1.0:1783444516.653605:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1783444516.653621:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575408384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444516.653679:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575408384:12345-0@lo:400:kworker.0 Request processed in 64us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.653704:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1783444516.653769:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575408384:0@lo:400:kworker.0 00000100:00100000:1.0:1783444516.653780:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575408128:0@lo:400:kworker.0 00000100:00100000:3.0:1783444516.653816:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.653857:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575408512:0@lo:38:kworker.0 00000100:00100000:3.0:1783444516.653885:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.653910:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575408640:0@lo:38:kworker.0 00000100:00100000:3.0:1783444516.653931:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.653953:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575408768:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783444516.653979:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444516.654017:0:92306:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783444516.654021:0:92306:0:(pinger.c:247:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783444516.654061:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575408768 00000100:00100000:3.0:1783444516.654066:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575408768 00000100:00100000:3.0:1783444516.654090:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783444516.654105:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c54d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3632:x1870073575408768:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783444516.654612:0:94359:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo t0 exp 0000000000000000 cur 3507 last 0 00000020:00000080:3.0:1783444516.654642:0:94359:0:(genops.c:1406:class_connect()) connect: client c89ab73b-dbb2-4305-b221-37cc64d61227, cookie 0x42cb6883e383355a 00000100:00100000:1.0:1783444516.654771:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575408512 00000100:00100000:1.0:1783444516.654776:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575408512 00000100:00100000:1.0:1783444516.654826:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1783444516.654831:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575408512:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444516.655269:0:8431:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444516.655325:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575408512:12345-0@lo:38:kworker.0 Request processed in 492us (1438us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444516.655333:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00080000:1.0:1783444516.655376:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444516.655381:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444516.655385:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575408512:0@lo:38:kworker.0 00000100:00100000:1.0:1783444516.655407:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575408256 00000100:00100000:1.0:1783444516.655410:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575408256 00000100:00100000:1.0:1783444516.655429:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575408640 00000100:00100000:1.0:1783444516.655431:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575408640 00000100:00100000:1.0:1783444516.655442:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1783444516.655447:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575408256:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444516.655456:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444516.655496:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575408256:12345-0@lo:38:kworker.0 Request processed in 48us (1682us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444516.655503:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1783444516.655516:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1783444516.655520:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575408640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783444516.655530:0:67017:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444516.655553:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3632:x1870073575408640:12345-0@lo:38:kworker.0 Request processed in 31us (1621us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444516.655559:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00080000:1.0:1783444516.655584:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444516.655588:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444516.655591:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575408256:0@lo:38:kworker.0 00000100:00080000:1.0:1783444516.655600:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444516.655602:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444516.655605:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575408640:0@lo:38:kworker.0 00000100:00080000:3.0:1783444516.655862:0:94359:0:(import.c:65:import_set_state_nolock()) ffff9367c229d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444516.655914:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c54d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+5:3632:x1870073575408768:12345-0@lo:250:mount.lustre.0 Request processed in 1807us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.655921:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783444516.656246:0:3632:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 29 00000100:00080000:1.0:1783444516.656253:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:1.0:1783444516.656261:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783444516.656265:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783444516.656269:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb774000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783444516.656271:0:3632:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783444516.656345:0:3632:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783444516.656355:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c89ab73b-dbb2-4305-b221-37cc64d61227:3632:1870073575408768:0@lo:250:mount.lustre.0 00000020:01000000:1.0:1783444516.656392:0:92152:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.204.120@tcp 10000000:01000000:1.0:1783444516.656407:0:92152:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1783444516.656410:0:92152:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783444516.656416:0:92152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783444516.656418:0:92152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444516.656419:0:92152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444516.656420:0:92152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444516.656422:0:92152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444516.656424:0:92152:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783444516.656425:0:92152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444516.656427:0:92152:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783444516.656461:0:92152:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783444516.656468:0:92152:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1783444516.656470:0:92152:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783444516.656471:0:92152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783444516.656473:0:92152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444516.656473:0:92152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444516.656475:0:92152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444516.656476:0:92152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444516.656477:0:92152:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783444516.656478:0:92152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444516.656479:0:92152:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1783444516.656491:0:92152:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1783444516.656495:0:92152:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1783444516.656497:0:92152:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1783444516.656499:0:92152:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783444516.656500:0:92152:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444516.656501:0:92152:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444516.656502:0:92152:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444516.656503:0:92152:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444516.656505:0:92152:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783444516.656506:0:92152:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444516.656507:0:92152:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783444516.656513:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575408000 00000100:00100000:2.0:1783444516.656521:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575408000 00000020:01000000:1.0:1783444516.656525:0:92152:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1783444516.656554:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444516.656555:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1783444516.656563:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575408000:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783444516.656569:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575409152:0@lo:253:kworker.0 00010000:00020000:2.0:1783444516.656579:0:66223:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444516.656614:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444516.656642:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3632:x1870073575408000:12345-0@lo:38:kworker.0 Request processed in 76us (4865us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444516.656659:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1783444516.656665:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575409024:0@lo:253:kworker.0 00000100:00080000:2.0:1783444516.656691:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444516.656698:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444516.656702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444516.656706:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575408000:0@lo:38:kworker.0 00000100:00100000:1.0:1783444516.656726:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444516.656741:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575408896:0@lo:253:kworker.0 00000100:00100000:2.0:1783444516.656744:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575409152 00000100:00100000:2.0:1783444516.656748:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575409152 00000100:00100000:1.0:1783444516.656773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444516.656959:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575409024 00000100:00100000:2.0:1783444516.656964:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575409024 00000100:00100000:2.0:1783444516.656979:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575408896 00000100:00100000:2.0:1783444516.656982:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575408896 00000100:00100000:2.0:1783444516.656992:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783444516.656997:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c54d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3634:x1870073575409152:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1783444516.657020:0:94361:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1783444516.657284:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783444516.657293:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c338a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3636:x1870073575409024:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783444516.657308:0:94359:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:2.0:1783444516.657405:0:94353:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1783444516.657415:0:94353:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783444516.657447:0:94353:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783444516.657452:0:94353:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 10000000:01000000:3.0:1783444516.657492:0:94363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783444516.657623:0:94361:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 123 00000040:01000000:3.0:1783444516.657773:0:94353:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783444516.657829:0:94353:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1783444516.657833:0:94353:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783444516.658279:0:94353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444516.658281:0:94353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444516.658282:0:94353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444516.658284:0:94353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444516.658285:0:94353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444516.658287:0:94353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444516.658288:0:94353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444516.658290:0:94353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444516.658291:0:94353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783444516.658294:0:94353:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1783444516.658297:0:94353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783444516.658298:0:94353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444516.658299:0:94353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444516.658301:0:94353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444516.658302:0:94353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444516.658303:0:94353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444516.658304:0:94353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444516.658305:0:94353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444516.658306:0:94353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444516.658307:0:94353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783444516.658325:0:94353:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783444516.658340:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409280:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783444516.658384:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.658409:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c4848cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444516.658494:0:94360:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1783444516.658503:0:94360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1783444516.660043:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575409280 00000100:00100000:3.0:1783444516.660055:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575409280 00000100:00100000:1.0:1783444516.660192:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783444516.660202:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3636:x1870073575408896:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1783444516.660247:0:94365:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783444516.661188:0:94364:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783444516.661193:0:94364:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1783444516.661197:0:94364:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783444516.661199:0:94364:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783444516.661219:0:94364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:2.0:1783444516.661398:0:94361:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444516.661419:0:94361:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783444516.663523:0:94359:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783444516.663646:0:94361:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444516.663662:0:94361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1783444516.663743:0:94363:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783444516.663748:0:94363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783444516.663772:0:94363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663814:0:94363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783444516.663825:0:94363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000077325s 00010000:00010000:3.0:1783444516.663830:0:94363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663837:0:94363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663844:0:94363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663851:0:94363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663858:0:94363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444516.663862:0:94363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663870:0:94363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663897:0:94363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663904:0:94363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.663911:0:94363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513b600/0x42cb6883e3833561 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783444516.667435:0:94359:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783444516.667451:0:94359:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783444516.667519:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c54d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3634:x1870073575409152:12345-0@lo:253:kworker.0 Request processed in 10515us (10900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.667533:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783444516.667581:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783444516.667591:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+7:94353:x1870073575409280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783444516.667633:0:94361:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783444516.667635:0:94361:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783444516.667638:0:94361:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1783444516.667643:0:94361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783444516.667817:0:94363:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783444516.667823:0:94363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783444516.667847:0:94363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667862:0:94363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444516.667872:0:94363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000077325s 00010000:00010000:0.0:1783444516.667878:0:94363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667884:0:94363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667891:0:94363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667898:0:94363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667920:0:94363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444516.667924:0:94363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667932:0:94363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667945:0:94363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667951:0:94363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.667957:0:94363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91c00/0x42cb6883e3833568 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444516.668086:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c338a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:3636:x1870073575409024:12345-0@lo:253:kworker.0 Request processed in 10789us (11382us total) trans 0 rc 0/0 00000020:01000004:1.0:1783444516.668164:0:3634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1783444516.668167:0:3634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783444516.668169:0:3634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783444516.668170:0:3634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783444516.668171:0:3634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783444516.668173:0:3634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783444516.668174:0:3634:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783444516.668176:0:3634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783444516.668178:0:3634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:0.0:1783444516.668180:0:3636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000100:00100000:1.0:1783444516.668182:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575409152:0@lo:253:kworker.0 00000020:01000004:0.0:1783444516.668182:0:3636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783444516.668183:0:3636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444516.668184:0:3636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444516.668186:0:3636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444516.668187:0:3636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444516.668188:0:3636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444516.668189:0:3636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444516.668190:0:3636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1783444516.668193:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575409024:0@lo:253:kworker.0 00000100:00100000:3.0:1783444516.668232:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:1.0:1783444516.668241:0:94365:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783444516.668580:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+6:94353:x1870073575409280:12345-0@lo:253:mount.lustre.0 Request processed in 991us (10194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.668587:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783444516.668659:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409280:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783444516.668672:0:94353:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783444516.668674:0:94353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783444516.668675:0:94353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783444516.668676:0:94353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783444516.668677:0:94353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783444516.668679:0:94353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783444516.668680:0:94353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783444516.668681:0:94353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783444516.668682:0:94353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783444516.668684:0:94353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783444516.668685:0:94353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783444516.668707:0:94353:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9368dd221800 from lustre-MDT0000 10000000:01000000:3.0:1783444516.668741:0:94353:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783444516.668744:0:94353:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783444516.668751:0:94353:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9368dd221800 10000000:01000000:3.0:1783444516.668756:0:94353:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783444516.668767:0:94353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9368dd221800 10000000:01000000:3.0:1783444516.668770:0:94353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783444516.668773:0:94353:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368dd221800 from 1 10000000:01000000:3.0:1783444516.668776:0:94353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783444516.668976:0:94353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513a000/0x42cb6883e383356f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.668986:0:94353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513a000/0x42cb6883e383356f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.668995:0:94353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513a000/0x42cb6883e383356f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444516.669016:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783444516.669056:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.669199:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c4848000 going to sleep for 11 seconds 00000100:00100000:1.0:1783444516.669238:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575409408 00000100:00100000:1.0:1783444516.669245:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575409408 00000100:00100000:1.0:1783444516.669314:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783444516.669323:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c338b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:94353:x1870073575409408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444516.669334:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444516.669348:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26a00/0x42cb6883e3833576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383356f expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.669393:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26a00/0x42cb6883e3833576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383356f expref: 7 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.669404:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26a00/0x42cb6883e3833576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383356f expref: 7 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.669412:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26a00, rc 0) 00000100:00100000:1.0:1783444516.669458:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c338b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:94353:x1870073575409408:12345-0@lo:101:mount.lustre.0 Request processed in 136us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.669464:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783444516.669525:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444516.669538:0:94353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513a000/0x42cb6883e383356f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833576 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.669546:0:94353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513a000/0x42cb6883e383356f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833576 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.669569:0:94353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783444516.669588:0:94353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513a000/0x42cb6883e383356f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833576 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.669596:0:94353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513a000/0x42cb6883e383356f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833576 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.669602:0:94353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783444516.669606:0:94353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783444516.669612:0:94353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9368dd221800 10000000:01000000:0.0:1783444516.669615:0:94353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783444516.669618:0:94353:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783444516.669620:0:94353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444516.669635:0:94353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.669643:0:94353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.669649:0:94353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444516.669661:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783444516.669687:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.669981:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69aab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444516.670050:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575409536 00000100:00100000:3.0:1783444516.670054:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575409536 00000100:00100000:3.0:1783444516.670076:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783444516.670082:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:94353:x1870073575409536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444516.670089:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444516.670202:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383357d expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.670218:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383357d expref: 8 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.670227:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383357d expref: 8 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.670246:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a600, rc 0) 00000100:00100000:3.0:1783444516.670281:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94353:x1870073575409536:12345-0@lo:101:mount.lustre.0 Request processed in 199us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.670288:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783444516.670347:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444516.670358:0:94353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.670371:0:94353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444516.670489:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783444516.670514:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.670599:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69aab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444516.670643:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575409664 00000100:00100000:1.0:1783444516.670647:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575409664 00000100:00100000:2.0:1783444516.671491:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783444516.671505:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94353:x1870073575409664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783444516.671662:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:94353:x1870073575409664:12345-0@lo:501:mount.lustre.0 Request processed in 161us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.671671:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783444516.671836:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444516.671876:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444516.671919:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.671955:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa81b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.672094:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575409792 00000100:00100000:0.0:1783444516.672099:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575409792 00000100:00100000:0.0:1783444516.672126:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783444516.672132:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:94353:x1870073575409792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783444516.672251:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:94353:x1870073575409792:12345-0@lo:503:mount.lustre.0 Request processed in 117us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.672258:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783444516.672405:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575409792:0@lo:503:mount.lustre.0 20000000:01000000:3.0:1783444516.673276:0:94365:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783444516.673293:0:94365:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783444516.673530:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+8:3636:x1870073575408896:12345-0@lo:253:kworker.0 Request processed in 13327us (16755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.673539:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1783444516.673611:0:3636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1783444516.673614:0:3636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783444516.673615:0:3636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444516.673616:0:3636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444516.673618:0:3636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444516.673619:0:3636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444516.673621:0:3636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444516.673622:0:3636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444516.673624:0:3636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783444516.673626:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575408896:0@lo:253:kworker.0 20000000:01000000:1.0:1783444516.673683:0:94363:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783444516.673688:0:94363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783444516.673708:0:94363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673724:0:94363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783444516.673733:0:94363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000077325s 00010000:00010000:1.0:1783444516.673738:0:94363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673745:0:94363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673752:0:94363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673771:0:94363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673777:0:94363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444516.673782:0:94363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673883:0:94363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673897:0:94363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673904:0:94363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.673911:0:94363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27000/0x42cb6883e383358b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444516.674259:0:94366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94366:1870073575409920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444516.674323:0:94366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.674403:0:94366:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa81f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444516.674481:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575409920 00000100:00100000:2.0:1783444516.674487:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575409920 00000100:00100000:2.0:1783444516.674549:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783444516.674556:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94366:x1870073575409920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444516.674949:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94366:x1870073575409920:12345-0@lo:502:llog_process_th.0 Request processed in 392us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.674957:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783444516.675020:0:94366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94366:1870073575409920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444516.675050:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444516.675061:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.675064:0:94366:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783444516.675072:0:94366:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783444516.675076:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783444516.675089:0:94366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9367c2c619c0) 00000020:00000080:3.0:1783444516.675179:0:94366:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1783444516.675187:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783444516.675255:0:94366:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783444516.675261:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3833599 00000020:00000080:3.0:1783444516.675443:0:94366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783444516.675446:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444516.675449:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.675451:0:94366:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783444516.675452:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444516.675455:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.675456:0:94366:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783444516.675458:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783444516.675463:0:94366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9367c2c63380) 00000020:00000080:3.0:1783444516.675472:0:94366:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1783444516.675474:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783444516.675476:0:94366:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783444516.675478:0:94366:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783444516.675481:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783444516.675511:0:94366:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368dd221800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783444516.675519:0:94366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9367c72519c0) 00000020:00000080:3.0:1783444516.675526:0:94366:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1783444516.675564:0:94366:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783444516.675566:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38335ae 00000020:00000080:3.0:1783444516.675628:0:94366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783444516.675633:0:94366:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783444516.675635:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42cb6883e38335b5 00080000:01000000:3.0:1783444516.675638:0:94366:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783444516.675640:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38335bc 00010000:00010000:3.0:1783444516.714405:0:94366:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1783444516.714537:0:94366:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964116997 srv lr: 120259084288 lx: 0 gen 22 00000001:00080000:3.0:1783444516.714586:0:94366:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 08efc25c-17e5-4d29-97d2-f1505f195a06 idx: 2 lr: 0 srv lr: 120259084288 lx: 0 gen 24 00000001:00000004:3.0:1783444516.714609:0:94366:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:3.0:1783444516.714699:0:94366:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1783444516.714743:0:94366:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368ddda2540: xid 1870073575390208, transno 120259084296, client gen 22, slot idx 0 00000001:00080000:3.0:1783444516.714749:0:94366:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368ddda26c0: xid 1870073575388288, transno 120259084295, client gen 22, slot idx 1 00000001:00080000:3.0:1783444516.714752:0:94366:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368ddda2e40: xid 1870073557827200, transno 120259084294, client gen 24, slot idx 2 00000001:00080000:3.0:1783444516.714755:0:94366:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9368ddda2b40: xid 1870073557826816, transno 120259084293, client gen 24, slot idx 3 00000020:00000080:3.0:1783444516.715303:0:94366:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9367c7254d40) 00000020:00000080:3.0:1783444516.715324:0:94366:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1783444516.715395:0:94366:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783444516.715404:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38335d8 00000020:00000080:2.0:1783444516.716958:0:94366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783444516.719936:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42cb6883e38335df 00000020:00000080:0.0:1783444516.720319:0:94366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783444516.720331:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444516.720337:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444516.720339:0:94366:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783444516.720342:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783444516.720344:0:94366:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783444516.720346:0:94366:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444516.720347:0:94366:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444516.720349:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783444516.720351:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444516.720352:0:94366:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783444516.720354:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444516.720359:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444516.720360:0:94366:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783444516.720365:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783444516.720411:0:94366:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783444516.720430:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444516.720433:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444516.720434:0:94366:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783444516.720436:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444516.720439:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444516.720441:0:94366:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1783444516.720444:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783444516.720449:0:94366:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:00000080:0.0:1783444516.720473:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783444516.720486:0:94366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9367c1e83380) 00000020:00000080:0.0:1783444516.720502:0:94366:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783444516.720507:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783444516.720563:0:94366:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1783444516.720569:0:94366:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783444516.720574:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e38335ed 00010000:00080000:0.0:1783444516.720603:0:94366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368cab9e800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1783444516.722394:0:94366:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1783444516.724730:0:94366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783444516.724746:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783444516.724814:0:94366:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783444516.724841:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e38335f4 00000100:00080000:3.0:1783444516.724852:0:94366:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783444516.724859:0:94366:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9368cab9e800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444516.724894:0:94366:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c5802300 x1870073575410048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783444516.724924:0:94366:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783444516.724999:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444516.725003:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.725005:0:94366:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783444516.725007:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783444516.725010:0:94366:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783444516.725012:0:94366:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783444516.725013:0:94366:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783444516.725015:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783444516.725017:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.725018:0:94366:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783444516.725021:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783444516.725030:0:94366:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783444516.725034:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.725036:0:94366:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783444516.725039:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783444516.725044:0:94366:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:3.0:1783444516.725067:0:94366:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783444516.725070:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783444516.725082:0:94366:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9367c7253380) 00000020:00000080:3.0:1783444516.725109:0:94366:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1783444516.725114:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783444516.725184:0:94366:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783444516.725188:0:94366:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783444516.725193:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3833602 00010000:00080000:3.0:1783444516.725217:0:94366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368cb786800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1783444516.725362:0:94366:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1783444516.725771:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575410048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783444516.725858:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.726171:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575410048 00000100:00100000:3.0:1783444516.726179:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575410048 00000100:00100000:3.0:1783444516.726254:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:3.0:1783444516.726261:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575410048:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783444516.726288:0:23687:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3507 last 0 00000020:00000080:3.0:1783444516.726317:0:23687:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3833609 00000004:00100000:3.0:1783444516.726329:0:23687:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783444516.726412:0:23687:0:(import.c:65:import_set_state_nolock()) ffff9368cb784000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444516.726478:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575410048:12345-0@lo:38:llog_process_th.0 Request processed in 216us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.726486:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:2.0:1783444516.726554:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783444516.726563:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1783444516.726571:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783444516.726576:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783444516.726578:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cab9e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783444516.726595:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575410048:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1783444516.726847:0:94366:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783444516.726913:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575410176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444516.726953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444516.726999:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575410176 00000100:00100000:1.0:1783444516.727004:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575410176 00000100:00100000:1.0:1783444516.727033:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1783444516.727040:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575410176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444516.727062:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:1.0:1783444516.727111:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575410176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000040:01000000:2.0:1783444516.727127:0:94366:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1783444516.727128:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1783444516.727175:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575410176:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783444516.727485:0:94366:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:2.0:1783444516.728270:0:94366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783444516.728298:0:94366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000040:00080000:2.0:1783444516.728461:0:94366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000040:00080000:1.0:1783444516.729226:0:94372:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:1.0:1783444516.729233:0:94372:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783444516.729372:0:94372:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:1.0:1783444516.729390:0:94372:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1783444516.729509:0:94372:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:1.0:1783444516.729512:0:94372:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783444516.730381:0:94366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444516.730394:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783444516.730435:0:94366:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783444516.730459:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3833610 00000100:00080000:2.0:1783444516.730470:0:94366:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444516.730476:0:94366:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368cb786800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444516.730513:0:94366:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4aca680 x1870073575410304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444516.730572:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575410304:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783444516.730641:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.730724:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575410304 00000100:00100000:0.0:1783444516.730732:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575410304 00000100:00100000:0.0:1783444516.730771:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:0.0:1783444516.730779:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3632:x1870073575410304:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1783444516.730869:0:26212:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3507 last 0 00000020:00000080:0.0:1783444516.730892:0:26212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3833617 00002000:00100000:0.0:1783444516.730904:0:26212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9367cae8e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783444516.730908:0:26212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783444516.730911:0:26212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783444516.730968:0:26212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783444516.730989:0:26212:0:(import.c:65:import_set_state_nolock()) ffff9367cae88000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1783444516.731072:0:94366:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783444516.731320:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444516.731325:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.731327:0:94366:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783444516.731330:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783444516.731332:0:94366:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1783444516.731334:0:94366:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444516.731335:0:94366:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783444516.731337:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783444516.731339:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.731340:0:94366:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783444516.731342:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783444516.731347:0:94366:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783444516.731350:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.731351:0:94366:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783444516.731354:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783444516.731357:0:94366:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1783444516.731384:0:94366:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783444516.731387:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783444516.731399:0:94366:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9367c3333380) 00000020:00000080:2.0:1783444516.731415:0:94366:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1783444516.731420:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783444516.731486:0:94366:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783444516.731492:0:94366:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783444516.731498:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42cb6883e3833625 00010000:00080000:2.0:1783444516.731524:0:94366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9367c5037000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1783444516.731703:0:94366:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1783444516.731761:0:94366:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783444516.731774:0:94366:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783444516.732283:0:94366:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:2.0:1783444516.732949:0:94366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783444516.732978:0:94366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000040:00080000:2.0:1783444516.733116:0:94366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000040:00080000:2.0:1783444516.733535:0:94374:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:2.0:1783444516.733540:0:94374:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1783444516.733631:0:94374:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:2.0:1783444516.733644:0:94374:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1783444516.733741:0:94374:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:2.0:1783444516.733745:0:94374:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783444516.734333:0:94366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783444516.734344:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783444516.734386:0:94366:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783444516.734412:0:94366:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e383362c 00000100:00080000:2.0:1783444516.734423:0:94366:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783444516.734429:0:94366:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9367c5037000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1783444516.734464:0:94366:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4ac8000 x1870073575410432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783444516.734488:0:94366:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783444516.734561:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444516.734566:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.734568:0:94366:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783444516.734570:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444516.734574:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.734575:0:94366:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783444516.734578:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783444516.734580:0:94366:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783444516.734582:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444516.734585:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.734586:0:94366:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783444516.734588:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444516.734590:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.734591:0:94366:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783444516.734594:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783444516.734600:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444516.734602:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.734603:0:94366:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1783444516.734606:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444516.734609:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.734610:0:94366:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1783444516.734612:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1783444516.734652:0:94366:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1783444516.735005:0:94366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94366:1870073575410560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444516.735080:0:94366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444516.735111:0:94366:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.735258:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575410304:12345-0@lo:8:llog_process_th.0 Request processed in 4476us (4614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.735269:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00100000:1.0:1783444516.735354:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783444516.735363:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783444516.735369:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783444516.735373:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783444516.735376:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783444516.735388:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783444516.735395:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575410304:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783444516.735419:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575410432:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1783444516.735423:0:94372:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783444516.735451:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783444516.735493:0:94372:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3507777703241ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783444516.735499:0:94372:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783444516.735609:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575410560 00000100:00100000:1.0:1783444516.735615:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575410560 00000100:00100000:1.0:1783444516.735661:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783444516.735668:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94366:x1870073575410560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444516.735766:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94366:x1870073575410560:12345-0@lo:502:llog_process_th.0 Request processed in 98us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.735783:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783444516.735890:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575410688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444516.735896:0:94366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94366:1870073575410560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444516.735917:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1783444516.735920:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444516.735925:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.735931:0:94366:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:2.0:1783444516.735935:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783444516.735939:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.735940:0:94366:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1783444516.735944:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00000100:00100000:1.0:1783444516.735954:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575410688 00020000:01000000:2.0:1783444516.735956:0:94366:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:1.0:1783444516.735958:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575410688 00000100:00100000:1.0:1783444516.736001:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:1.0:1783444516.736007:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575410688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444516.736023:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444516.736060:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575410688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.736065:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00080000:1.0:1783444516.736081:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444516.736104:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575410688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444516.736454:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575410432 00000100:00100000:3.0:1783444516.736459:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575410432 00000100:00100000:3.0:1783444516.736481:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:3.0:1783444516.736494:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3632:x1870073575410432:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1783444516.736518:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3507 last 0 00000020:00000080:3.0:1783444516.736545:0:26209:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42cb6883e3833633 00002000:00100000:3.0:1783444516.736560:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9368c5118000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783444516.736564:0:26209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783444516.736568:0:26209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783444516.736623:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783444516.736645:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9368c511f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444516.736687:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3632:x1870073575410432:12345-0@lo:8:llog_process_th.0 Request processed in 193us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.736694:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00000100:00100000:0.0:1783444516.736707:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783444516.736713:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783444516.736720:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783444516.736724:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783444516.736726:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c5037000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783444516.736744:0:3632:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783444516.736749:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575410432:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783444516.736992:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575410816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444516.737025:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.737241:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575410816 00000100:00100000:0.0:1783444516.737246:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575410816 00000100:00100000:0.0:1783444516.737331:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:0.0:1783444516.737342:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575410816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444516.737355:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444516.737388:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1870073575410816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.737395:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1783444516.737421:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575410816:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783444516.737435:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1783444516.737626:0:94354:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1783444516.737661:0:94374:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783444516.737719:0:94374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3507779929085ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783444516.737725:0:94374:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783444516.738229:0:94366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94366:1870073575410944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444516.738283:0:94366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1783444516.738414:0:94376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368dd221800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783444516.738418:0:94376:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368dd221800 4 00000100:00100000:2.0:1783444516.738500:0:94366:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.738648:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575410944 00000100:00100000:0.0:1783444516.738655:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575410944 00000100:00100000:0.0:1783444516.738695:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783444516.738704:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94366:x1870073575410944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444516.738850:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94366:x1870073575410944:12345-0@lo:502:llog_process_th.0 Request processed in 146us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.738877:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783444516.739088:0:94366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94366:1870073575410944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444516.739276:0:94366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444516.739281:0:94366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444516.739283:0:94366:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783444516.739286:0:94366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:0.0:1783444516.739552:0:94353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:0.0:1783444516.739574:0:94353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783444516.739597:0:94353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.739605:0:94353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.739611:0:94353:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368dd221800 from 1 10000000:01000000:0.0:1783444516.739613:0:94353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783444516.739636:0:94353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.739642:0:94353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.739648:0:94353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444516.739661:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783444516.739685:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.739707:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa813c0 going to sleep for 11 seconds 00000004:00080000:0.0:1783444516.739858:0:94354:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783444516.739908:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575411072 00000100:00100000:1.0:1783444516.739913:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575411072 00000100:00100000:1.0:1783444516.739948:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783444516.739956:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:94353:x1870073575411072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444516.739966:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444516.739980:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383363a expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.740015:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383363a expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.740025:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383363a expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.740034:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27000, rc 0) 00000100:00100000:1.0:1783444516.740082:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:94353:x1870073575411072:12345-0@lo:101:mount.lustre.0 Request processed in 126us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.740089:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783444516.740506:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444516.740521:0:94353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.740552:0:94353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444516.741625:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411200:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783444516.741727:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.742004:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368eaa813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444516.742291:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575411200 00000100:00100000:2.0:1783444516.742298:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575411200 00000100:00100000:2.0:1783444516.742382:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783444516.742391:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:94353:x1870073575411200:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783444516.742413:0:94361:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783444516.742433:0:94361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783444516.742437:0:94361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783444516.742439:0:94361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783444516.742442:0:94361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 126 00000100:00100000:2.0:1783444516.742551:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:94353:x1870073575411200:12345-0@lo:256:mount.lustre.0 Request processed in 161us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.742869:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783444516.743088:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411200:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783444516.744115:0:94353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783444516.744148:0:94353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.744160:0:94353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444516.744170:0:94353:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368dd221800 from 1 10000000:01000000:3.0:1783444516.744173:0:94353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783444516.744207:0:94353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e3833648 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.744216:0:94353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e3833648 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.744240:0:94353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e3833648 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444516.744263:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783444516.744312:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.744749:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5b4bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.744910:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575411328 00000100:00100000:0.0:1783444516.744917:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575411328 00000100:00100000:0.0:1783444516.744962:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783444516.744972:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+9:94353:x1870073575411328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783444516.744985:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444516.745001:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf90800/0x42cb6883e383364f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833648 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.745025:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf90800/0x42cb6883e383364f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833648 expref: 10 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.745037:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf90800/0x42cb6883e383364f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833648 expref: 10 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.745046:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90800, rc 0) 00000100:00100000:3.0:1783444516.745197:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444516.745210:0:94353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e3833648 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383364f expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.745219:0:94353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e3833648 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383364f expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444516.745285:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444516.745314:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.745329:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5b4bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.745416:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94353:x1870073575411328:12345-0@lo:101:mount.lustre.0 Request processed in 125us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.745424:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783444516.745452:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575411456 00000100:00100000:0.0:1783444516.745456:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575411456 00000100:00100000:0.0:1783444516.745468:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783444516.745482:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94353:x1870073575411456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783444516.745658:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94353:x1870073575411456:12345-0@lo:501:mount.lustre.0 Request processed in 175us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.745664:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783444516.746021:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783444516.746054:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444516.746110:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.746147:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5b4bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.746245:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575411584 00000100:00100000:0.0:1783444516.746250:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575411584 00000100:00100000:0.0:1783444516.746282:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783444516.746288:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94353:x1870073575411584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783444516.746380:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94353:x1870073575411584:12345-0@lo:503:mount.lustre.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.746387:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783444516.746491:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444516.746967:0:94377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94377:1870073575411712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444516.747006:0:94377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.747036:0:94377:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5b4b780 going to sleep for 11 seconds 00000100:00100000:2.0:1783444516.747083:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575411712 00000100:00100000:2.0:1783444516.747089:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575411712 00000100:00100000:2.0:1783444516.747206:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783444516.747213:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94377:x1870073575411712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444516.747852:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94377:x1870073575411712:12345-0@lo:502:llog_process_th.0 Request processed in 637us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.747861:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783444516.747957:0:94377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94377:1870073575411712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444516.747986:0:94377:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444516.747996:0:94377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.747998:0:94377:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783444516.748005:0:94377:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9368dd221800 00000020:00000080:3.0:1783444516.748007:0:94377:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783444516.748016:0:94377:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444516.748018:0:94377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.748020:0:94377:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783444516.748022:0:94377:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444516.748024:0:94377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.748026:0:94377:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783444516.748029:0:94377:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9368dd221800 00000020:00000080:3.0:1783444516.748032:0:94377:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783444516.748129:0:94377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94377:1870073575411840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444516.748176:0:94377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444516.748190:0:94377:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5b4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.749222:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575411840 00000100:00100000:0.0:1783444516.749231:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575411840 00000100:00100000:0.0:1783444516.749280:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783444516.749288:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94377:x1870073575411840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444516.749461:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94377:x1870073575411840:12345-0@lo:502:llog_process_th.0 Request processed in 172us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.749468:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783444516.749560:0:94377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5803800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94377:1870073575411840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444516.749664:0:94377:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444516.749671:0:94377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444516.749673:0:94377:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783444516.749677:0:94377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783444516.749877:0:94353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1783444516.749896:0:94353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444516.749918:0:94353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e3833648 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383364f expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.749930:0:94353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e3833648 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383364f expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.749989:0:94353:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783444516.749997:0:94353:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9368dd221800 10000000:01000000:0.0:1783444516.750000:0:94353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9368dd221800 10000000:01000000:0.0:1783444516.750004:0:94353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783444516.750009:0:94353:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368dd221800 from 1 10000000:01000000:0.0:1783444516.750012:0:94353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444516.750039:0:94353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.750048:0:94353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.750057:0:94353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444516.750075:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783444516.750448:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.750479:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75e5780 going to sleep for 11 seconds 00000100:00100000:3.0:1783444516.750843:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575411968 00000100:00100000:3.0:1783444516.750850:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575411968 00000100:00100000:3.0:1783444516.750885:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783444516.750893:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94353:x1870073575411968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783444516.750904:0:94361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444516.750917:0:94361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833656 expref: -99 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.751081:0:94361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833656 expref: 11 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.751090:0:94361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833656 expref: 11 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444516.751174:0:94361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513b800, rc 0) 00000100:00100000:3.0:1783444516.751219:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94353:x1870073575411968:12345-0@lo:101:mount.lustre.0 Request processed in 326us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.751226:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783444516.751319:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575411968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444516.751335:0:94353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.751343:0:94353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444516.751548:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575412096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444516.751585:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444516.751620:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c328fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.752222:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575412096 00000100:00100000:0.0:1783444516.752229:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575412096 00000100:00100000:0.0:1783444516.752268:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783444516.752276:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94353:x1870073575412096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783444516.752522:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94353:x1870073575412096:12345-0@lo:501:mount.lustre.0 Request processed in 245us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.752529:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783444516.752630:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575412096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783444516.752670:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575412224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783444516.752712:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444516.752742:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c328fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444516.752976:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575412224 00000100:00100000:3.0:1783444516.752992:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575412224 00000100:00100000:3.0:1783444516.753027:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783444516.753034:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94353:x1870073575412224:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783444516.753147:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94353:x1870073575412224:12345-0@lo:503:mount.lustre.0 Request processed in 100us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.753154:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783444516.753197:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575412224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783444516.753414:0:94379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94379:1870073575412352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444516.753448:0:94379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444516.753472:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575412352 00000100:00100000:2.0:1783444516.753476:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575412352 00000100:00100000:2.0:1783444516.753500:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783444516.753507:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94379:x1870073575412352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444516.753581:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94379:x1870073575412352:12345-0@lo:502:llog_process_th.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.753588:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783444516.753622:0:94379:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974540 going to sleep for 11 seconds 00000100:00100000:2.0:1783444516.753644:0:94379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94379:1870073575412352:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783444516.753694:0:94379:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783444516.753708:0:94379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9367c33319c0) 00000020:00000080:2.0:1783444516.753733:0:94379:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1783444516.755046:0:94379:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368dd221800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783444516.755055:0:94379:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368dd221800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783444516.755058:0:94379:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368dd221800 4 00010000:00080000:0.0:1783444516.755177:0:94379:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9367cae88800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1783444516.760989:0:94379:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1783444516.762199:0:94379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783444516.762270:0:94379:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783444516.762285:0:94379:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42cb6883e383366b 00000100:00080000:0.0:1783444516.762298:0:94379:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783444516.762305:0:94379:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9367cae88800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444516.762341:0:94379:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd170380 x1870073575412480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444516.762415:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575412480:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783444516.762490:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783444516.762553:0:94379:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783444516.762869:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575412480 00000100:00100000:1.0:1783444516.762877:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575412480 00000100:00100000:1.0:1783444516.762907:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1783444516.762914:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575412480:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783444516.762970:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575412480:12345-0@lo:38:llog_process_th.0 Request processed in 54us (479us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783444516.762976:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1783444516.763015:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783444516.763022:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367cae88800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444516.763026:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783444516.763029:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575412480:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783444516.763300:0:94379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94379:1870073575412608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444516.763345:0:94379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.763371:0:94379:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444516.763422:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575412608 00000100:00100000:2.0:1783444516.763432:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575412608 00000100:00100000:2.0:1783444516.763464:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783444516.763470:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94379:x1870073575412608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444516.763623:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94379:x1870073575412608:12345-0@lo:502:llog_process_th.0 Request processed in 152us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.763630:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783444516.763742:0:94379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94379:1870073575412608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444516.763776:0:94379:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94379:1870073575412736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444516.763912:0:94379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.763973:0:94379:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75e53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444516.764004:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575412736 00000100:00100000:1.0:1783444516.764009:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575412736 00000100:00100000:1.0:1783444516.764068:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783444516.764075:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94379:x1870073575412736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444516.764273:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94379:x1870073575412736:12345-0@lo:502:llog_process_th.0 Request processed in 197us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.764281:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783444516.764357:0:94379:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:94379:1870073575412736:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783444516.764378:0:94379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1783444516.764443:0:94353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:2.0:1783444516.764465:0:94353:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444516.764481:0:94353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444516.764493:0:94353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783444516.764539:0:94353:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783444516.764542:0:94353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444516.764543:0:94353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444516.764544:0:94353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444516.764545:0:94353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444516.764547:0:94353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444516.764548:0:94353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444516.764550:0:94353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444516.764552:0:94353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444516.764554:0:94353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783444516.764558:0:94353:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783444516.764561:0:94353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783444516.764562:0:94353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444516.764563:0:94353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444516.764564:0:94353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444516.764565:0:94353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444516.764571:0:94353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444516.764572:0:94353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444516.764573:0:94353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444516.764574:0:94353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444516.764575:0:94353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783444516.764589:0:94353:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783444516.764601:0:94353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575412864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783444516.764631:0:94353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444516.764646:0:94353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d4dd8780 going to sleep for 11 seconds 00000100:00100000:2.0:1783444516.764668:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575412864 00000100:00100000:2.0:1783444516.764672:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575412864 00000100:00100000:2.0:1783444516.764695:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783444516.764701:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:94353:x1870073575412864:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783444516.764722:0:94359:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783444516.764736:0:94359:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783444516.770191:0:94359:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783444516.770215:0:94359:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783444516.771215:0:94363:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783444516.771221:0:94363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783444516.771244:0:94363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.771262:0:94363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383363a expref: 11 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.771271:0:94363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.771319:0:94363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e383363a expref: 11 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.771334:0:94363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e383363a expref: 11 pid: 94360 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444516.771349:0:94363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94363:1870073575412992:0@lo:104: 00000100:00100000:1.0:1783444516.771417:0:94363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444516.771503:0:94363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c328fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444516.775362:0:6489:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783444516.775398:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575412992 00000100:00100000:0.0:1783444516.775408:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575412992 00000100:00100000:0.0:1783444516.775482:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1783444516.775493:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ceb07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:94363:x1870073575412992:12345-0@lo:104: 00010000:00010000:0.0:1783444516.775512:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.775591:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783444516.775597:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ceb07c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:94363:x1870073575412992:12345-0@lo:104: Request processed in 106us (4181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.775604:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1783444516.775755:0:94363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79abb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94363:1870073575412992:0@lo:104: 00010000:00010000:1.0:1783444516.775777:0:94363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.775881:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444516.775887:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.775895:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444516.775900:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.775909:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444516.775916:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444516.775922:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444516.775966:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.775973:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444516.775989:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.775996:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf91c00/0x42cb6883e383363a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833641 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776011:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444516.776013:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444516.776014:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444516.776077:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575413120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444516.776131:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.776294:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575413120 00000100:00100000:0.0:1783444516.776300:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575413120 00010000:00010000:0.0:1783444516.776317:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383363a expref: 12 pid: 94360 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444516.776353:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1783444516.776361:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+12:3633:x1870073575413120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444516.776372:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444516.776378:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383363a expref: 12 pid: 94360 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776389:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e383363a expref: 12 pid: 94360 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776403:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27000/0x42cb6883e3833641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e383363a expref: 12 pid: 94360 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776416:0:6490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776424:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783444516.776438:0:6490:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005217606s 00010000:00010000:0.0:1783444516.776443:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776449:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776456:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776461:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776471:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444516.776476:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776483:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776493:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444516.776501:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444516.776527:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+11:3633:x1870073575413120:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444516.776533:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:3.0:1783444516.776618:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+10:94353:x1870073575412864:12345-0@lo:253:mount.lustre.0 Request processed in 11915us (11984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.776624:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575413120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444516.776627:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1783444516.776640:0:94363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.776646:0:94363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444516.776652:0:94363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26e00/0x42cb6883e3833672 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444516.777264:0:94353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:94353:1870073575412864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783444516.777277:0:94353:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783444516.777280:0:94353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783444516.777281:0:94353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783444516.777283:0:94353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444516.777284:0:94353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444516.777286:0:94353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444516.777287:0:94353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444516.777288:0:94353:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783444516.777290:0:94353:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783444516.777292:0:94353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444516.777293:0:94353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783444516.777307:0:94353:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1783444516.793144:0:94353:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411361 00000040:01000000:2.0:1783444516.798576:0:94353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783444516.798685:0:94385:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411361 00000020:00080000:3.0:1783444516.798689:0:94385:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411361 00000040:01000000:2.0:1783444516.803395:0:94386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783444516.803703:0:94353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1783444516.805720:0:94386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783444516.808714:0:94386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783444516.808870:0:94386:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1783444516.818239:0:94387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94387:1870073575413248:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444516.818341:0:94387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.818454:0:94387:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2243c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444516.819219:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575413248 00000100:00100000:2.0:1783444516.819231:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575413248 00000100:00100000:2.0:1783444516.819303:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:2.0:1783444516.819316:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94387:x1870073575413248:12345-0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783444516.819453:0:94353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783444516.819492:0:94353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783444516.819592:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94387:x1870073575413248:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 278us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.819601:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:0.0:1783444516.819685:0:94387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94387:1870073575413248:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1783444516.819721:0:94387:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783444516.819759:0:94387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94387:1870073575413376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444516.819842:0:94387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444516.819873:0:94387:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2243c00 going to sleep for 11 seconds 00000004:00000080:1.0:1783444516.819927:0:94353:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783444516.819936:0:94353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783444516.819975:0:94353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783444516.820025:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575413376 00000100:00100000:2.0:1783444516.820031:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575413376 00000100:00100000:2.0:1783444516.820066:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:2.0:1783444516.820074:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fa172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94387:x1870073575413376:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783444516.820202:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fa172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94387:x1870073575413376:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 128us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.820208:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000040:00080000:1.0:1783444516.820863:0:94353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1783444516.821105:0:94387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94387:1870073575413376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444516.821202:0:94387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94387:1870073575413504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1783444516.821240:0:94387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783444516.821317:0:94353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:0.0:1783444516.821335:0:94387:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c2243c00 going to sleep for 11 seconds 00000040:01000000:1.0:1783444516.821356:0:94353:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783444516.821456:0:94353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783444516.822006:0:94353:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00010000:00080000:1.0:1783444516.823713:0:94353:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084296 00000100:00100000:3.0:1783444516.825700:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575413504 00000100:00100000:3.0:1783444516.825715:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575413504 00000100:00100000:3.0:1783444516.825812:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:3.0:1783444516.825823:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94387:x1870073575413504:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:0.0:1783444516.826124:0:94388:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94388 00010000:02000000:0.0:1783444516.826146:0:94388:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1783444516.826150:0:94388:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783444516.826154:0:94388:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1783444516.826283:0:94353:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783444516.826300:0:94353:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783444516.826319:0:94353:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1783444516.826337:0:94353:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000100:00100000:3.0:1783444516.826954:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94387:x1870073575413504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1131us (5710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444516.826964:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000020:00000004:1.0:1783444516.827260:0:94353:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444516.827500:0:94353:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783444516.839379:0:94387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94387:1870073575413504:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783444516.839455:0:94387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783444516.841244:0:94387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d3:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783444516.841340:0:94387:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783444516.841346:0:94387:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1783444516.843880:0:94388:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1783444516.888068:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444516.888467:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444516.891152:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444516.891309:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557839616 00000100:00100000:1.0:1783444516.891319:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557839616 00000100:00100000:1.0:1783444516.891361:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557839744 00000100:00100000:1.0:1783444516.891364:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557839744 00000100:00100000:1.0:1783444516.891415:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1135 00000100:00100000:1.0:1783444516.891425:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2403:x1870073557839744:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444516.891470:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557839488 00000100:00100000:2.0:1783444516.891476:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557839488 00000100:00100000:2.0:1783444516.891504:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:2.0:1783444516.891514:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1870073557839488:12345-192.168.204.20@tcp:250:kworker.0 00000100:00100000:1.0:1783444516.891514:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2403:x1870073557839744:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 87us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.891527:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1135 00010000:00080000:2.0:1783444516.891539:0:94361:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp t0 exp 0000000000000000 cur 3507 last 0 00000100:00100000:1.0:1783444516.891552:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1435 00000020:00000080:2.0:1783444516.891568:0:94361:0:(genops.c:1406:class_connect()) connect: client 28921b6e-3bc9-4a81-ae87-1992169ba754, cookie 0x42cb6883e3833679 00000100:00100000:1.0:1783444516.891575:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870073557839616:12345-192.168.204.20@tcp:38:kworker.0 00010000:00080000:1.0:1783444516.891597:0:67017:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '08efc25c-17e5-4d29-97d2-f1505f195a06' at ffff9367c5621800, cookie 0x42cb6883e38335ca 00010000:00080000:1.0:1783444516.891603:0:67017:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp recovering/t120259084297 exp ffff9367c5621800 cur 3507 last 1783444516 00010000:02000400:1.0:1783444516.891612:0:67017:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1783444516.891620:0:67017:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1783444516.891648:0:67017:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783444516.891814:0:94361:0:(import.c:65:import_set_state_nolock()) ffff9367c17b6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783444516.891842:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+5:2400:x1870073557839488:12345-192.168.204.20@tcp:250:kworker.0 Request processed in 332us (3785us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444516.891849:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00080000:1.0:1783444516.891888:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368c518e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444516.891921:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557839616:12345-192.168.204.20@tcp:38:kworker.0 Request processed in 346us (3453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444516.891928:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1435 00000100:00080000:1.0:1783444516.891949:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783444516.893673:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444516.896523:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444516.897239:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557831424 00000100:00100000:2.0:1783444516.897249:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557831424 00000100:00100000:2.0:1783444516.897303:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1436 00000100:00100000:2.0:1783444516.897313:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557831424:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00080000:2.0:1783444516.897334:0:71469:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084297, replaying 00000100:00100000:2.0:1783444516.897347:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557831424:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 36us (833us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444516.897353:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1436 00010000:00080000:0.0:1783444516.897415:0:94388:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1783444517.927664:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783444518.108993:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783444518.109013:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368dd221800 from 127 10000000:01000000:3.0:1783444518.109018:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783444518.109070:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.109094:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.109118:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.109150:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575413632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.109225:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.109272:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.109324:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575413632 00000100:00100000:0.0:1783444518.109332:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575413632 00000100:00100000:0.0:1783444518.109386:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783444518.109395:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+10:6503:x1870073575413632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.109409:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444518.109423:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833680 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.109446:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833680 expref: 11 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.109457:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833680 expref: 11 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.109467:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91a00, rc 0) 00000100:00100000:0.0:1783444518.109501:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575413632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.109508:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783444518.110644:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575413632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.110679:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.110700:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444518.110842:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575413760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.110888:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444518.110922:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.110957:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575413760 00000100:00100000:0.0:1783444518.110963:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575413760 00000100:00100000:0.0:1783444518.111028:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783444518.111037:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575413760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783444518.111057:0:94361:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783444518.111075:0:94361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783444518.111078:0:94361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:0.0:1783444518.111193:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575413760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.111199:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783444518.111457:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575413760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783444518.111512:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783444518.111520:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.111528:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444518.111536:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783444518.111539:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 58 10000000:01000000:2.0:1783444518.111541:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783444518.111566:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.111573:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.111590:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444518.111603:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575413888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.111631:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444518.111652:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.111921:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575413888 00000100:00100000:0.0:1783444518.111926:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575413888 00000100:00100000:0.0:1783444518.111954:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783444518.111959:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+11:6503:x1870073575413888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.111967:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444518.111977:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383368e expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.111993:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383368e expref: 12 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.111999:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383368e expref: 12 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.112006:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91800, rc 0) 00000100:00100000:0.0:1783444518.112036:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575413888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.112040:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783444518.112121:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575413888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444518.112132:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.112144:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444518.112203:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.112229:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444518.112272:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e3834780 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.112482:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575414016 00000100:00100000:0.0:1783444518.112487:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575414016 00000100:00100000:0.0:1783444518.112517:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783444518.112532:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575414016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.113314:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575414016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 781us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.113322:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783444518.113474:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.113519:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.113562:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.113588:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.113837:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575414144 00000100:00100000:0.0:1783444518.113841:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575414144 00000100:00100000:0.0:1783444518.113865:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783444518.113870:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575414144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.113944:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575414144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.113949:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783444518.114183:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444518.115415:0:94448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1783444518.116373:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1783444518.116405:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783444518.116417:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.116449:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444518.116459:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783444518.116462:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cd800 from 124 10000000:01000000:1.0:1783444518.116465:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783444518.116508:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.116516:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.116527:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444518.116552:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.116621:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444518.116672:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e3834d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.116755:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575414272 00000100:00100000:0.0:1783444518.116764:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575414272 00000100:00100000:0.0:1783444518.116852:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783444518.116861:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+12:6503:x1870073575414272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.116876:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444518.116888:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383369c expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.116911:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383369c expref: 13 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.116921:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383369c expref: 13 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.116930:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91400, rc 0) 00000100:00100000:0.0:1783444518.116979:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575414272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.116992:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783444518.117097:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.117125:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.117136:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.117192:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.117229:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.117261:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.117436:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575414400 00000100:00100000:0.0:1783444518.117441:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575414400 00000100:00100000:0.0:1783444518.117471:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783444518.117478:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575414400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783444518.117492:0:94361:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783444518.117510:0:94361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783444518.117514:0:94361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1783444518.117517:0:94361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1783444518.117520:0:94361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1783444518.117522:0:94361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:0.0:1783444518.117613:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575414400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.117621:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783444518.117696:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783444518.117824:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783444518.117832:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.117841:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444518.117849:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783444518.117856:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1783444518.117859:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444518.117878:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.117886:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.117893:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.117906:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.117932:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.117944:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.118096:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575414528 00000100:00100000:0.0:1783444518.118101:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575414528 00000100:00100000:0.0:1783444518.118144:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783444518.118151:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+13:6503:x1870073575414528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.118160:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444518.118171:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38336aa expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.118188:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38336aa expref: 14 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.118197:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336aa expref: 14 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.118215:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91600, rc 0) 00000100:00100000:0.0:1783444518.118243:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575414528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.118250:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783444518.118328:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.118339:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.118348:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.118403:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.118430:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.118462:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.118510:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575414656 00000100:00100000:0.0:1783444518.118514:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575414656 00000100:00100000:0.0:1783444518.118542:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783444518.118549:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575414656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.118698:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575414656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.118705:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783444518.118733:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.118764:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.118846:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.118859:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c75ddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.118869:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575414784 00000100:00100000:0.0:1783444518.118872:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575414784 00000100:00100000:0.0:1783444518.118888:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783444518.118893:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575414784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.118990:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575414784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.118997:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783444518.119034:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444518.119606:0:94449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:2.0:1783444518.123023:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:2.0:1783444518.123066:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783444518.123077:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.123090:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444518.123101:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1783444518.123104:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9368ef0cd800 from 1 10000000:01000000:2.0:1783444518.123116:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783444518.123163:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38336b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.123172:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38336b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.123181:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38336b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444518.123205:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.123281:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444518.123315:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef11ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.123698:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575414912 00000100:00100000:3.0:1783444518.123704:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575414912 00000100:00100000:3.0:1783444518.123759:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783444518.123784:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+14:6503:x1870073575414912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.123825:0:94361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444518.123881:0:94361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0031c00/0x42cb6883e38336bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38336b8 expref: -99 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.123910:0:94361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0031c00/0x42cb6883e38336bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38336b8 expref: 15 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.123922:0:94361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0031c00/0x42cb6883e38336bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336b8 expref: 15 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.123930:0:94361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031c00, rc 0) 00000100:00100000:2.0:1783444518.123981:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575414912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444518.123988:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783444518.124248:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575414912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.124261:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38336b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.124268:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38336b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444518.124282:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783444518.124284:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38336b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.124289:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c0031600/0x42cb6883e38336b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336bf expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444518.124294:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783444518.124296:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef0cd800 from 7 10000000:01000000:3.0:1783444518.124297:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783444518.124309:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e38336c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.124314:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e38336c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.124318:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e38336c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.124327:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.124348:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.124373:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444518.124379:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575415040 00000100:00100000:2.0:1783444518.124383:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575415040 00000100:00100000:2.0:1783444518.124416:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783444518.124423:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575415040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444518.124431:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444518.124440:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0030a00/0x42cb6883e38336cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38336c6 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.124454:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030a00/0x42cb6883e38336cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38336c6 expref: 16 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.124462:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0030a00/0x42cb6883e38336cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336c6 expref: 16 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.124481:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030a00, rc 0) 00000100:00100000:2.0:1783444518.124508:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575415040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444518.124514:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783444518.124517:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.124533:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e38336c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.124541:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e38336c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.124587:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.124607:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.124614:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444518.125073:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575415168 00000100:00100000:1.0:1783444518.125080:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575415168 00000100:00100000:1.0:1783444518.125121:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783444518.125128:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575415168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.125261:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575415168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444518.125268:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783444518.125334:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.125359:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.125389:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.125412:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444518.125423:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575415296 00000100:00100000:2.0:1783444518.125427:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575415296 00000100:00100000:2.0:1783444518.125456:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783444518.125462:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575415296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.125548:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575415296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.125594:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.126321:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:2.0:1783444518.128713:0:94450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783444518.128810:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783444518.128836:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783444518.128848:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e38336c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.128860:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e38336c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444518.128870:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444518.128872:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 58 10000000:01000000:3.0:1783444518.128875:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444518.128914:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.128940:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.128951:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.128975:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.129036:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.129077:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444518.129277:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575415424 00000100:00100000:1.0:1783444518.129283:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575415424 00000100:00100000:1.0:1783444518.129320:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783444518.129332:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575415424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444518.129343:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444518.129353:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38336d4 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.129372:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 17 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.129379:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 17 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.129386:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26400, rc 0) 00000100:00100000:1.0:1783444518.129428:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575415424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444518.129435:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783444518.129460:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444518.129475:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.129484:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444518.129535:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.129561:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.129603:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575415552 00000100:00100000:3.0:1783444518.129607:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575415552 00000100:00100000:2.0:1783444518.129648:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.129676:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783444518.129684:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575415552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.129832:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575415552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.129839:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783444518.129869:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.129895:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.129940:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444518.129966:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444518.130007:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575415680 00000100:00100000:1.0:1783444518.130011:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575415680 00000100:00100000:1.0:1783444518.130033:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783444518.130037:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575415680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.130124:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575415680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444518.130131:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783444518.130269:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444518.131052:0:94451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1783444518.131198:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1783444518.131222:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444518.131232:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.131243:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444518.131251:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783444518.131254:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783444518.131257:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444518.131300:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.131308:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.131317:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.131335:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.131376:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.131407:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849900 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.131411:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575415808 00000100:00100000:0.0:1783444518.131418:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575415808 00000100:00100000:0.0:1783444518.131459:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783444518.131467:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575415808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.131478:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444518.131490:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38336e2 expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.131513:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 18 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.131522:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 18 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.131530:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91200, rc 0) 00000100:00100000:0.0:1783444518.131570:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575415808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.131577:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783444518.131599:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.131611:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.131619:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.131665:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.131688:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.131752:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849900 going to sleep for 11 seconds 00000100:00100000:1.0:1783444518.131955:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575415936 00000100:00100000:1.0:1783444518.131960:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575415936 00000100:00100000:1.0:1783444518.131989:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783444518.131994:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575415936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.132105:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575415936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444518.132245:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575415936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.132273:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.132309:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444518.132358:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783444518.132387:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444518.132415:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575416064 00000100:00100000:1.0:1783444518.132418:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575416064 00000100:00100000:3.0:1783444518.132444:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783444518.132451:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575416064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.133431:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575416064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 976us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.133441:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783444518.133541:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444518.135601:0:94452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783444518.135763:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783444518.135836:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783444518.135847:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.135856:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444518.135863:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783444518.135864:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368f9acf800 from 7 10000000:01000000:3.0:1783444518.135866:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783444518.135899:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513be00/0x42cb6883e38336f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.135904:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368c513be00/0x42cb6883e38336f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.135912:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368c513be00/0x42cb6883e38336f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444518.135931:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.135984:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.136017:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c5849900 going to sleep for 11 seconds 00000100:00100000:2.0:1783444518.136091:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575416192 00000100:00100000:2.0:1783444518.136098:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575416192 00000100:00100000:2.0:1783444518.136153:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783444518.136162:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575416192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444518.136176:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444518.136191:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0030000/0x42cb6883e38336f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38336f0 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.136216:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030000/0x42cb6883e38336f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38336f0 expref: 19 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.136224:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0030000/0x42cb6883e38336f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336f0 expref: 19 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.136231:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030000, rc 0) 00000100:00100000:2.0:1783444518.136272:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575416192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444518.136286:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783444518.136302:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.136316:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368c513be00/0x42cb6883e38336f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.136325:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368c513be00/0x42cb6883e38336f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444518.136379:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.136681:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.136716:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444518.136724:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575416320 00000100:00100000:2.0:1783444518.136728:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575416320 00000100:00100000:2.0:1783444518.136773:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783444518.136805:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575416320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444518.136909:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575416320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444518.136915:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783444518.137329:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.137364:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.137418:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.137445:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.137640:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575416448 00000100:00100000:3.0:1783444518.137646:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575416448 00000100:00100000:3.0:1783444518.137681:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783444518.137688:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575416448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.137817:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575416448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.137824:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783444518.138204:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444518.140053:0:94453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783444518.140358:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783444518.140383:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783444518.140531:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368c513be00/0x42cb6883e38336f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.140543:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368c513be00/0x42cb6883e38336f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38336f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444518.140553:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444518.140556:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 58 10000000:01000000:0.0:1783444518.140560:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444518.140613:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.140621:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.140630:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444518.140652:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.141542:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.141591:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444518.142838:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575416576 00000100:00100000:2.0:1783444518.142851:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575416576 00000100:00100000:2.0:1783444518.142917:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783444518.142926:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575416576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444518.142943:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444518.142960:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38336fe expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.142985:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38336fe expref: 20 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.142996:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336fe expref: 20 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.143005:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030200, rc 0) 00000100:00100000:2.0:1783444518.143082:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575416576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444518.143089:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783444518.143120:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.143137:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.143146:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444518.143221:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.143251:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.143274:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:1.0:1783444518.143498:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575416704 00000100:00100000:1.0:1783444518.143503:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575416704 00000100:00100000:1.0:1783444518.143539:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783444518.143547:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575416704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.143663:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575416704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444518.143670:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783444518.143674:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.144353:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.144498:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.144523:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.144531:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575416832 00000100:00100000:3.0:1783444518.144536:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575416832 00000100:00100000:3.0:1783444518.144567:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783444518.144575:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575416832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.144672:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575416832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.144679:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783444518.144940:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444518.146239:0:94454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1783444518.147586:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1783444518.147621:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444518.147633:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.147647:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444518.147658:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783444518.147661:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783444518.147664:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444518.147704:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.147726:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.147738:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444518.147982:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.148040:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.148397:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:1.0:1783444518.148440:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575416960 00000100:00100000:1.0:1783444518.148447:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575416960 00000100:00100000:1.0:1783444518.148533:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783444518.148543:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575416960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444518.148557:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444518.148572:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383370c expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.148598:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383370c expref: 21 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.148608:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383370c expref: 21 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.148615:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26600, rc 0) 00000100:00100000:1.0:1783444518.148654:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575416960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444518.148659:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783444518.148735:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575416960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.148761:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.148777:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444518.148858:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.148884:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.149393:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.149420:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575417088 00000100:00100000:3.0:1783444518.149427:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575417088 00000100:00100000:3.0:1783444518.149473:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783444518.149481:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575417088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.149613:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575417088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.149620:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783444518.149694:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.149725:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.150026:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.150244:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.150275:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575417216 00000100:00100000:3.0:1783444518.150280:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575417216 00000100:00100000:3.0:1783444518.150314:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783444518.150320:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575417216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.152556:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575417216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2229us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.152567:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783444518.152873:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783444518.154015:0:94455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1783444518.154225:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1783444518.154261:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783444518.154270:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.154278:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444518.154285:0:6503:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783444518.154287:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9368ef29c800 from 7 10000000:01000000:0.0:1783444518.154288:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783444518.154321:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.154328:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.154339:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444518.154365:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.154419:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444518.154453:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444518.154840:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575417344 00000100:00100000:2.0:1783444518.154849:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575417344 00000100:00100000:2.0:1783444518.154892:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783444518.154901:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575417344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444518.154915:0:94361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444518.154928:0:94361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c0030600/0x42cb6883e3833721 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383371a expref: -99 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.154953:0:94361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c0030600/0x42cb6883e3833721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383371a expref: 22 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.154963:0:94361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c0030600/0x42cb6883e3833721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383371a expref: 22 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.154971:0:94361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030600, rc 0) 00000100:00100000:2.0:1783444518.156264:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575417344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1355us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444518.156275:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783444518.156346:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444518.156367:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.156380:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444518.156816:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.156866:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444518.156908:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.156918:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575417472 00000100:00100000:0.0:1783444518.156926:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575417472 00000100:00100000:0.0:1783444518.156968:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783444518.156977:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575417472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.157717:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575417472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 738us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.157727:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783444518.157758:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.157847:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.157894:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444518.157928:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.157939:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575417600 00000100:00100000:3.0:1783444518.157946:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575417600 00000100:00100000:3.0:1783444518.157984:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783444518.157990:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575417600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.158151:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.158155:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575417600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.158164:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000040:00080000:2.0:1783444518.159273:0:94456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783444518.159762:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783444518.159786:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783444518.160635:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.160648:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444518.160658:0:6503:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1783444518.160661:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9368c507b380 from 1 10000000:01000000:1.0:1783444518.160663:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783444518.161747:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27200/0x42cb6883e3833728 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.161776:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27200/0x42cb6883e3833728 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.161814:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27200/0x42cb6883e3833728 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444518.161843:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.161915:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444518.161964:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783444518.162094:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575417728 00000100:00100000:0.0:1783444518.162102:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575417728 00000100:00100000:0.0:1783444518.162172:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783444518.162183:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575417728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444518.162197:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444518.162217:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367caf91c00/0x42cb6883e383372f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833728 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.162238:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367caf91c00/0x42cb6883e383372f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833728 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.162248:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367caf91c00/0x42cb6883e383372f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833728 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444518.162257:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91c00, rc 0) 00000100:00100000:0.0:1783444518.162300:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575417728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.162306:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783444518.162397:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444518.162412:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27200/0x42cb6883e3833728 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383372f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.162421:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27200/0x42cb6883e3833728 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383372f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444518.162441:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783444518.162447:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27200/0x42cb6883e3833728 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383372f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.162454:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27200/0x42cb6883e3833728 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383372f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444518.162462:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783444518.162465:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:1.0:1783444518.162468:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783444518.162483:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.162504:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.162513:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444518.162528:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.162553:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444518.163527:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575417856 00000100:00100000:3.0:1783444518.163537:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575417856 00000100:00100000:1.0:1783444518.163556:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.163575:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783444518.163584:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575417856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.163597:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444518.163612:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833736 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.163634:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833736 expref: 24 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.163644:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833736 expref: 24 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.163653:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513ac00, rc 0) 00000100:00100000:3.0:1783444518.163749:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575417856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.163756:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783444518.164014:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444518.164029:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.164038:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444518.164102:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.164152:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444518.164214:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0240 going to sleep for 11 seconds 00000100:00100000:3.0:1783444518.164598:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575417984 00000100:00100000:3.0:1783444518.164604:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575417984 00000100:00100000:3.0:1783444518.164680:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783444518.164688:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575417984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.164817:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575417984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (664us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444518.164842:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783444518.164894:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575417984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783444518.164927:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783444518.164934:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444518.164943:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444518.413689:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444518.414017:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557839872 00000100:00100000:3.0:1783444518.414029:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557839872 00000100:00100000:3.0:1783444518.414112:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1783444518.414124:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+5:70972:x1870073557839872:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.414143:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444518.414163:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939df2 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.414194:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 6 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.414206:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 6 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.414217:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513aa00, rc 0) 00000100:00100000:3.0:1783444518.414287:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70972:x1870073557839872:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 165us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.414296:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:1.0:1783444518.420724:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444518.420841:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557840000 00000100:00100000:3.0:1783444518.420856:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557840000 00000100:00100000:3.0:1783444518.420923:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1783444518.420934:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70972:x1870073557840000:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783444518.420962:0:94360:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1783444518.420997:0:94360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783444518.421002:0:94360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1783444518.421004:0:94360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1783444518.421013:0:94360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1783444518.421015:0:94360:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:3.0:1783444518.426758:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70972:x1870073557840000:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 Request processed in 5814us (6032us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.426780:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:2.0:1783444518.445300:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444518.447861:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557840128 00000100:00100000:1.0:1783444518.447877:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557840128 00000100:00100000:1.0:1783444518.447953:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:1.0:1783444518.447964:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c54d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+6:70972:x1870073557840128:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444518.447984:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444518.448005:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939df9 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.448052:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 7 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.448063:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 7 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.448072:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27400, rc 0) 00000100:00100000:1.0:1783444518.448154:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c54d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+7:70972:x1870073557840128:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 192us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444518.448161:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:1.0:1783444518.456628:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444518.457004:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557840256 00000100:00100000:0.0:1783444518.457014:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557840256 00000100:00100000:0.0:1783444518.457236:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:0.0:1783444518.457247:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c54d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+7:70972:x1870073557840256:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.457417:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c54d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557840256:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 170us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.457425:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:2.0:1783444518.467618:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444518.468115:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557840384 00000100:00100000:1.0:1783444518.468127:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557840384 00000100:00100000:1.0:1783444518.468192:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1783444518.468204:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c338a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557840384:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444518.468361:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c338a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557840384:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 158us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444518.468369:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:2.0:1783444518.487957:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444518.488126:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557840512 00000100:00100000:3.0:1783444518.488136:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557840512 00000100:00100000:3.0:1783444518.488195:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:3.0:1783444518.488205:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557840512:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444518.488223:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444518.488242:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368c513a800/0x42cb6883e3833752 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e00 expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.488271:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368c513a800/0x42cb6883e3833752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e00 expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.488284:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368c513a800/0x42cb6883e3833752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e00 expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444518.488295:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a800, rc 0) 00000100:00100000:3.0:1783444518.489110:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557840512:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 893us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444518.489120:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1783444518.505715:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444518.505820:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557840640 00000100:00100000:0.0:1783444518.505831:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557840640 00000100:00100000:0.0:1783444518.505971:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1783444518.505980:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c338b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557840640:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.506247:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c338b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557840640:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 267us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.506255:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1783444518.511684:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444518.512614:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557840768 00000100:00100000:0.0:1783444518.512628:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557840768 00000100:00100000:0.0:1783444518.512694:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1783444518.512705:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557840768:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444518.512914:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557840768:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 210us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444518.512923:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1783444518.551510:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444518.551617:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557840896 00000100:00100000:1.0:1783444518.551628:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557840896 00000100:00100000:1.0:1783444518.551682:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1783444518.551691:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557840896:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444518.551709:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444518.551729:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e07 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.551780:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 10 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.551810:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 10 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444518.551820:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27c00, rc 0) 00000100:00100000:1.0:1783444518.551895:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557840896:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 204us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444518.551903:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1783444518.557522:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444518.557692:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557841024 00000100:00100000:3.0:1783444518.557704:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557841024 00000100:00100000:3.0:1783444518.557763:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1783444518.557774:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557841024:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444518.557915:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557841024:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 142us (402us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444518.557933:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00010000:00010000:0.0:1783444518.942361:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444519.964995:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444520.988942:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783444521.195702:0:94638:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783444521.757109:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575418112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444521.757207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444521.757373:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575418112 00000100:00100000:0.0:1783444521.757382:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575418112 00000100:00100000:0.0:1783444521.757437:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1783444521.757445:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575418112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444521.757479:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444521.757524:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575418112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444521.757532:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00100000:1.0:1783444521.757694:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575418112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444521.758016:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444521.758028:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575418240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444521.758070:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444521.758224:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575418240 00000100:00100000:0.0:1783444521.758231:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575418240 00000100:00100000:0.0:1783444521.758278:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:0.0:1783444521.758286:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575418240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444521.758322:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444521.758371:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575418240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444521.758378:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00080000:1.0:1783444521.758644:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444521.758680:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575418240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444521.763308:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444521.763334:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575418368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444521.763424:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444521.763625:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575418368 00000100:00100000:0.0:1783444521.763634:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575418368 00000100:00100000:0.0:1783444521.763714:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:0.0:1783444521.763724:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575418368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444521.763753:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444521.763829:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575418368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444521.763837:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00080000:3.0:1783444521.767946:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444521.768028:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575418368:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444522.023540:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444522.066771:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444522.066830:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444522.066860:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557841152 00000100:00100000:3.0:1783444522.066869:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557841152 00000100:00100000:3.0:1783444522.066920:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:3.0:1783444522.066931:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557841152:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444522.067007:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557841152:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444522.067014:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:3.0:1783444522.067072:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557841280 00000100:00100000:3.0:1783444522.067075:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557841280 00000100:00100000:3.0:1783444522.067111:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1136 00000100:00100000:3.0:1783444522.067118:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557841280:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444522.067150:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557841280:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444522.067157:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1136 00000100:00080000:3.0:1783444522.067279:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444522.273990:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444522.273997:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444522.274001:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444522.274009:0:15368:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3507 00000100:00080000:0.0:1783444522.274014:0:15368:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444522.274022:0:15368:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9367c17ce000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444522.274055:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367ccd31f80 x1870073575418624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444522.274081:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444522.274085:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444522.274086:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444522.274090:0:15368:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3507 00000100:00080000:0.0:1783444522.274099:0:15368:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444522.274103:0:15368:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9367c2faf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444522.274115:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367ccd32300 x1870073575418880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444522.274140:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444522.274144:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444522.274146:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444522.274150:0:15368:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3507 00000100:00080000:0.0:1783444522.274152:0:15368:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444522.274156:0:15368:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9368f8ca7800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444522.274168:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367ccd30380 x1870073575419136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444522.274189:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444522.274191:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444522.274193:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444522.274196:0:15368:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3507 00000100:00080000:0.0:1783444522.274199:0:15368:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1783444522.274202:0:15368:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9368dd118000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444522.274213:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367ccd31880 x1870073575419520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444522.274238:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783444522.274241:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783444522.274243:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9367cae88800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444522.274247:0:15368:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9367cae88800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444522.274265:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c4369f80 x1870073575420032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444522.274297:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575418496:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.274375:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274414:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575419392:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.274441:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274468:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783444522.274474:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575418752:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.274497:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274516:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575419648:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.274537:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274571:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575418624:0@lo:38:kworker.0 00000100:00100000:0.0:1783444522.274595:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274612:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575418880:0@lo:38:kworker.0 00000100:00100000:0.0:1783444522.274631:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274646:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575419136:0@lo:38:kworker.0 00000100:00100000:0.0:1783444522.274666:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274682:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575419520:0@lo:38:kworker.0 00000100:00100000:0.0:1783444522.274701:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274715:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575420032:0@lo:38:kworker.0 00000100:00100000:0.0:1783444522.274737:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274764:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575419008:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.274807:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274825:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575419776:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.274856:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274874:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783444522.274881:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575419264:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.274901:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274918:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575419904:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.274937:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.274970:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575418496 00000100:00100000:0.0:1783444522.274978:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575418496 00000100:00100000:0.0:1783444522.275019:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783444522.275038:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575418496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.275090:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575418496:12345-0@lo:400:kworker.0 Request processed in 62us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.275097:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783444522.275132:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575419392 00000100:00100000:0.0:1783444522.275136:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575419392 00000100:00100000:0.0:1783444522.275160:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575419776 00000100:00100000:0.0:1783444522.275164:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575419776 00000100:00100000:0.0:1783444522.275191:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575419264 00000100:00100000:0.0:1783444522.275194:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575419264 00000100:00100000:0.0:1783444522.275210:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575419904 00000100:00100000:0.0:1783444522.275212:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575419904 00000100:00100000:0.0:1783444522.275230:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:0.0:1783444522.275237:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575419392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.275271:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575419392:12345-0@lo:400:kworker.0 Request processed in 35us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.275277:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:0.0:1783444522.275289:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:0.0:1783444522.275295:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575419776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.275336:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575419776:12345-0@lo:400:kworker.0 Request processed in 40us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.275342:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:0.0:1783444522.275354:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:0.0:1783444522.275360:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575419264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.275388:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575419264:12345-0@lo:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.275393:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:0.0:1783444522.275404:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:0.0:1783444522.275410:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575419904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.275435:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575419904:12345-0@lo:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.275440:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:0.0:1783444522.275463:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575418752 00000100:00100000:0.0:1783444522.275467:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575418752 00000100:00100000:0.0:1783444522.275484:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575418624 00000100:00100000:0.0:1783444522.275488:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575418624 00000100:00100000:0.0:1783444522.275495:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575418880 00000100:00100000:0.0:1783444522.275498:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575418880 00000100:00100000:0.0:1783444522.275504:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575419520 00000100:00100000:0.0:1783444522.275506:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575419520 00000100:00100000:0.0:1783444522.275512:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575420032 00000100:00100000:0.0:1783444522.275514:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575420032 00000100:00100000:0.0:1783444522.275521:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575419008 00000100:00100000:0.0:1783444522.275524:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575419008 00000100:00100000:0.0:1783444522.275537:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1783444522.275543:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575418752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.275570:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575418752:12345-0@lo:400:kworker.0 Request processed in 27us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.275582:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1783444522.275595:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1783444522.275601:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575419008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.275632:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575419008:12345-0@lo:400:kworker.0 Request processed in 31us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.275637:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1783444522.275649:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1783444522.275653:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575418624:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444522.275677:0:80475:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3513 last 0 00000020:00000080:0.0:1783444522.275709:0:80475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42cb6883e3833760 00000004:00100000:0.0:1783444522.275723:0:80475:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444522.275861:0:80475:0:(import.c:65:import_set_state_nolock()) ffff9368ff649000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444522.275901:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1870073575418624:12345-0@lo:38:kworker.0 Request processed in 245us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.275907:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1783444522.275920:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1783444522.275924:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575418880:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444522.275938:0:80475:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3513 last 0 00000020:00000080:0.0:1783444522.275959:0:80475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42cb6883e3833767 00000004:00100000:0.0:1783444522.275966:0:80475:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444522.275983:0:80475:0:(import.c:65:import_set_state_nolock()) ffff9368ff64f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444522.276012:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3632:x1870073575418880:12345-0@lo:38:kworker.0 Request processed in 86us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.276017:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1783444522.276051:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1783444522.276055:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575419520:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444522.276069:0:80475:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3513 last 0 00000020:00000080:0.0:1783444522.276089:0:80475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x42cb6883e383376e 00000004:00100000:0.0:1783444522.276095:0:80475:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444522.276109:0:80475:0:(import.c:65:import_set_state_nolock()) ffff9367c32ce000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444522.276136:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3632:x1870073575419520:12345-0@lo:38:kworker.0 Request processed in 79us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.276142:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1783444522.276154:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1783444522.276158:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575420032:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444522.276171:0:80475:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3513 last 0 00000020:00000080:0.0:1783444522.276192:0:80475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42cb6883e3833775 00000004:00100000:0.0:1783444522.276198:0:80475:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444522.276211:0:80475:0:(import.c:65:import_set_state_nolock()) ffff9368c9a11000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444522.276237:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3632:x1870073575420032:12345-0@lo:38:kworker.0 Request processed in 78us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.276241:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1783444522.276265:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575419648 00000100:00100000:0.0:1783444522.276270:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575419648 00000100:00100000:0.0:1783444522.276295:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575419136 00000100:00100000:0.0:1783444522.276298:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575419136 00000100:00100000:0.0:1783444522.276311:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:0.0:1783444522.276316:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575419648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.276347:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575419648:12345-0@lo:400:kworker.0 Request processed in 31us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.276362:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:0.0:1783444522.276375:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:0.0:1783444522.276380:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3632:x1870073575419136:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783444522.276394:0:8430:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9367c5624000, cookie 0x42cb6883e38335c3 00010000:00080000:0.0:1783444522.276398:0:8430:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084299 exp ffff9367c5624000 cur 3513 last 1783444516 00000004:00100000:0.0:1783444522.276407:0:8430:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783444522.276420:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9368c9a10000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783444522.276457:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575419136:12345-0@lo:38:kworker.0 Request processed in 76us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444522.276463:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00080000:0.0:1783444522.276513:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444522.276519:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444522.276521:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783444522.276543:0:94388:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1783444522.276548:0:94388:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 120259084297 00000020:00080000:0.0:1783444522.276552:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444522.276555:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084297, next_transno: 120259084297 00010000:00080000:0.0:1783444522.276559:0:94388:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084297) 00000020:00080000:0.0:1783444522.276561:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1783444522.276571:0:94388:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557831424 t120259084297 from 192.168.204.20@tcp req@ffff9367c79abb80 x1870073557831424/t0(120259084297) o36->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:137/0 lens 528/0 e 0 to 0 dl 1783444527 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444522.276748:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575419264:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.276763:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575419904:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.276776:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575419008:0@lo:400:kworker.0 00000100:00100000:0.0:1783444522.276819:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575419776:0@lo:400:kworker.0 00010000:00080000:0.0:1783444522.276862:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367ccd31f80 x1870073575418624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.276873:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000004:00080000:3.0:1783444522.281428:0:94388:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4807us 00000100:00100000:3.0:1783444522.281493:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575418752:0@lo:400:kworker.0 00000100:00100000:3.0:1783444522.281534:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575419648:0@lo:400:kworker.0 00000100:00100000:3.0:1783444522.281546:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575418496:0@lo:400:kworker.0 00000100:00100000:3.0:1783444522.281557:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575419392:0@lo:400:kworker.0 00000100:00080000:0.0:1783444522.291557:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9367ccd31f80 x1870073575418624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444547 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.291573:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444522.291580:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444522.291585:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444522.291591:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575418624:0@lo:38:kworker.0 00010000:00080000:0.0:1783444522.291626:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367ccd32300 x1870073575418880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.291643:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:0.0:1783444522.292448:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9367ccd32300 x1870073575418880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444547 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.292458:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444522.292461:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c2faf000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444522.292465:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444522.292470:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3632:1870073575418880:0@lo:38:kworker.0 00000100:00080000:0.0:1783444522.292495:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:0.0:1783444522.292505:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1783444522.292510:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783444522.292513:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:0.0:1783444522.292532:0:3632:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9367c68f0000 x1870073575395712/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783444500 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.292540:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368f8ca7800 from lustre-MDT0000_UUID committed 120259084296 last 0 00000100:00080000:0.0:1783444522.292547:0:3632:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff9367c68f0000 x1870073575395712/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783444500 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444522.292559:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575419136:0@lo:38:kworker.0 00010000:00080000:0.0:1783444522.292575:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367ccd31880 x1870073575419520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.292585:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00000100:00080000:0.0:1783444522.293397:0:3632:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9367ccd31880 x1870073575419520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444547 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.293406:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1783444522.293410:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368dd118000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1783444522.293413:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1783444522.293416:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3632:1870073575419520:0@lo:38:kworker.0 00010000:00080000:0.0:1783444522.293436:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c4369f80 x1870073575420032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.293446:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:0.0:1783444522.293452:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783444522.293456:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783444522.293458:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367cae88800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783444522.293462:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3632:1870073575420032:0@lo:38:kworker.0 00000100:00100000:0.0:1783444522.293504:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575395712:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783444522.293578:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444522.293728:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575395712 00000100:00100000:2.0:1783444522.293737:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575395712 00000100:00100000:2.0:1783444522.293800:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:2.0:1783444522.293809:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575395712:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:2.0:1783444522.293830:0:8430:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084299, replaying 00000100:00100000:2.0:1783444522.293837:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3632:x1870073575395712:12345-0@lo:1000:osp_up0-1.0 Request processed in 31us (260us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444522.293844:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00010000:00010000:3.0:1783444522.309738:0:94388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.309758:0:94388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.309772:0:94388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.309783:0:94388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.309814:0:94388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.309821:0:94388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312130:0:94388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312148:0:94388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312155:0:94388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312174:0:94388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444522.312178:0:94388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312185:0:94388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312203:0:94388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3254900) 00010000:00010000:3.0:1783444522.312205:0:94388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444522.312210:0:94388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312215:0:94388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e383377c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444522.312234:0:94388:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031ec1645 reply state 000000000c0597b4 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312245:0:94388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.312251:0:94388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c3254400) 00010000:00010000:3.0:1783444522.312254:0:94388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444522.312257:0:94388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783444522.314937:0:94388:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444522.314968:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.314972:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084298 00000020:00080000:3.0:1783444522.314977:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.314979:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084298 00000100:00100000:0.0:1783444522.321560:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444522.321599:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557831936 00000100:00100000:0.0:1783444522.321608:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557831936 00000100:00100000:0.0:1783444522.321662:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1441 00000100:00100000:0.0:1783444522.321670:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2400:x1870073557831936:12345-192.168.204.20@tcp:36:rm.0 00010000:00080000:0.0:1783444522.321689:0:80475:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084298, current: 120259084298, replaying 00000100:00100000:0.0:1783444522.321705:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2400:x1870073557831936:12345-192.168.204.20@tcp:36:rm.0 Request processed in 37us (155us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444522.321711:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1441 00000020:00080000:3.0:1783444522.322266:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.322297:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 120259084298, next_transno: 120259084298 00010000:00080000:3.0:1783444522.322302:0:94388:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084298) 00000020:00080000:3.0:1783444522.322306:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.322316:0:94388:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557831936 t120259084298 from 192.168.204.20@tcp req@ffff9367c4369880 x1870073557831936/t0(120259084298) o36->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:143/0 lens 512/0 e 0 to 0 dl 1783444533 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783444522.322409:0:94388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322426:0:94388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322437:0:94388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322448:0:94388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322454:0:94388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322460:0:94388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322546:0:94388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322554:0:94388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322561:0:94388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322819:0:94388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322827:0:94388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322834:0:94388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322840:0:94388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444522.322844:0:94388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322851:0:94388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322864:0:94388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff9368c3254700) 00010000:00010000:3.0:1783444522.322868:0:94388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783444522.322872:0:94388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322877:0:94388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750e00/0x42cb6883e3833798 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322897:0:94388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322903:0:94388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322909:0:94388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322921:0:94388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444522.322925:0:94388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322931:0:94388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.322939:0:94388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3254e00) 00010000:00010000:3.0:1783444522.322941:0:94388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444522.322944:0:94388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783444522.323819:0:94354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084297 is committed 00010000:00010000:0.0:1783444522.323920:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.323931:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.323938:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.323943:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444522.323948:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.323954:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.323969:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c3254400) 00010000:00010000:0.0:1783444522.323972:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444522.323975:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.323990:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e3833783 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.324083:0:94388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751a00/0x42cb6883e383378a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444522.324101:0:94388:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff10c24f reply state 00000000a6fa186d transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.324116:0:94388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.324122:0:94388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368c3254400) 00010000:00010000:3.0:1783444522.324125:0:94388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444522.324128:0:94388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1783444522.324223:0:94388:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444522.324243:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.324247:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084299 00010000:00080000:3.0:1783444522.324250:0:94388:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084299) 00000020:00080000:3.0:1783444522.324253:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.324263:0:94388:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073575395712 t120259084299 from 0@lo req@ffff9367c4369f80 x1870073575395712/t0(120259084299) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:143/0 lens 488/0 e 0 to 0 dl 1783444533 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783444522.324496:0:94388:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444522.324508:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.324510:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000020:00080000:3.0:1783444522.324513:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.324515:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000100:00080000:0.0:1783444522.324561:0:3632:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff9367c68f0000 x1870073575395712/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783444538 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.324570:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783444522.324573:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:0.0:1783444522.324577:0:3632:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9367c68f0000 x1870073575395712/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783444538 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.324583:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368f8ca7800 from lustre-MDT0000_UUID committed 120259084296 last 120259084299 00000100:00080000:0.0:1783444522.324590:0:3632:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff9367c32f5880 x1870073575396224/t120259084300(120259084300) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783444501 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444522.324602:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575395712:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783444522.324621:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575396224:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1783444522.324655:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444522.324736:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575396224 00000100:00100000:1.0:1783444522.324743:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575396224 00000100:00100000:1.0:1783444522.324818:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:1.0:1783444522.324828:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3632:x1870073575396224:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1783444522.324840:0:23687:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 120259084300, current: 120259084300, replaying 00000100:00100000:1.0:1783444522.324862:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3632:x1870073575396224:12345-0@lo:1000:osp_up0-1.0 Request processed in 36us (206us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444522.324870:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000020:00080000:3.0:1783444522.328183:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.328195:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084300, next_transno: 120259084300 00010000:00080000:3.0:1783444522.328201:0:94388:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (120259084300) 00000020:00080000:3.0:1783444522.328205:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.328217:0:94388:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073575396224 t120259084300 from 0@lo req@ffff9367c436bb80 x1870073575396224/t0(120259084300) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:143/0 lens 488/0 e 0 to 0 dl 1783444533 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783444522.328439:0:94388:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1783444522.328462:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.328465:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000020:00080000:3.0:1783444522.328467:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.328469:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000100:00080000:0.0:1783444522.328490:0:3632:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff9367c32f5880 x1870073575396224/t120259084300(120259084300) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783444538 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.328501:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1783444522.328504:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:0.0:1783444522.328509:0:3632:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9367c68f0000 x1870073575395712/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1783444538 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444522.328516:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368f8ca7800 from lustre-MDT0000_UUID committed 120259084296 last 120259084300 00000100:00080000:0.0:1783444522.328521:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1783444522.336509:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444522.336552:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557841408 00000100:00100000:2.0:1783444522.336563:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557841408 00000100:00100000:2.0:1783444522.336624:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1139 00000100:00100000:2.0:1783444522.336635:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2400:x1870073557841408:12345-192.168.204.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1783444522.336665:0:71469:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9367c4ac9f80 x1870073557841408/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:143/0 lens 224/0 e 0 to 0 dl 1783444533 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444522.336691:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2400:x1870073557841408:12345-192.168.204.20@tcp:400:ldlm_lock_repla.0 Request processed in 58us (191us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444522.336698:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1139 00000020:00080000:3.0:1783444522.336828:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1783444522.336833:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000100:00100000:1.0:1783444522.342514:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575396224:0@lo:1000:osp_up0-1.0 00010000:00080000:2.0:1783444522.345006:0:94685:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1783444522.345015:0:94685:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1783444522.345038:0:94685:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:2.0:1783444522.346251:0:94685:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e3832ec3 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1783444522.346286:0:94685:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:1.0:1783444522.346844:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575420160:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1783444522.346915:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444522.346975:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575420160 00000100:00100000:1.0:1783444522.346982:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575420160 00000100:00100000:1.0:1783444522.347115:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:1.0:1783444522.347125:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3632:x1870073575420160:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:1.0:1783444522.347151:0:8430:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9367c79aa300 x1870073575420160/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:143/0 lens 328/0 e 0 to 0 dl 1783444533 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444522.347167:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3632:x1870073575420160:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 45us (253us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444522.347174:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000020:00080000:1.0:1783444522.347194:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444522.347198:0:94388:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:1.0:1783444522.347200:0:94388:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1783444522.347203:0:94388:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1783444522.347208:0:94388:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1783444522.347210:0:94388:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1783444522.347214:0:94388:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff9367c79aa300 x1870073575420160/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:143/0 lens 328/0 e 0 to 0 dl 1783444533 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1783444522.347232:0:94388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444522.347260:0:94388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e383379f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42cb6883e3832ebc expref: -99 pid: 94388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.347297:0:94388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e383379f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3832ebc expref: 9 pid: 94388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.347312:0:94388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26c00/0x42cb6883e383379f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3832ebc expref: 9 pid: 94388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.347321:0:94388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26c00, rc 0) 00010000:00080000:1.0:1783444522.347376:0:94388:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1783444522.347390:0:94388:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:1.0:1783444522.347424:0:3632:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9368e6f04600/0x42cb6883e3832ebc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x42cb6883e383379f expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783444522.347433:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1783444522.347453:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575420160:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1783444522.347471:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575420288:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1783444522.347494:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444522.347521:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575420288 00000100:00100000:1.0:1783444522.347524:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575420288 00000100:00100000:1.0:1783444522.347549:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1783444522.347556:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3632:x1870073575420288:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1783444522.347567:0:23687:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9367c79a9880 x1870073575420288/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:143/0 lens 224/0 e 0 to 0 dl 1783444533 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444522.347579:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3632:x1870073575420288:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 25us (85us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444522.347584:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00010000:00080000:1.0:1783444522.347605:0:94388:0:(ldlm_lib.c:2272:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1783444522.347710:0:94388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:2.0:1783444522.349697:0:94354:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783444522.349707:0:94354:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000001:00080000:2.0:1783444522.349715:0:94354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000001:00080000:2.0:1783444522.349740:0:94354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00010000:00010000:3.0:1783444522.349843:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.349857:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.349865:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.349880:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444522.349884:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.349892:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.349910:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.349916:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750a00/0x42cb6883e3833791 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94388 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444522.350068:0:94388:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1783444522.350113:0:94388:0:(ldlm_lib.c:1983:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1783444522.350130:0:94388:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 192.168.204.20@tcp: req@ffff9367c4ac9f80 x1870073557841408/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:143/0 lens 224/0 e 0 to 0 dl 1783444533 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1783444522.352527:0:94388:0:(ldlm_lib.c:2927:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9367c79a9880 x1870073575420288/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:143/0 lens 224/0 e 0 to 0 dl 1783444533 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444522.352635:0:94388:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:06, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:1.0:1783444522.359315:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084300 gen 3 00000004:00080000:1.0:1783444522.359328:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084299 committed transno 120259084300 00000004:00080000:1.0:1783444522.359353:0:3632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084300 committed transno 120259084300 00000100:00080000:1.0:1783444522.359371:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1783444522.359385:0:3632:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9367c79a8a80 x1870073575420288/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444538 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444522.359395:0:3632:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9367c79a8a80 x1870073575420288/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444538 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444522.359403:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca7800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1783444522.359427:0:3632:0:(import.c:1742:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1783444522.359434:0:3632:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e4e5ee80): req@ffff9367c56f5f80 x1870073575397888/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444505 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444522.359459:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575420288:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1783444522.359568:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444522.359615:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575397888 00000100:00100000:1.0:1783444522.359621:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575397888 00000100:00100000:1.0:1783444522.359667:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1783444522.359676:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575397888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444522.359711:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:1.0:1783444522.359757:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575397888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444522.359764:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1783444522.359830:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575397888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444522.359979:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575420416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444522.360019:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444522.360095:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575420416 00000100:00100000:2.0:1783444522.360100:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575420416 00000100:00100000:2.0:1783444522.360134:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:2.0:1783444522.360140:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575420416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444522.360152:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:2.0:1783444522.360183:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575420416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444522.360188:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:1.0:1783444522.360245:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575420416:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1783444522.403479:0:94692:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444522.403981:0:94692:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000004:00000080:2.0:1783444522.439856:0:94388:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac1c486cfe10 00100000:10000000:2.0:1783444522.439872:0:94388:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1783444522.441505:0:94375:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:0.0:1783444522.441575:0:94375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94375:1870073575420544:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783444522.441656:0:94375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444522.441701:0:94375:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444522.441836:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575420544 00000100:00100000:2.0:1783444522.441846:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575420544 00000100:00100000:2.0:1783444522.441903:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:2.0:1783444522.441912:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:94375:x1870073575420544:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1783444522.441940:0:8420:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 897 -> diff = -94 00002000:02000040:2.0:1783444522.441945:0:8420:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:897) 00000004:00080000:3.0:1783444522.443134:0:94373:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:3.0:1783444522.443172:0:94373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94373:1870073575420672:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783444522.443228:0:94373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444522.443266:0:94373:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444522.443281:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575420672 00000100:00100000:0.0:1783444522.443288:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575420672 00000100:00100000:0.0:1783444522.443332:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:0.0:1783444522.443341:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:94373:x1870073575420672:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783444522.443380:0:26200:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 897 -> diff = -95 00002000:02000040:0.0:1783444522.443385:0:26200:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:897) 00002000:00010000:2.0:1783444522.465194:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444522.465209:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465237:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x381:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:2.0:1783444522.465242:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444522.465249:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465269:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465280:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465289:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465322:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783444522.465607:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444522.465614:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465622:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x380:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:2.0:1783444522.465626:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x380:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444522.465630:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465640:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465659:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465667:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465681:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783444522.465691:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444522.465696:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465704:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444522.465708:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465718:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465736:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465743:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfda51d5/0x42cb6883e38337a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465848:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444522.465859:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465866:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444522.465870:0:10324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465878:0:10324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465890:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465898:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e408eeb/0x42cb6883e38337ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.465909:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444522.465911:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444522.465913:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.466187:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783444522.467254:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444522.467282:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.467298:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37f:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:2.0:1783444522.467302:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444522.467307:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444522.467308:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783444522.467321:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467339:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x381:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:0.0:1783444522.467344:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444522.467348:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467350:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.467374:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467378:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.467393:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467396:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467414:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467448:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444522.467470:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444522.467477:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.467485:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444522.467490:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.467498:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.467513:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444522.467518:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444522.467522:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014294f49/0x42cb6883e38337bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.467564:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444522.467566:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444522.467567:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444522.467709:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444522.467719:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444522.467723:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.467730:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444522.467751:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467752:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467766:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x380:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:0.0:1783444522.467769:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x380:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444522.467773:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467783:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467859:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467868:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.467879:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444522.472377:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.472388:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472407:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37f:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.472411:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.472417:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472430:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472438:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472445:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472475:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444522.472536:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.472541:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472564:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37e:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.472567:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.472571:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472580:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472588:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472595:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472612:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1783444522.472655:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.472660:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472667:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37d:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.472670:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.472674:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472681:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472700:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472707:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.472716:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1783444522.472754:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783444522.472975:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.472995:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473002:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acd64dbb/0x42cb6883e38337b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473023:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783444522.473038:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473046:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444522.473057:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473065:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473077:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473085:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be9ebbf0/0x42cb6883e38337c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473097:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444522.473101:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473107:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444522.473111:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473118:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473128:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473134:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea92185f/0x42cb6883e38337c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473155:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444522.473158:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473165:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444522.473168:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473176:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473185:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473192:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000252803c8/0x42cb6883e38337d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473204:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444522.473207:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473213:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444522.473216:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473235:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473246:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473253:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ac569d0/0x42cb6883e38337d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444522.473265:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444522.473267:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444522.473268:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783444522.473314:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783444522.473347:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.473522:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473533:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37c:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.473537:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.473541:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473551:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473559:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473566:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473590:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444522.473639:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.473645:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473653:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37b:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.473656:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.473660:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473668:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473676:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473683:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473696:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444522.473728:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.473733:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.473740:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37a:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.473748:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.473752:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474363:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444522.474372:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474381:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444522.474393:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474401:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474415:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474422:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdcabcdd/0x42cb6883e38337de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474439:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444522.474442:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474449:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444522.474452:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474459:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474468:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474474:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dc87b39/0x42cb6883e38337e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.474493:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444522.474495:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444522.474496:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.474650:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.474952:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.474959:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.475121:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.475128:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475139:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37e:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.475142:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.475147:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475157:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475166:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475173:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475186:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444522.475223:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.475228:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475235:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37d:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.475238:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.475242:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475262:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475270:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475276:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475290:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444522.475297:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444522.475302:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475308:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.475312:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475319:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475331:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475338:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a91f43f/0x42cb6883e38337f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475357:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.475361:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475368:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.475371:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475379:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475388:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475395:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b715454e/0x42cb6883e38337fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475405:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.475407:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.475409:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.475453:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.475458:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475466:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37c:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.475474:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.475478:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475486:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475493:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475500:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475512:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.475519:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.475522:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475528:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.475531:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475538:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475546:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475562:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043086d7a/0x42cb6883e3833801 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475575:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.475576:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.475578:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.475612:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.475618:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475625:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37b:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.475628:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.475631:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475639:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475647:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475654:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475666:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.475672:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.475680:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475687:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.475690:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475698:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475709:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475714:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff58a05/0x42cb6883e3833808 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.475726:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.475728:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.475729:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.476875:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.476885:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.476906:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.476919:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.476923:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.476930:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.476933:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.476940:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.476954:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.476973:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037dd4888/0x42cb6883e38337ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.476993:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.476995:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.476996:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.477087:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.477093:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477102:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x379:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.477105:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x379:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.477110:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477120:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477128:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477134:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477147:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.477159:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.477163:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477169:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.477172:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477180:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477190:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477197:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4abcfb5/0x42cb6883e383380f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477211:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.477212:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.477214:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.477252:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.477257:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477264:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x378:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.477266:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x378:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.477270:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477289:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477297:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477304:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477317:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.477324:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.477328:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477334:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.477338:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477346:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477356:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477363:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003206e881/0x42cb6883e3833816 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477381:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.477382:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.477384:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.477418:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.477423:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477430:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x377:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.477433:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.477437:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477445:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477452:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477458:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477469:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.477473:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.477476:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477493:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.477496:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477503:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477513:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477519:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c9dd32a/0x42cb6883e383381d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477532:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.477533:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.477535:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.477567:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.477572:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477579:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x376:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.477582:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x376:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.477586:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477594:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477607:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477614:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477625:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.477630:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.477633:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477639:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.477642:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477649:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477658:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477665:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ab9f38b/0x42cb6883e3833824 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477676:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.477682:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.477684:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.477719:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.477724:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477731:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x375:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.477733:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x375:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.477737:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477745:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477752:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.477757:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444522.477997:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.478002:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478010:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37a:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.478013:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.478017:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478050:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478057:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478064:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478077:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.478084:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.478087:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478093:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.478096:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478103:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478113:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478119:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7cd07cf/0x42cb6883e3833832 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478139:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.478141:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.478142:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.478191:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.478196:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478203:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x379:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.478206:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x379:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.478209:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478217:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478224:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478230:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478241:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.478247:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.478250:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478266:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.478269:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478276:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478286:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478291:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c6817e2/0x42cb6883e3833839 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478304:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.478305:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.478307:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.478345:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.478350:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478356:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x378:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.478359:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x378:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.478363:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478370:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478383:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478390:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478402:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.478408:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.478411:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478416:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.478419:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478433:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478443:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478450:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e2557c7/0x42cb6883e3833840 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478463:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.478469:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.478471:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.478511:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.478515:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478522:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x377:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.478524:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.478528:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478537:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478545:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478552:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478563:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.478568:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.478572:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478577:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.478580:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478596:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478607:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478613:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001503a445/0x42cb6883e3833847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478626:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.478627:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.478629:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.478670:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.478675:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478682:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x376:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.478685:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x376:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.478689:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478697:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478704:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478717:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478728:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.478735:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.478738:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478744:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.478748:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.478756:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444522.482857:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.484125:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444522.484258:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.484266:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484279:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x374:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.484285:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x374:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.484291:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484312:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484322:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484330:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484346:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783444522.484357:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444522.484362:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484368:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.484372:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484381:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484396:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484401:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b9335c7/0x42cb6883e383382b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484428:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.484432:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484437:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.484440:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484448:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484458:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484464:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f028fb/0x42cb6883e3833855 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484473:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.484475:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.484477:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.484520:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.484525:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484532:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x373:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.484541:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x373:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.484545:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484553:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484560:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484566:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484576:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.484583:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.484586:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484591:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.484594:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484601:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484609:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484626:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018a9e84a/0x42cb6883e383385c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484640:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.484641:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.484643:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.484682:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.484687:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484694:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x372:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.484696:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.484700:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484708:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484715:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484721:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484733:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.484744:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.484748:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484755:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.484758:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484765:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484775:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484783:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd6d8b9b/0x42cb6883e3833863 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484819:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.484821:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.484822:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.484868:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.484873:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484879:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x371:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.484882:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x371:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.484886:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484904:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484912:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484920:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484932:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.484939:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.484942:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484949:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.484952:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484960:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484970:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484977:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006240a133/0x42cb6883e383386a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.484997:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.484998:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.485000:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485100:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485108:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091ec7dea/0x42cb6883e383384e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485131:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485156:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485158:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485160:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.485227:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.485233:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485241:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x375:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.485244:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x375:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.485247:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485256:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485263:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485270:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485288:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444522.485328:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.485333:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485341:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x374:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.485343:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x374:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.485347:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485366:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485374:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485381:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485394:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444522.485402:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444522.485406:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485413:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.485415:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485422:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485431:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485436:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfea002e/0x42cb6883e3833871 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485455:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.485458:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485464:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.485467:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485474:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485485:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485492:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cffa4928/0x42cb6883e3833878 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485502:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485504:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485505:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.485546:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.485551:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485559:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x373:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.485567:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x373:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.485571:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485581:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485588:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485594:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485606:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444522.485642:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.485647:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485654:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x372:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.485656:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.485660:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485667:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485674:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485688:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485699:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444522.485706:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444522.485709:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485716:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.485720:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485727:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485738:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485745:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000179a3220/0x42cb6883e383387f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485756:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.485759:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485775:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.485779:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485823:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485836:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485844:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2d31b97/0x42cb6883e3833886 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485856:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485857:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485859:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.485864:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.485900:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.485905:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485912:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x371:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.485915:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x371:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.485919:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485936:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485944:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485951:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485964:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.485971:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.485974:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485980:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.485983:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.485990:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486000:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486006:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000490bea8e/0x42cb6883e383388d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486038:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486040:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486042:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.486086:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.486091:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486098:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x370:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.486101:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x370:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.486105:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486114:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486121:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486127:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486139:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444522.486178:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.486182:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486199:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36f:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.486201:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.486205:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486213:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486220:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486228:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486240:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444522.486246:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444522.486250:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486257:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.486260:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486266:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486288:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486295:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1e55d1b/0x42cb6883e3833894 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486308:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.486311:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486317:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.486320:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486327:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486336:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486343:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084611bc6/0x42cb6883e383389b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486354:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486356:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486364:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486369:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.486411:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.486415:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486423:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36e:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.486426:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.486430:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486439:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486447:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486454:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486466:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.486472:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.486476:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486481:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.486484:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486500:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486510:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486516:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015a8e001/0x42cb6883e38338a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486528:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486529:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486531:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.486570:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.486575:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486582:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36d:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.486585:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.486589:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486598:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486605:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486616:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486626:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444522.486661:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.486666:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486674:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36c:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.486676:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.486680:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486689:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486696:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486705:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486714:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444522.486720:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444522.486723:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486734:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513bc00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.486737:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486744:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486753:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486760:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a85de9de/0x42cb6883e38338a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486772:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.486774:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486780:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71c00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.486783:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486810:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486819:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486832:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d05817/0x42cb6883e38338b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486845:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486847:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486849:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.486853:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.486894:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.486899:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486907:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36b:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.486910:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.486914:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486923:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486930:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486937:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486948:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.486960:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.486964:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486971:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.486974:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486981:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486992:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.486999:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a94d70d/0x42cb6883e38338b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.487011:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.487013:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.487014:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.489918:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.489992:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.490003:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490019:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x370:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.490023:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x370:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.490039:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490051:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490060:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490068:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490094:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783444522.490159:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.490164:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490194:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36f:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.490197:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.490202:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490211:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490219:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490225:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490244:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1783444522.490287:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.490293:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490301:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36e:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.490304:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.490308:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490317:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490335:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490342:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490372:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783444522.490380:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444522.490385:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490393:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.490397:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490406:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490423:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490430:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af35849c/0x42cb6883e38338be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490449:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444522.490458:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490465:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.490468:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490475:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490486:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490492:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac6fd5e/0x42cb6883e38338c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490503:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.490506:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490513:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.490516:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490523:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490544:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490551:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8c13928/0x42cb6883e38338cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490563:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.490564:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.490566:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.490605:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.490609:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490617:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36d:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.490620:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.490624:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490632:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490639:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490646:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490670:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.490677:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.490681:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490687:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.490689:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490696:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490706:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490712:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e38338d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490724:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.490725:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.490727:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.490768:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.490773:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490780:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36c:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.490815:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.490820:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490829:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490837:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490844:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490860:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.490866:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.490869:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490875:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.490878:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490884:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490893:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490910:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e38338da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490922:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.490924:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.490925:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.490965:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.490969:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490977:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36b:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.490980:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.490983:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490991:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.490997:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491003:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491015:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.491038:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.491042:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491048:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.491051:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491058:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491069:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491076:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e2c6f7/0x42cb6883e38338e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491088:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491089:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491091:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.491129:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.491134:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491141:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36a:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.491144:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.491148:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491166:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491174:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491181:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491194:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.491201:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.491204:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491210:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.491213:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491221:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491231:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491237:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11d5483/0x42cb6883e38338e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491256:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491258:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491259:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.491297:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.491303:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491310:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x369:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.491313:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.491318:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491326:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491333:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491340:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491351:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.491356:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.491360:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491375:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.491378:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491385:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491394:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491402:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004caf8d10/0x42cb6883e38338ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491413:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491414:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491416:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.491453:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.491458:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491466:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x368:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.491469:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x368:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.491472:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491481:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491495:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491502:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491514:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.491520:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.491524:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491531:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fc00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.491534:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491542:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491552:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491560:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f2a7bae/0x42cb6883e38338f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491575:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491582:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491584:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.491625:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.491630:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491637:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x367:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.491640:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.491644:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491651:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491659:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491665:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491676:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.491681:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.491685:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491691:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.491694:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491712:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491722:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491730:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004531d09a/0x42cb6883e38338fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491744:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491746:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491747:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.491810:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.491815:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491823:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x366:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.491826:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x366:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.491830:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491838:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491845:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491858:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491871:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.491878:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.491881:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491887:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.491890:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491897:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491907:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491915:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067dc726b/0x42cb6883e3833904 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491928:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491930:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.491931:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.491971:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.491982:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.491989:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x365:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.491992:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x365:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.491995:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492003:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492010:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492016:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492038:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.492045:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.492048:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492054:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.492057:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492064:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492081:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492087:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057621104/0x42cb6883e383390b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492100:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.492102:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.492103:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.492148:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.492152:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492159:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x364:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.492163:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.492166:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492175:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492183:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492191:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492214:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.492221:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.492225:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492230:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583ec00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.492233:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492241:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492252:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492259:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c9731e6/0x42cb6883e3833912 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492272:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.492274:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.492276:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.492318:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.492323:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492330:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x363:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.492338:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x363:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.492342:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492351:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492359:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492367:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492378:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.492385:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.492388:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492394:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.492397:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492405:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492415:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492432:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f6c1e0c/0x42cb6883e3833919 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492446:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.492448:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.492449:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783444522.492491:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783444522.492496:0:26200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492503:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x362:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:1.0:1783444522.492506:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444522.492510:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492517:0:26200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492524:0:26200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492530:0:26200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492542:0:26200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783444522.492554:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444522.492558:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492563:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fe00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444522.492566:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492572:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492581:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492588:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009787485d/0x42cb6883e3833920 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444522.492600:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.492601:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.492603:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.497138:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.497170:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.497292:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.497302:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497319:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36a:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.497323:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.497340:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497353:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497363:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497370:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497396:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444522.497444:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.497449:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497456:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x369:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.497459:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.497463:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497472:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497479:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497497:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497510:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444522.497518:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444522.497523:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497531:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.497535:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497544:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497562:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497569:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000799db743/0x42cb6883e3833927 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497589:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.497593:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497609:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71200 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.497612:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497619:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497628:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497634:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000324b74e1/0x42cb6883e383392e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497645:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.497646:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.497648:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.497688:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.497694:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497701:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x368:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.497704:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x368:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.497708:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497717:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497731:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497739:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497751:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444522.497808:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.497813:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497821:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x367:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.497823:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.497827:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497836:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497843:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497850:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497871:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444522.497878:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444522.497882:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497889:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.497892:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497900:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497911:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497918:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcd0a1fa/0x42cb6883e3833935 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497931:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.497934:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497940:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70a00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.497943:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497962:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497972:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497978:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000644466a1/0x42cb6883e383393c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.497990:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.497992:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.497993:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.497999:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.498051:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.498057:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498065:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x366:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.498068:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x366:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.498072:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498082:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498090:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498102:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498115:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.498121:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.498125:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498132:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.498135:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498143:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498154:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498162:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0adc3a0/0x42cb6883e3833943 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498173:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.498174:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.498176:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.498211:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.498223:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498231:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x365:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.498234:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x365:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.498238:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498247:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498255:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498262:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498273:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783444522.498308:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.498313:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498319:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x364:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.498322:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.498325:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498334:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498348:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498355:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498366:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783444522.498372:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783444522.498376:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498382:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70400 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.498386:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498394:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498404:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498411:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004366aa5/0x42cb6883e383394a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498423:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.498432:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498438:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.498442:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498449:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498460:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498467:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e3833951 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498479:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.498481:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.498483:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.498488:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.498526:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.498531:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498538:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x363:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.498541:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x363:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.498545:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498564:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498572:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498580:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498591:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444522.498598:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.498601:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498607:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70800 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.498610:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498618:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498628:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498636:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008440e7c4/0x42cb6883e3833958 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498655:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.498656:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.498658:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783444522.498701:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783444522.498706:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498713:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x362:0x0].0x0 since=3513s v=(0 0) 00010000:00010000:3.0:1783444522.498716:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444522.498720:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498727:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498735:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498742:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.498754:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783444522.499200:0:8420:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:3.0:1783444522.499295:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:94375:x1870073575420544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57379us (57635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444522.499305:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:3.0:1783444522.499375:0:94375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94375:1870073575420544:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783444522.499390:0:94375:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x381:0x0] from OST, last_created [0x2c0000401:0x381:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:3.0:1783444522.499460:0:94375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94375:1870073575420928:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783444522.499498:0:94375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444522.499530:0:94375:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d016eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783444522.499548:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575420800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444522.499573:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444522.499605:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575420800 00000100:00100000:3.0:1783444522.499610:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575420800 00000100:00100000:3.0:1783444522.499651:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:3.0:1783444522.499659:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575420800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444522.499679:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444522.499715:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575420800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444522.499721:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:3.0:1783444522.499755:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575420800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783444522.499771:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444522.499776:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.499785:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70e00 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:3.0:1783444522.499809:0:10323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.499818:0:10323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.499842:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.499849:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f07f3915/0x42cb6883e383395f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444522.499865:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.499867:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444522.499869:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444522.499876:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575420928 00000100:00100000:3.0:1783444522.499880:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575420928 00000100:00100000:3.0:1783444522.499906:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:3.0:1783444522.499912:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:94375:x1870073575420928:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783444522.499938:0:8422:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 898 00010000:00010000:2.0:1783444522.500165:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444522.500924:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783444522.500990:0:26200:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00000100:00100000:1.0:1783444522.501074:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:94373:x1870073575420672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 57732us (57843us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444522.501085:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000100:00100000:2.0:1783444522.501127:0:94373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5802300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94373:1870073575420672:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783444522.501143:0:94373:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x381:0x0] from OST, last_created [0x280000401:0x381:0x0]last_used is [0x280000401:0x322:0x0] 00000100:00100000:1.0:1783444522.501242:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575421056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444522.501246:0:94373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94373:1870073575421184:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783444522.501292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444522.501295:0:94373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444522.501321:0:94373:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444522.501350:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575421056 00000100:00100000:1.0:1783444522.501358:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575421056 00000100:00100000:1.0:1783444522.501395:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:1.0:1783444522.501403:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575421056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444522.501418:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444522.501700:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575421056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444522.501706:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575421056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444522.501711:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000001:00100000:2.0:1783444522.502054:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783444522.508086:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575421184 00000100:00100000:2.0:1783444522.508100:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575421184 00000100:00100000:2.0:1783444522.508167:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:2.0:1783444522.508180:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:94373:x1870073575421184:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783444522.508228:0:8420:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 898 00000100:00100000:3.0:1783444522.509405:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:94375:x1870073575420928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9488us (9902us total) trans 4294969460 rc 0/0 00000100:00100000:3.0:1783444522.509415:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00100000:3.0:1783444522.509493:0:94375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94375:1870073575420928:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783444522.509508:0:94375:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x381:0x0]-[0x2c0000401:0x3a1:0x0] 00000100:00100000:2.0:1783444522.512770:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:94373:x1870073575421184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4577us (11458us total) trans 4294969454 rc 0/0 00000100:00100000:2.0:1783444522.512783:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000100:00100000:2.0:1783444522.512874:0:94373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94373:1870073575421184:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783444522.512891:0:94373:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x381:0x0]-[0x280000401:0x3a1:0x0] 00000001:00100000:0.0:1783444522.784059:0:75651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783444523.037224:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783444523.497646:0:94743:0:(tgt_mount.c:2345:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783444523.498026:0:94743:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783444524.064845:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444525.085032:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444525.658219:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444525.658316:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557841536 00000100:00100000:0.0:1783444525.658329:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557841536 00000100:00100000:0.0:1783444525.658406:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1442 00000100:00100000:0.0:1783444525.658417:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+6:72398:x1870073557841536:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444525.658438:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444525.658458:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e0e expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444525.658524:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e383396d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444525.658538:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e383396d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444525.658549:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e383396d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444525.658604:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444525.658608:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444525.658645:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e383396d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444525.658684:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e0e expref: 8 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444525.658704:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e383396d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e0e expref: 7 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444525.658714:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444525.658717:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444525.658721:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645400, rc 0) 00000100:00100000:0.0:1783444525.658834:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+7:72398:x1870073557841536:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 374us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444525.658841:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1442 00000100:00080000:3.0:1783444525.659339:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444525.670431:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444525.673137:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557841664 00000100:00100000:2.0:1783444525.673156:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557841664 00000100:00100000:2.0:1783444525.673374:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1443 00000100:00100000:2.0:1783444525.673386:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:72398:x1870073557841664:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1783444525.673435:0:80475:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:2.0:1783444525.673526:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:72398:x1870073557841664:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 142us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444525.673534:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1443 00000100:00100000:3.0:1783444525.676544:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444525.682674:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557841792 00000100:00100000:0.0:1783444525.682690:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557841792 00000100:00080000:3.0:1783444525.682761:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444525.682778:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1444 00000100:00100000:0.0:1783444525.682808:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+9:72398:x1870073557841792:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:0.0:1783444525.682849:0:66225:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444525.682932:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+9:72398:x1870073557841792:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 143us (6395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444525.682940:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1444 00000100:00100000:1.0:1783444525.696411:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444525.696679:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557841920 00000100:00100000:3.0:1783444525.696689:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557841920 00000100:00100000:3.0:1783444525.696743:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5921 00000100:00100000:3.0:1783444525.696775:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2400:x1870073557841920:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:3.0:1783444525.696836:0:26209:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp 0000000000000000 cur 3516 last 0 00000020:00000080:3.0:1783444525.696867:0:26209:0:(genops.c:1406:class_connect()) connect: client 08efc25c-17e5-4d29-97d2-f1505f195a06, cookie 0x42cb6883e3833974 00002000:00100000:3.0:1783444525.696880:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 08efc25c-17e5-4d29-97d2-f1505f195a06/ffff9368ff57a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783444525.696897:0:26209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783444525.696984:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783444525.697017:0:26209:0:(import.c:65:import_set_state_nolock()) ffff9367c17cf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783444525.697096:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557841920:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 321us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444525.697105:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5921 00000100:00100000:3.0:1783444525.700124:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444525.703305:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557842048 00000100:00100000:0.0:1783444525.703321:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557842048 00000100:00100000:0.0:1783444525.703421:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2008 00000100:00100000:0.0:1783444525.703433:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:72398:x1870073557842048:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1783444525.703478:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444525.703574:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:72398:x1870073557842048:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 143us (3458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444525.703582:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2008 00000100:00080000:3.0:1783444525.703854:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444525.712735:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444525.713251:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557842176 00000100:00100000:1.0:1783444525.713262:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557842176 00000100:00100000:1.0:1783444525.713310:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5922 00000100:00100000:1.0:1783444525.713320:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2400:x1870073557842176:12345-192.168.204.20@tcp:8:lfs.0 00010000:00080000:1.0:1783444525.713357:0:26210:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp t0 exp 0000000000000000 cur 3516 last 0 00000020:00000080:1.0:1783444525.713384:0:26210:0:(genops.c:1406:class_connect()) connect: client 08efc25c-17e5-4d29-97d2-f1505f195a06, cookie 0x42cb6883e383397b 00002000:00100000:1.0:1783444525.713395:0:26210:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 08efc25c-17e5-4d29-97d2-f1505f195a06/ffff9368c518e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783444525.713414:0:26210:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783444525.713474:0:26210:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783444525.713503:0:26210:0:(import.c:65:import_set_state_nolock()) ffff9368c518c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783444525.713566:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557842176:12345-192.168.204.20@tcp:8:lfs.0 Request processed in 246us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444525.713574:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5922 00000100:00100000:2.0:1783444525.722142:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444525.722255:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557842304 00000100:00100000:3.0:1783444525.722265:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557842304 00000100:00100000:3.0:1783444525.722345:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2009 00000100:00100000:3.0:1783444525.722357:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:72398:x1870073557842304:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:3.0:1783444525.722382:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444525.722451:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+6:72398:x1870073557842304:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444525.722459:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2009 00000100:00080000:0.0:1783444525.722648:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783444526.111820:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444526.877273:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444526.877295:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575421312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444526.877364:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444526.877547:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575421312 00000100:00100000:0.0:1783444526.877555:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575421312 00000100:00100000:0.0:1783444526.877620:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:0.0:1783444526.877629:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575421312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444526.877649:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444526.877694:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575421312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444526.877701:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:0.0:1783444526.877747:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575421312:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783444526.877828:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444526.887260:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575421440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444526.887369:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444526.887449:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575421440 00000100:00100000:3.0:1783444526.887457:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575421440 00000100:00100000:3.0:1783444526.887520:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1783444526.887531:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575421440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444526.887555:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444526.887605:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575421440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444526.887612:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00080000:3.0:1783444526.887638:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444526.887680:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575421440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444526.898447:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444526.898483:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575421568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444526.898585:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444526.898659:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575421568 00000100:00100000:1.0:1783444526.898666:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575421568 00000100:00100000:1.0:1783444526.898714:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:1.0:1783444526.898722:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575421568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783444526.898757:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:1.0:1783444526.898817:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575421568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444526.898824:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:1.0:1783444526.898877:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575421568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783444527.135163:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444527.184292:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444527.184344:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444527.184377:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444527.184407:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444527.184435:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444527.184467:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557842944 00000100:00100000:3.0:1783444527.184477:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557842944 00000100:00100000:3.0:1783444527.184531:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557842816 00000100:00100000:3.0:1783444527.184535:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557842816 00000100:00100000:3.0:1783444527.184561:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2535 00000100:00100000:3.0:1783444527.184572:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557842944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444527.184663:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557842944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444527.184683:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2535 00000100:00100000:3.0:1783444527.184701:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2536 00000100:00100000:3.0:1783444527.184724:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557842816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444527.184751:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557842816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444527.184757:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2536 00000100:00100000:3.0:1783444527.184777:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557842688 00000100:00100000:3.0:1783444527.184781:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557842688 00000100:00100000:3.0:1783444527.184840:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557842560 00000100:00100000:3.0:1783444527.184844:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557842560 00000100:00100000:3.0:1783444527.184867:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1140 00000100:00100000:3.0:1783444527.184875:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557842688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444527.185087:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1141 00000100:00100000:0.0:1783444527.185097:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557842560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444527.185146:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557842688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 272us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444527.185153:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1140 00000100:00080000:3.0:1783444527.185176:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444527.185180:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444527.185183:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444527.185185:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444527.185281:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557842432 00000100:00100000:1.0:1783444527.185287:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557842432 00000100:00100000:1.0:1783444527.185321:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:1.0:1783444527.185328:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557842432:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444527.187379:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557842560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 2274us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444527.187393:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1141 00000100:00100000:0.0:1783444527.189276:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557842432:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 3938us (4988us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444527.189291:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:2.0:1783444527.390570:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444527.391223:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c79ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575421952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444527.391305:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444527.396028:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575421824:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.396101:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444527.396203:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575421696:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.396236:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444527.398412:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575421952 00000100:00100000:2.0:1783444527.398443:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575421952 00000100:00100000:2.0:1783444527.398503:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:2.0:1783444527.398513:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575421952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444527.398553:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:2.0:1783444527.399349:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575421952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 833us (8040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444527.399358:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:2.0:1783444527.399402:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575421696 00000100:00100000:2.0:1783444527.399407:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575421696 00000100:00100000:2.0:1783444527.399452:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783444527.399459:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575421696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.399503:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575421696:12345-0@lo:400:kworker.0 Request processed in 45us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444527.399510:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783444527.400158:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575422208:0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.400212:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444527.400256:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575421696:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.400298:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575422336:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.400331:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575422464:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.400356:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444527.400383:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575422976:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.400404:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444527.400694:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c79ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575421952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444527.400710:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783444527.400716:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575422080:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.400782:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575422464 00000100:00100000:2.0:1783444527.400808:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575422464 00000100:00100000:2.0:1783444527.400842:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575422976 00000100:00100000:2.0:1783444527.400845:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575422976 00000100:00100000:2.0:1783444527.400876:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:2.0:1783444527.400883:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575422464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.400926:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575422464:12345-0@lo:400:kworker.0 Request processed in 44us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444527.400947:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:2.0:1783444527.400961:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1783444527.400967:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575422976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.400994:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575422976:12345-0@lo:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444527.400999:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00080000:2.0:1783444527.401020:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444527.416111:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575422720:0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.416175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444527.418601:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575421824 00000100:00100000:1.0:1783444527.418615:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575421824 00000100:00100000:1.0:1783444527.418711:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575422208 00000100:00100000:1.0:1783444527.418715:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575422208 00000100:00100000:1.0:1783444527.418746:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1783444527.418755:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575421824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444527.418854:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575421824:12345-0@lo:400:kworker.0 Request processed in 99us (22752us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444527.418862:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1783444527.418882:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00080000:3.0:1783444527.419009:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444527.421770:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575422208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444527.421879:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575422208:12345-0@lo:400:kworker.0 Request processed in 124us (21666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444527.426862:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575423232:0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.426946:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444527.427002:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575422208:0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.427036:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575422720 00000100:00100000:0.0:1783444527.427042:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575422720 00000100:00100000:0.0:1783444527.427081:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575423232 00000100:00100000:0.0:1783444527.427084:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575423232 00000100:00100000:0.0:1783444527.427099:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1783444527.427108:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575422720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.427160:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575422720:12345-0@lo:400:kworker.0 Request processed in 52us (10984us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444527.427167:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1783444527.427196:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1783444527.427203:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575423232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.427228:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575423232:12345-0@lo:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444527.427233:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1783444527.427262:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575422720:0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.427273:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575423232:0@lo:400:kworker.0 00000100:00100000:3.0:1783444527.429911:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444527.429972:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575422592:0@lo:400:kworker.0 00000100:00100000:3.0:1783444527.430030:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444527.430051:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575423104:0@lo:400:kworker.0 00000100:00100000:3.0:1783444527.430069:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444527.430117:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575422464:0@lo:400:kworker.0 00000100:00100000:3.0:1783444527.430130:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575422976:0@lo:400:kworker.0 00000100:00100000:3.0:1783444527.430168:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575422592 00000100:00100000:3.0:1783444527.430198:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575422592 00000100:00100000:3.0:1783444527.430242:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575423104 00000100:00100000:3.0:1783444527.430245:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575423104 00000100:00100000:3.0:1783444527.430272:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1783444527.430279:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575422592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444527.430626:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575422592:12345-0@lo:400:kworker.0 Request processed in 346us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444527.430634:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1783444527.430652:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:3.0:1783444527.430659:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575423104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444527.430687:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1870073575423104:12345-0@lo:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444527.430692:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00080000:3.0:1783444527.430709:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444527.430733:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575422592:0@lo:400:kworker.0 00000100:00100000:3.0:1783444527.430743:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575423104:0@lo:400:kworker.0 00000100:00100000:1.0:1783444527.431329:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1783444527.431365:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575422080 00000100:00100000:1.0:1783444527.431369:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575422080 00000100:00100000:1.0:1783444527.431417:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1783444527.431423:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575422080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783444527.431558:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444527.431646:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575422080:12345-0@lo:400:kworker.0 Request processed in 223us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444527.431653:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1783444527.432087:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575422080:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.435416:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444527.441695:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575422848:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.441765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444527.441843:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575421824:0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.441918:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575422848 00000100:00100000:2.0:1783444527.441925:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575422848 00000100:00100000:2.0:1783444527.441988:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:2.0:1783444527.441998:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575422848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.442027:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575422336 00000100:00100000:0.0:1783444527.442032:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575422336 00000100:00100000:2.0:1783444527.442059:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575422848:12345-0@lo:400:kworker.0 Request processed in 62us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444527.442067:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:0.0:1783444527.442075:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1783444527.442082:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575422336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444527.442102:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575422848:0@lo:400:kworker.0 00000100:00100000:0.0:1783444527.442148:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575422336:12345-0@lo:400:kworker.0 Request processed in 66us (6738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444527.442154:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00080000:0.0:1783444527.442176:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444527.453134:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575422336:0@lo:400:kworker.0 00000100:00100000:1.0:1783444527.904158:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444527.905532:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575423488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444527.906289:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444527.906347:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575423488 00000100:00100000:1.0:1783444527.906355:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575423488 00000100:00100000:1.0:1783444527.906403:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1783444527.906413:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575423488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444527.907145:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444527.907532:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444527.907552:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575423360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444527.908547:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444527.908733:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575423488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2319us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444527.908744:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1783444527.908776:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575423360 00000100:00100000:1.0:1783444527.908783:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575423360 00000100:00100000:1.0:1783444527.908823:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:1.0:1783444527.908830:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575423360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444527.908853:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444527.908890:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1870073575423360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444527.908897:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:1.0:1783444527.908993:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575423488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444527.909384:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575423360:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1783444527.914218:0:9499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000001:00080000:1.0:1783444527.914237:0:9499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969460 is committed 00000001:00100000:2.0:1783444527.917551:0:8415:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 08efc25c-17e5-4d29-97d2-f1505f195a06 00000001:00080000:2.0:1783444527.917568:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969454 is committed 00010000:00010000:3.0:1783444528.158436:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444529.186561:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444530.207954:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444531.229405:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783444531.729321:0:94937:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:1.0:1783444531.997197:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575423616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444531.997272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444531.997698:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575423616 00000100:00100000:0.0:1783444531.997705:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575423616 00000100:00100000:0.0:1783444531.997760:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:0.0:1783444531.997769:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575423616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444531.997823:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444531.997899:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575423616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444531.997906:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00100000:1.0:1783444531.998198:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575423616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444531.998266:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575423744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444531.998317:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444531.998405:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575423744 00000100:00100000:1.0:1783444531.998409:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575423744 00000100:00100000:1.0:1783444531.998463:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1783444531.998471:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575423744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444531.998490:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444531.998541:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575423744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444531.998547:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1783444531.998580:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575423744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444531.999195:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575423872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444531.999228:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444531.999320:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575423872 00000100:00100000:2.0:1783444531.999325:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575423872 00000100:00100000:2.0:1783444531.999367:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:2.0:1783444531.999374:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575423872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444531.999392:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444531.999454:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575423872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444531.999460:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:3.0:1783444532.000312:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575423872:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783444532.000388:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444532.000394:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783444532.253096:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444532.308076:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444532.308122:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444532.308161:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444532.308208:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444532.308233:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444532.308267:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557843456 00000100:00100000:3.0:1783444532.308277:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557843456 00000100:00100000:3.0:1783444532.308328:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557843584 00000100:00100000:3.0:1783444532.308332:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557843584 00000100:00100000:3.0:1783444532.308597:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2541 00000100:00100000:3.0:1783444532.308610:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557843456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444532.308673:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557843200 00000100:00100000:1.0:1783444532.308679:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557843200 00000100:00100000:3.0:1783444532.308685:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557843456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444532.308693:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2541 00000100:00100000:3.0:1783444532.308715:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2542 00000100:00100000:1.0:1783444532.308720:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557843328 00000100:00100000:3.0:1783444532.308726:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557843584:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444532.308726:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557843328 00000100:00100000:1.0:1783444532.308759:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1148 00000100:00100000:3.0:1783444532.308761:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557843584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444532.308768:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2542 00000100:00100000:1.0:1783444532.308785:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557843200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444532.308875:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557843200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 94us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444532.308883:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1148 00000100:00100000:1.0:1783444532.308901:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1149 00000100:00100000:1.0:1783444532.308907:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557843328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444532.308934:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557843328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444532.308942:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1149 00000100:00080000:3.0:1783444532.308971:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444532.308976:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444532.308978:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444532.308980:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444532.310215:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557843072 00000100:00100000:2.0:1783444532.310225:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557843072 00000100:00100000:2.0:1783444532.310275:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:2.0:1783444532.310283:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557843072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444532.310349:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557843072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 66us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444532.310356:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:1.0:1783444532.509434:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575424256:0@lo:400:kworker.0 00000100:00100000:1.0:1783444532.509516:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444532.509558:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444532.509565:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575424384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444532.509594:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444532.509629:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575424384 00000100:00100000:1.0:1783444532.509636:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575424384 00000100:00100000:1.0:1783444532.509685:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:1.0:1783444532.509694:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575424384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444532.509730:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:1.0:1783444532.509780:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575424384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444532.509809:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00100000:1.0:1783444532.509856:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575424768:0@lo:400:kworker.0 00000100:00100000:0.0:1783444532.509866:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575424256 00000100:00100000:0.0:1783444532.509872:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575424256 00000100:00100000:1.0:1783444532.509884:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444532.510078:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575424000:0@lo:400:kworker.0 00000100:00100000:1.0:1783444532.510121:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575424384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444532.510132:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444532.510147:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444532.510156:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575424896:0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.510169:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575424512:0@lo:400:kworker.0 00000100:00100000:1.0:1783444532.510189:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444532.510202:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444532.510223:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575424768 00000100:00100000:1.0:1783444532.510228:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575424768 00000100:00100000:3.0:1783444532.510230:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575425024:0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.510254:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444532.510273:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783444532.510280:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575424128:0@lo:400:kworker.0 00000100:00100000:1.0:1783444532.510447:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575424512 00000100:00100000:1.0:1783444532.510451:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575424512 00000100:00100000:0.0:1783444532.510473:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1783444532.510480:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1783444532.510485:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575424256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444532.510501:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575424768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444532.510541:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575424256:12345-0@lo:400:kworker.0 Request processed in 60us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444532.510549:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575424768:12345-0@lo:400:kworker.0 Request processed in 50us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444532.510551:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1783444532.510562:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1783444532.510577:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1783444532.510584:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575424512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444532.510615:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575424512:12345-0@lo:400:kworker.0 Request processed in 32us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444532.510621:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1783444532.510669:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575424896 00000100:00100000:1.0:1783444532.510673:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575424896 00000100:00100000:3.0:1783444532.510737:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444532.510756:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575424640:0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.510777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444532.510860:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575424000 00000100:00100000:2.0:1783444532.510864:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575424000 00000100:00100000:2.0:1783444532.510895:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783444532.510902:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575424000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444532.515250:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575424768:0@lo:400:kworker.0 00000100:00100000:0.0:1783444532.515272:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575424256:0@lo:400:kworker.0 00000100:00100000:1.0:1783444532.517428:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575425024 00000100:00100000:1.0:1783444532.517442:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575425024 00000100:00100000:1.0:1783444532.517568:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1783444532.517580:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575424896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444532.517774:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:0.0:1783444532.517815:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575425024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.518783:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575425152:0@lo:400:kworker.0 00000100:00100000:2.0:1783444532.518988:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575424000:12345-0@lo:400:kworker.0 Request processed in 8083us (8853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444532.518998:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1783444532.519062:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444532.519067:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444532.519071:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444532.519074:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444532.519105:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575424128 00000100:00100000:2.0:1783444532.519112:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575424128 00000100:00100000:2.0:1783444532.519154:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575424640 00000100:00100000:2.0:1783444532.519157:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575424640 00000100:00100000:2.0:1783444532.519178:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1783444532.519185:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575424128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444532.519227:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575424128:12345-0@lo:400:kworker.0 Request processed in 41us (8489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444532.519234:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1783444532.519247:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1783444532.519252:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575424640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444532.519294:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575424640:12345-0@lo:400:kworker.0 Request processed in 31us (8505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444532.519300:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00080000:2.0:1783444532.519315:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444532.519318:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444532.523704:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575425024:12345-0@lo:400:kworker.0 Request processed in 5881us (13438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444532.523719:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1783444532.527574:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575424896:12345-0@lo:400:kworker.0 Request processed in 9986us (17374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444532.527591:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:0.0:1783444532.527856:0:3635:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:0.0:1783444532.527881:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575424896:0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.532006:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444532.532124:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575424000:0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.532144:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575424512:0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.532156:0:3633:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969460 gen 2 00000100:00100000:3.0:1783444532.532174:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575425024:0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.532201:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575424128:0@lo:400:kworker.0 00000100:00100000:3.0:1783444532.532212:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575424640:0@lo:400:kworker.0 00000100:00100000:2.0:1783444532.539486:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575425152 00000100:00100000:2.0:1783444532.539501:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575425152 00000100:00100000:2.0:1783444532.539632:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1783444532.539644:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575425152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444532.539760:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575425152:12345-0@lo:400:kworker.0 Request processed in 119us (7762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444532.539768:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1783444532.539874:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575425152:0@lo:400:kworker.0 00000100:00100000:2.0:1783444533.028342:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444533.028370:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575425280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444533.028547:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444533.028725:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575425280 00000100:00100000:2.0:1783444533.028734:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575425280 00000100:00100000:2.0:1783444533.028811:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:2.0:1783444533.028819:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575425280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444533.029141:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444533.029237:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575425280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 418us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444533.029245:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1783444533.029351:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575425280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444533.029375:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575425408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444533.029403:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444533.029567:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575425408 00000100:00100000:2.0:1783444533.029574:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575425408 00000100:00100000:2.0:1783444533.030752:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:2.0:1783444533.030765:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575425408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444533.030804:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444533.030875:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575425408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444533.030882:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:2.0:1783444533.030930:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575425408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783444533.278490:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783444533.301221:0:94985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1783444534.301068:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444535.193968:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.194086:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557843712 00000100:00100000:2.0:1783444535.194097:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557843712 00000100:00080000:0.0:1783444535.194174:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444535.194194:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1445 00000100:00100000:2.0:1783444535.194205:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:72866:x1870073557843712:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1783444535.194242:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:2.0:1783444535.194334:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:72866:x1870073557843712:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 130us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.194342:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1445 00000100:00100000:1.0:1783444535.198659:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.198980:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557843840 00000100:00100000:2.0:1783444535.198992:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557843840 00000100:00100000:2.0:1783444535.199080:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1446 00000100:00100000:2.0:1783444535.199091:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+9:72866:x1870073557843840:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1783444535.199133:0:66226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:2.0:1783444535.199221:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+9:72866:x1870073557843840:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 132us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.199229:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1446 00000100:00080000:0.0:1783444535.200169:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444535.202994:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.203764:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557843968 00000100:00100000:2.0:1783444535.203776:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557843968 00000100:00100000:2.0:1783444535.203920:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2018 00000100:00100000:2.0:1783444535.203933:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+5:72866:x1870073557843968:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444535.203973:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00080000:0.0:1783444535.204173:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444535.205041:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+5:72866:x1870073557843968:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 126us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.205353:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2018 00000100:00100000:1.0:1783444535.210781:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.211648:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557844096 00000100:00100000:2.0:1783444535.211659:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557844096 00000100:00100000:2.0:1783444535.211755:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2019 00000100:00100000:2.0:1783444535.211772:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+5:72866:x1870073557844096:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444535.211837:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444535.211917:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+5:72866:x1870073557844096:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 147us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.211924:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2019 00000100:00080000:0.0:1783444535.212294:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444535.255903:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444535.256082:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557844224 00000100:00100000:0.0:1783444535.256092:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557844224 00000100:00100000:2.0:1783444535.256318:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1447 00000100:00100000:2.0:1783444535.256333:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:71763:x1870073557844224:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1783444535.256373:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444535.256398:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e15 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256473:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256489:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256502:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256515:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256521:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256527:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256683:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e3833997 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256691:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e3833997 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256699:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e3833997 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444535.256730:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444535.256740:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444535.256839:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e3833997 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256855:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256860:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256866:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256872:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256877:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444535.256882:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256889:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256902:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:2.0:1783444535.256905:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444535.256910:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256916:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256929:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256946:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256952:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256957:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444535.256960:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256966:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256975:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9368c6b5eb00) 00010000:00010000:2.0:1783444535.256977:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444535.256980:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.256986:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.257019:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e15 expref: 9 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.257033:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031400/0x42cb6883e3833997 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e15 expref: 8 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.257041:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368c6b5ee00) 00010000:00010000:2.0:1783444535.257043:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444535.257051:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0031400, rc 0) 00000100:00100000:2.0:1783444535.257137:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71763:x1870073557844224:12345-192.168.204.20@tcp:101:bash.0 Request processed in 807us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.257145:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1447 00000100:00100000:3.0:1783444535.263285:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.263431:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557844352 00000100:00100000:2.0:1783444535.263441:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557844352 00000100:00100000:2.0:1783444535.263507:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1448 00000100:00100000:2.0:1783444535.263517:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:71763:x1870073557844352:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1783444535.263539:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444535.263562:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e383399e lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e1c expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.263629:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.263643:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.263654:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.263668:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.263675:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.263681:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444535.263887:0:71469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4acaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:71469:1870073575425536:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783444535.263956:0:71469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444535.263982:0:71469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c4445540 going to sleep for 11 seconds 00000100:00100000:0.0:1783444535.264489:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575425536 00000100:00100000:0.0:1783444535.264497:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575425536 00000100:00100000:0.0:1783444535.264546:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:0.0:1783444535.264554:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:71469:x1870073575425536:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783444535.264650:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:71469:x1870073575425536:12345-0@lo:1000:mdt00_004.0 Request processed in 97us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444535.264659:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00100000:3.0:1783444535.268049:0:71469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4acaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:71469:1870073575425536:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783444535.268142:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70e00/0x42cb6883e38339b3 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268171:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70e00/0x42cb6883e38339b3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268184:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70e00/0x42cb6883e38339b3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444535.268213:0:71469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70e00/0x42cb6883e38339b3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268229:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268235:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268241:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268247:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268253:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444535.268257:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268263:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268289:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368c6b5ee00) 00010000:00010000:3.0:1783444535.268292:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444535.268296:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268302:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e38339a5 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268316:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268321:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268326:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268332:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444535.268334:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268340:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268346:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff9368c6b5ef00) 00010000:00010000:3.0:1783444535.268348:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444535.268351:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268356:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e38339ac lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268407:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27000/0x42cb6883e383399e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e1c expref: 10 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268422:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70e00/0x42cb6883e38339b3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e1c expref: 9 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.268429:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9367c4206600) 00010000:00010000:3.0:1783444535.268431:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783444535.268434:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70e00, rc 0) 00000100:00100000:3.0:1783444535.268520:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71763:x1870073557844352:12345-192.168.204.20@tcp:101:bash.0 Request processed in 5004us (5255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444535.268530:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1448 00000100:00100000:1.0:1783444535.272357:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.272449:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557844480 00000100:00100000:2.0:1783444535.272460:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557844480 00000100:00100000:2.0:1783444535.272519:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1449 00000100:00100000:2.0:1783444535.272529:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71763:x1870073557844480:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1783444535.272552:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444535.272574:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26e00/0x42cb6883e38339ba lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e23 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.272637:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e38339c1 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.272650:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e38339c1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.272664:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e38339c1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444535.272718:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1783444535.272722:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1783444535.272830:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26e00/0x42cb6883e38339ba lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e23 expref: 11 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.272849:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e38339c1 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e23 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.272857:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368e7860500) 00010000:00010000:2.0:1783444535.272860:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1783444535.272877:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27800, rc 0) 00000100:00100000:2.0:1783444535.272931:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71763:x1870073557844480:12345-192.168.204.20@tcp:101:bash.0 Request processed in 404us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.272939:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1449 00000100:00100000:1.0:1783444535.279584:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444535.279630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.279720:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557844736 00000100:00100000:2.0:1783444535.279729:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557844736 00000100:00100000:2.0:1783444535.279842:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 749 00000100:00100000:2.0:1783444535.279852:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2401:x1870073557844736:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783444535.279867:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444535.279890:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e38339c1 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e23 expref: 10 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.279910:0:19646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368e7860500) 00010000:00010000:2.0:1783444535.279915:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444535.279976:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2401:x1870073557844736:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 125us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.279983:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 749 00000100:00100000:0.0:1783444535.280485:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557844608 00000100:00100000:0.0:1783444535.280491:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557844608 00000100:00100000:0.0:1783444535.280532:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1450 00000100:00100000:0.0:1783444535.280540:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71763:x1870073557844608:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1783444535.280558:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444535.280575:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645600/0x42cb6883e38339c8 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e2a expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280656:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280669:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280678:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280691:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280698:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280703:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280820:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644e00/0x42cb6883e38339dd lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280829:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644e00/0x42cb6883e38339dd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280835:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644e00/0x42cb6883e38339dd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444535.280879:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783444535.280884:0:66223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444535.280905:0:66223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644e00/0x42cb6883e38339dd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280929:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644e00/0x42cb6883e38339dd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280938:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280944:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280950:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280956:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280963:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444535.280967:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280975:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280985:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff9368e7860500) 00010000:00010000:0.0:1783444535.280988:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444535.280992:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.280998:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644400/0x42cb6883e38339cf lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281012:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281024:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281030:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281035:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444535.281038:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281044:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281052:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff9368f57c6d00) 00010000:00010000:0.0:1783444535.281055:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444535.281353:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281361:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645e00/0x42cb6883e38339d6 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281396:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7645600/0x42cb6883e38339c8 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e2a expref: 11 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281409:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c7644e00/0x42cb6883e38339dd lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e2a expref: 10 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444535.281416:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff9368c59a7600) 00010000:00010000:0.0:1783444535.281419:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444535.281428:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7644e00, rc 0) 00000100:00100000:0.0:1783444535.281487:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71763:x1870073557844608:12345-192.168.204.20@tcp:101:bash.0 Request processed in 946us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444535.281495:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1450 00000100:00100000:1.0:1783444535.293483:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444535.293570:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557844864 00000100:00100000:3.0:1783444535.293580:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557844864 00000100:00100000:3.0:1783444535.293704:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5923 00000100:00100000:3.0:1783444535.293716:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2401:x1870073557844864:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1783444535.293733:0:26201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444535.293755:0:26201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e38339e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e31 expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444535.293843:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x603:0x0] initial LVB size: 0, mtime: 0x6a4d3407, atime: 0x6a4d3407, ctime: 0x6a4d3407, blocks: 0x0 00010000:00010000:3.0:1783444535.293864:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=3526s v=(0 0) 00010000:00010000:3.0:1783444535.293867:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444535.293878:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e38339e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e31 expref: 6 pid: 26201 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.293916:0:26201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095edffa6/0x42cb6883e38339e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e31 expref: 6 pid: 26201 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.293930:0:26201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71e00, rc 0) 00000100:00100000:3.0:1783444535.293981:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2401:x1870073557844864:12345-192.168.204.20@tcp:101:bash.0 Request processed in 268us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444535.293988:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5923 00000100:00100000:3.0:1783444535.310559:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444535.310674:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557844992 00000100:00100000:1.0:1783444535.310685:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557844992 00000100:00100000:1.0:1783444535.310770:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1451 00000100:00100000:1.0:1783444535.310826:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+9:71763:x1870073557844992:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1783444535.310848:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444535.310869:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e000/0x42cb6883e38339eb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e38 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444535.310938:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444535.310952:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444535.310963:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444535.310977:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444535.311000:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444535.311007:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444535.311114:0:80475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:80475:1870073575425664:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1783444535.311164:0:80475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444535.311206:0:80475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974480 going to sleep for 11 seconds 00000100:00100000:2.0:1783444535.311589:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575425664 00000100:00100000:2.0:1783444535.311595:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575425664 00000100:00100000:2.0:1783444535.311635:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:2.0:1783444535.311644:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:80475:x1870073575425664:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1783444535.311728:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:80475:x1870073575425664:12345-0@lo:1000:mdt00_005.0 Request processed in 85us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.311735:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1783444535.311872:0:80475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:80475:1870073575425664:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1783444535.311921:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70800/0x42cb6883e3833a00 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.311933:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70800/0x42cb6883e3833a00 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.311941:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70800/0x42cb6883e3833a00 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444535.311974:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70800/0x42cb6883e3833a00 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.311988:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.311995:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312001:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312016:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312022:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444535.312026:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312034:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312046:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff9368c6b5ee00) 00010000:00010000:3.0:1783444535.312049:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444535.312053:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312059:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e38339f2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312074:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312080:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312085:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312090:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fc00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444535.312092:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312108:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312117:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff9367c98c8000) 00010000:00010000:3.0:1783444535.312120:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444535.312123:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312129:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e38339f9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312165:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e000/0x42cb6883e38339eb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e38 expref: 11 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312178:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70800/0x42cb6883e3833a00 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e38 expref: 10 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.312185:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9367c4206b00) 00010000:00010000:3.0:1783444535.312187:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783444535.312189:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70800, rc 0) 00000100:00100000:3.0:1783444535.312230:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71763:x1870073557844992:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1451us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444535.312237:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1451 00000100:00100000:1.0:1783444535.319496:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.320679:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557845120 00000100:00100000:2.0:1783444535.320691:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557845120 00000100:00100000:3.0:1783444535.320846:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1452 00000100:00100000:3.0:1783444535.320859:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+10:71763:x1870073557845120:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1783444535.320882:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444535.320904:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70400/0x42cb6883e3833a07 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e3f expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.320978:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3833a0e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.320991:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3833a0e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.321003:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3833a0e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444535.321057:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783444535.321061:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1783444535.321101:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d70400/0x42cb6883e3833a07 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e3f expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.321123:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3833a0e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e3f expref: 11 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.321131:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c3254100) 00010000:00010000:3.0:1783444535.321134:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1783444535.321137:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71600, rc 0) 00000100:00100000:3.0:1783444535.321463:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+11:71763:x1870073557845120:12345-192.168.204.20@tcp:101:bash.0 Request processed in 606us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444535.321471:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1452 00010000:00010000:3.0:1783444535.327639:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444535.342245:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444535.343300:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.345030:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557845248 00000100:00100000:2.0:1783444535.345071:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557845248 00000100:00100000:2.0:1783444535.345138:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1453 00000100:00100000:2.0:1783444535.345148:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+11:71763:x1870073557845248:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1783444535.345170:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444535.345190:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26e00/0x42cb6883e3833a15 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e46 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345258:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345272:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345283:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345297:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345304:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345309:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345387:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e3833a2a lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345396:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e3833a2a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345402:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e3833a2a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444535.345448:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x5:0x0]: returning size 0 00000004:00200000:2.0:1783444535.345453:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444535.345470:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e3833a2a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345481:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e3833a2a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345490:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345496:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345501:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345508:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345514:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444535.345517:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345525:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345537:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c3254100) 00010000:00010000:2.0:1783444535.345540:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444535.345545:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345561:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26800/0x42cb6883e3833a1c lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345575:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345580:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345584:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345589:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444535.345592:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345597:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345603:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff9368c6b5eb00) 00010000:00010000:2.0:1783444535.345606:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444535.345608:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345613:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27600/0x42cb6883e3833a23 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345640:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c26e00/0x42cb6883e3833a15 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e46 expref: 13 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345664:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6c27800/0x42cb6883e3833a2a lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e46 expref: 12 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.345671:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff9368c3254b00) 00010000:00010000:2.0:1783444535.345673:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783444535.345676:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27800, rc 0) 00000100:00100000:2.0:1783444535.345747:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+12:71763:x1870073557845248:12345-192.168.204.20@tcp:101:bash.0 Request processed in 600us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.345754:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1453 00000100:00100000:3.0:1783444535.348722:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557845376 00000100:00100000:3.0:1783444535.348855:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557845376 00000100:00100000:3.0:1783444535.349052:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 750 00000100:00100000:3.0:1783444535.349075:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+12:2401:x1870073557845376:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783444535.349121:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444535.349151:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9367c6d71600/0x42cb6883e3833a0e lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e3f expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444535.349174:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff9368c3254100) 00010000:00010000:3.0:1783444535.349179:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783444535.349252:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2401:x1870073557845376:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 179us (5956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444535.349260:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 750 00000100:00100000:1.0:1783444535.364354:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444535.373769:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557845504 00000100:00100000:2.0:1783444535.373807:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557845504 00000100:00100000:2.0:1783444535.373977:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5924 00000100:00100000:2.0:1783444535.373989:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2403:x1870073557845504:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1783444535.374007:0:17653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444535.374030:0:17653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e3833a31 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e4d expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444535.374068:0:17653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x604:0x0] initial LVB size: 0, mtime: 0x6a4d3407, atime: 0x6a4d3407, ctime: 0x6a4d3407, blocks: 0x0 00010000:00010000:2.0:1783444535.374091:0:17653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x604:0x0].0x0 since=3526s v=(0 0) 00010000:00010000:2.0:1783444535.374095:0:17653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x604:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444535.374105:0:17653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e3833a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e4d expref: 7 pid: 17653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.374124:0:17653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037dd4888/0x42cb6883e3833a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e4d expref: 7 pid: 17653 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444535.374162:0:17653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26e00, rc 0) 00000100:00100000:2.0:1783444535.374236:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557845504:12345-192.168.204.20@tcp:101:bash.0 Request processed in 248us (9891us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444535.374244:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5924 00010000:00010000:3.0:1783444536.348929:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444537.117143:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575425920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444537.117217:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444537.117257:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783444537.117264:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575425792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444537.117290:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444537.117377:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575425920 00000100:00100000:0.0:1783444537.117385:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575425920 00000100:00100000:0.0:1783444537.117447:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:0.0:1783444537.117456:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575425920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444537.117488:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444537.117537:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575425920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444537.117544:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:0.0:1783444537.117590:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575425920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444537.117654:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575425792 00000100:00100000:1.0:1783444537.117659:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575425792 00000100:00100000:1.0:1783444537.117717:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1783444537.117726:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575425792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444537.117760:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444537.117829:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575425792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444537.117835:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1783444537.117873:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575425792:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783444537.117928:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444537.122670:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575426048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444537.122741:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444537.122865:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575426048 00000100:00100000:3.0:1783444537.122874:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575426048 00000100:00100000:3.0:1783444537.122936:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:3.0:1783444537.122946:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575426048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444537.122974:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783444537.123077:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444537.123411:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575426048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 465us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444537.123419:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1783444537.123536:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575426048:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783444537.373445:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444537.428202:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444537.428258:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444537.428339:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444537.428377:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444537.428412:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444537.428471:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557845632 00000100:00100000:1.0:1783444537.428481:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557845632 00000100:00100000:1.0:1783444537.428533:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:1.0:1783444537.428542:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557845632:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444537.428606:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557845632:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444537.428613:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1783444537.429043:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557845760 00000100:00100000:3.0:1783444537.429048:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557845760 00000100:00100000:3.0:1783444537.429102:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557845888 00000100:00100000:3.0:1783444537.429105:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557845888 00000100:00100000:3.0:1783444537.429129:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1156 00000100:00100000:3.0:1783444537.429135:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2404:x1870073557845760:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444537.429175:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2404:x1870073557845760:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444537.429181:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1156 00000100:00100000:3.0:1783444537.429215:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1157 00000100:00100000:3.0:1783444537.429220:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557845888:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444537.429249:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557845888:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444537.429255:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1157 00000100:00080000:1.0:1783444537.429690:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444537.429695:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444537.439194:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557846016 00000100:00100000:3.0:1783444537.439209:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557846016 00000100:00100000:3.0:1783444537.439310:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557846144 00000100:00100000:3.0:1783444537.439314:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557846144 00000100:00100000:3.0:1783444537.439347:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2545 00000100:00100000:3.0:1783444537.439358:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557846016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444537.439437:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557846016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 81us (11177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444537.439445:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2545 00000100:00100000:3.0:1783444537.439463:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2546 00000100:00100000:3.0:1783444537.439469:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557846144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444537.439493:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557846144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (11081us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444537.439499:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2546 00000100:00080000:2.0:1783444537.440317:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444537.440322:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783444537.630808:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575426176:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.630900:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444537.630939:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575426688:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.630967:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444537.630983:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575427200:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631004:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444537.631148:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783444537.631156:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575426560:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631181:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444537.631197:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575427072:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631234:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444537.631265:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575427200 00000100:00100000:0.0:1783444537.631272:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575427200 00000100:00100000:0.0:1783444537.631319:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575427072 00000100:00100000:0.0:1783444537.631322:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575427072 00000100:00100000:0.0:1783444537.631343:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:0.0:1783444537.631352:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575427200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631405:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575427200:12345-0@lo:400:kworker.0 Request processed in 53us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444537.631412:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:0.0:1783444537.631428:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:0.0:1783444537.631435:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575427072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631464:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575427072:12345-0@lo:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444537.631470:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:0.0:1783444537.631487:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575426688 00000100:00100000:0.0:1783444537.631491:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575426688 00000100:00100000:0.0:1783444537.631514:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575426560 00000100:00100000:0.0:1783444537.631517:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575426560 00000100:00100000:0.0:1783444537.631535:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1783444537.631541:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575426688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631570:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575426688:12345-0@lo:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444537.631577:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1783444537.631588:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1783444537.631594:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575426560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631621:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575426560:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444537.631633:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1783444537.631668:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575426560:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631678:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575427072:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631685:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575426688:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.631693:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575427200:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.631851:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575426176 00000100:00100000:2.0:1783444537.631855:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575426176 00000100:00100000:2.0:1783444537.631896:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783444537.631903:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575426176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.631941:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575426176:12345-0@lo:400:kworker.0 Request processed in 39us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444537.631947:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1783444537.631979:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444537.631983:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444537.631992:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444537.631994:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444537.632006:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575426432:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632046:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444537.632066:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575426944:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632086:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444537.632104:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783444537.632110:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575426304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632132:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444537.632148:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575426816:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632170:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444537.632187:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575427328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632210:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444537.632233:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575426816 00000100:00100000:2.0:1783444537.632236:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575426816 00000100:00100000:2.0:1783444537.632265:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:2.0:1783444537.632272:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575426816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632307:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575426816:12345-0@lo:400:kworker.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444537.632313:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:2.0:1783444537.632333:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575426432 00000100:00100000:2.0:1783444537.632337:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575426432 00000100:00100000:2.0:1783444537.632356:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575426944 00000100:00100000:2.0:1783444537.632358:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575426944 00000100:00100000:2.0:1783444537.632367:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575426304 00000100:00100000:2.0:1783444537.632369:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575426304 00000100:00100000:2.0:1783444537.632380:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575427328 00000100:00100000:2.0:1783444537.632382:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575427328 00000100:00100000:2.0:1783444537.632403:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1783444537.632409:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575426432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632454:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575426432:12345-0@lo:400:kworker.0 Request processed in 45us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444537.632461:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1783444537.632472:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1783444537.632478:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575426944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632503:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575426944:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444537.632508:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1783444537.632517:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1783444537.632523:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575426304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632547:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575426304:12345-0@lo:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444537.632553:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1783444537.632562:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1783444537.632567:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575427328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632593:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575427328:12345-0@lo:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444537.632599:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00080000:2.0:1783444537.632619:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444537.632621:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444537.632642:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575426304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632652:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575426816:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632660:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575427328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632679:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575426432:0@lo:400:kworker.0 00000100:00100000:2.0:1783444537.632686:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575426944:0@lo:400:kworker.0 00000100:00100000:0.0:1783444537.635276:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575426176:0@lo:400:kworker.0 00000100:00100000:3.0:1783444537.636398:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444537.636420:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575427456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444537.636489:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444537.637028:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575427456 00000100:00100000:2.0:1783444537.637038:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575427456 00000100:00100000:2.0:1783444537.637100:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:2.0:1783444537.637108:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575427456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444537.637146:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:2.0:1783444537.637206:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575427456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444537.637214:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:3.0:1783444537.637423:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c56f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575427456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444538.141566:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444538.141589:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575427584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444538.141668:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444538.142996:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575427584 00000100:00100000:1.0:1783444538.143010:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575427584 00000100:00100000:1.0:1783444538.143066:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:1.0:1783444538.143076:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575427584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444538.143116:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444538.143203:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575427584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444538.143211:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:1.0:1783444538.150357:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575427712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444538.150438:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444538.150511:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575427584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444538.151458:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575427712 00000100:00100000:3.0:1783444538.151472:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575427712 00000100:00100000:3.0:1783444538.151554:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1783444538.151565:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575427712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444538.151595:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444538.151681:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575427712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444538.151689:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:1.0:1783444538.152464:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575427712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783444538.397970:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444539.423249:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444540.465568:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444541.470303:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444542.237073:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575427968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444542.237171:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444542.237226:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444542.237233:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575427840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444542.237258:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444542.237297:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575427968 00000100:00100000:0.0:1783444542.237307:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575427968 00000100:00100000:0.0:1783444542.237374:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575427840 00000100:00100000:0.0:1783444542.237377:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575427840 00000100:00100000:0.0:1783444542.237394:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:0.0:1783444542.237404:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575427968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444542.237443:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444542.237496:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575427968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444542.237504:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:0.0:1783444542.237524:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1783444542.237531:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575427840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783444542.237562:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1783444542.237592:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575427840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444542.237598:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00080000:0.0:1783444542.237628:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444542.237633:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444542.237684:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575427840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444542.237700:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575427968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444542.237898:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575428096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444542.237933:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444542.237973:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575428096 00000100:00100000:0.0:1783444542.237977:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575428096 00000100:00100000:0.0:1783444542.238007:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1783444542.238014:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575428096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444542.238043:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444542.238080:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575428096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444542.238086:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1783444542.238116:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575428096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783444542.492990:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444542.540115:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444542.540178:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444542.540212:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444542.540232:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444542.540283:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444542.540333:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557846528 00000100:00100000:1.0:1783444542.540346:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557846528 00000100:00100000:1.0:1783444542.540421:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557846400 00000100:00100000:1.0:1783444542.540425:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557846400 00000100:00100000:1.0:1783444542.540454:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1164 00000100:00100000:1.0:1783444542.540466:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557846528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444542.540565:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557846528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444542.540573:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1164 00000100:00100000:1.0:1783444542.540598:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1165 00000100:00100000:1.0:1783444542.540605:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2404:x1870073557846400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444542.540632:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2404:x1870073557846400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444542.540639:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1165 00000100:00100000:1.0:1783444542.540676:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557846784 00000100:00100000:1.0:1783444542.540680:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557846784 00000100:00100000:1.0:1783444542.540709:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557846656 00000100:00100000:1.0:1783444542.540712:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557846656 00000100:00100000:1.0:1783444542.540734:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2549 00000100:00100000:1.0:1783444542.540740:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557846784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444542.540768:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557846784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444542.540774:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2549 00000100:00100000:3.0:1783444542.541006:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557846272 00000100:00100000:3.0:1783444542.541011:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557846272 00000100:00100000:3.0:1783444542.541046:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:3.0:1783444542.541054:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557846272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444542.541084:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557846272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444542.541092:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1783444542.541170:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2550 00000100:00100000:1.0:1783444542.541181:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557846656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444542.541219:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557846656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444542.551209:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2550 00000100:00080000:2.0:1783444542.551250:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444542.551257:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444542.551261:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444542.551265:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444542.750287:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575428608:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.750364:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575428352:0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.750377:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444542.750421:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444542.750423:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575429120:0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.750461:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444542.750465:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575428864:0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.750493:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783444542.750503:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575428224:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.750510:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444542.750560:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444542.750571:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783444542.750581:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575428480:0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.750596:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575428736:0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.750627:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444542.750671:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575429248:0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.750696:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444542.750727:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575429120 00000100:00100000:2.0:1783444542.750735:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575429120 00000100:00100000:3.0:1783444542.750882:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575428608 00000100:00100000:3.0:1783444542.750887:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575428608 00000100:00100000:3.0:1783444542.750946:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575428352 00000100:00100000:3.0:1783444542.750949:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575428352 00000100:00100000:3.0:1783444542.750979:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575428736 00000100:00100000:3.0:1783444542.750982:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575428736 00000100:00100000:3.0:1783444542.751023:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1783444542.751040:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c56f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575428608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.751052:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575429248 00000100:00100000:2.0:1783444542.751060:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575429248 00000100:00100000:2.0:1783444542.751094:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1783444542.751100:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575429120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.751144:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c56f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575428608:12345-0@lo:400:kworker.0 Request processed in 104us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444542.751151:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575429120:12345-0@lo:400:kworker.0 Request processed in 49us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444542.751156:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1783444542.751184:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1783444542.751198:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575428352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.751213:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1783444542.751232:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1783444542.751239:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575429248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.751244:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575428352:12345-0@lo:400:kworker.0 Request processed in 51us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444542.751259:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1783444542.751280:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575429248:12345-0@lo:400:kworker.0 Request processed in 41us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444542.751286:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1783444542.751289:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1783444542.751299:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575428736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444542.751313:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575428224 00000100:00100000:2.0:1783444542.751317:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575428224 00000100:00100000:3.0:1783444542.751351:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575428736:12345-0@lo:400:kworker.0 Request processed in 54us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444542.751351:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783444542.751360:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575428224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.751366:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1783444542.751394:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575428224:12345-0@lo:400:kworker.0 Request processed in 36us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444542.751400:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783444542.751409:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575428864 00000100:00100000:3.0:1783444542.751414:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575428864 00000100:00080000:2.0:1783444542.751445:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444542.751451:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444542.751453:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444542.751455:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444542.751465:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:3.0:1783444542.751480:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575428864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.751539:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575428864:12345-0@lo:400:kworker.0 Request processed in 60us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444542.751553:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:3.0:1783444542.751611:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444542.751666:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575428992:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.751695:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444542.751750:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575428352:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.751774:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575428864:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.751834:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575429376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444542.751865:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444542.751886:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444542.751900:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575429504:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.751929:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444542.751962:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575428480 00000100:00100000:3.0:1783444542.751965:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575428480 00000100:00100000:3.0:1783444542.752009:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575428992 00000100:00100000:3.0:1783444542.752013:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575428992 00000100:00100000:3.0:1783444542.752040:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575429504 00000100:00100000:3.0:1783444542.752043:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575429504 00000100:00100000:3.0:1783444542.752063:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1783444542.752070:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575428480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752117:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575428480:12345-0@lo:400:kworker.0 Request processed in 47us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444542.752125:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1783444542.752148:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1783444542.752154:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575428992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752186:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575428992:12345-0@lo:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444542.752200:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1783444542.752211:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1783444542.752229:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575429504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752267:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575429504:12345-0@lo:400:kworker.0 Request processed in 39us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444542.752273:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:3.0:1783444542.752306:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444542.752337:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575428224:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752359:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575428736:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752372:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575429248:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752391:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575428608:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752404:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575429120:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752462:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575429504:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752473:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575428480:0@lo:400:kworker.0 00000100:00100000:3.0:1783444542.752491:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575428992:0@lo:400:kworker.0 00000100:00100000:0.0:1783444542.754284:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575429376 00000100:00100000:0.0:1783444542.754297:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575429376 00000100:00100000:0.0:1783444542.754746:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:0.0:1783444542.754757:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575429376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783444542.754827:0:8430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:0.0:1783444542.754913:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575429376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444542.754927:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:1.0:1783444542.755073:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575429376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444543.261131:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444543.261183:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575429632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444543.261274:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444543.261452:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575429632 00000100:00100000:2.0:1783444543.261461:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575429632 00000100:00100000:2.0:1783444543.261520:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:2.0:1783444543.261529:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575429632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444543.261558:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1783444543.261607:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575429632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444543.261614:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:2.0:1783444543.261683:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575429632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444543.262661:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444543.262679:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575429760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444543.262734:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444543.263151:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575429760 00000100:00100000:3.0:1783444543.263160:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575429760 00000100:00100000:3.0:1783444543.263216:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:3.0:1783444543.263227:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575429760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444543.263255:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444543.263327:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575429760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444543.263335:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:3.0:1783444543.263382:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575429760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783444543.523659:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783444544.457235:0:95276:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc75e4b980 20000000:00000080:1.0:1783444544.457260:0:95276:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9368c83c3400 uarg=0000000000000000 00000040:00100000:1.0:1783444544.460567:0:95276:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:1.0:1783444544.460583:0:95276:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:1.0:1783444544.460621:0:95276:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1783444544.463525:0:95277:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 42 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1783444544.463650:0:95277:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 42 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1783444544.463665:0:95277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:1.0:1783444544.464985:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:1.0:1783444544.465011:0:95276:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1783444544.465030:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:1.0:1783444544.465044:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:1.0:1783444544.465058:0:95276:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1783444544.465713:0:95278:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 43 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1783444544.465763:0:95278:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 43 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1783444544.465776:0:95278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:1.0:1783444544.466349:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:1.0:1783444544.466364:0:95276:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1783444544.466381:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:1.0:1783444544.466397:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:1.0:1783444544.466410:0:95276:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1783444544.471749:0:95279:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 44 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1783444544.471893:0:95279:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 44 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1783444544.471909:0:95279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:0.0:1783444544.472351:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:0.0:1783444544.472372:0:95276:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1783444544.472390:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:0.0:1783444544.472410:0:95276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:0.0:1783444544.472435:0:95276:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783444544.472463:0:95276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472488:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383357d expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472496:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833656 expref: 23 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472515:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383368e expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472522:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336aa expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472529:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472536:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472562:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336fe expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472568:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383370c expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472575:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833736 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472586:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 9 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472593:0:95276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 9 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472601:0:95276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472673:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 9 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472691:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 9 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.472710:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575429888:192.168.204.20@tcp:104: 00010000:00010000:0.0:1783444544.472877:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 9 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472885:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 9 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.472901:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430016:192.168.204.20@tcp:104: 00010000:00010000:0.0:1783444544.472935:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833736 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.472942:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833736 expref: 23 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.472951:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430144:0@lo:104: 00000100:00100000:0.0:1783444544.472994:0:95276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444544.473032:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e383370c expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.473040:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e383370c expref: 23 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.473049:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430272:0@lo:104: 00000100:00100000:0.0:1783444544.473069:0:95276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444544.473097:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38336fe expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.473105:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38336fe expref: 23 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.473113:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430400:0@lo:104: 00000100:00100000:2.0:1783444544.473209:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575430144 00000100:00100000:2.0:1783444544.473220:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575430144 00000100:00100000:2.0:1783444544.473282:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575430272 00000100:00100000:2.0:1783444544.473285:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575430272 00000100:00100000:2.0:1783444544.473303:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1783444544.473313:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95276:x1870073575430144:12345-0@lo:104: 00010000:00010000:2.0:1783444544.473328:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.474973:0:95276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444544.475038:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475156:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783444544.475167:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95276:x1870073575430144:12345-0@lo:104: Request processed in 1854us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.475179:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1783444544.475218:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575430400 00000100:00100000:2.0:1783444544.475227:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575430400 00000100:00100000:2.0:1783444544.475257:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1783444544.475264:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95276:x1870073575430272:12345-0@lo:104: 00010000:00010000:2.0:1783444544.475290:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475341:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783444544.475346:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95276:x1870073575430272:12345-0@lo:104: Request processed in 83us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.475353:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1783444544.475366:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1783444544.475372:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:95276:x1870073575430400:12345-0@lo:104: 00010000:00010000:2.0:1783444544.475379:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475412:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783444544.475417:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:95276:x1870073575430400:12345-0@lo:104: Request processed in 46us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.475423:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:2.0:1783444544.475449:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783444544.475457:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475465:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444544.475470:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475480:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444544.475499:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444544.475511:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444544.475547:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475555:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444544.475581:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475588:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833736 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383373d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475623:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444544.475639:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475645:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444544.475649:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475656:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444544.475662:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444544.475668:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444544.475683:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475689:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783444544.475705:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475721:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf90e00/0x42cb6883e383370c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833713 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.475733:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 23 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475734:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444544.475742:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.475750:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444544.475755:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.475755:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430528:0@lo:104: 00010000:00010000:2.0:1783444544.475769:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444544.475776:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444544.475781:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783444544.475823:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.475830:0:95276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783444544.475836:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444544.475878:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.475886:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 23 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.475894:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431040:0@lo:104: 00000100:00100000:0.0:1783444544.475917:0:95276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444544.475936:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e38336aa expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.475944:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e38336aa expref: 23 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.475953:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431168:0@lo:104: 00000100:00100000:0.0:1783444544.475975:0:95276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444544.475992:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e383368e expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.476000:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e383368e expref: 23 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.476008:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431296:0@lo:104: 00000100:00100000:0.0:1783444544.476042:0:95276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444544.476060:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833656 expref: 23 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.476068:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833656 expref: 23 pid: 94361 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.476076:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431424:0@lo:104: 00010000:00010000:0.0:1783444544.476097:0:95276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e383357d expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.476104:0:95276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e383357d expref: 23 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444544.476111:0:95276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431552:0@lo:104: 00000100:00100000:0.0:1783444544.476130:0:95276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444544.476156:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430144:0@lo:104: 00000100:00100000:0.0:1783444544.476168:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430272:0@lo:104: 00000100:00100000:0.0:1783444544.476176:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430400:0@lo:104: 00010000:00010000:2.0:1783444544.478858:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.478881:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf90000/0x42cb6883e38336fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833705 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.478904:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444544.478928:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444544.478931:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444544.478959:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575430912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.478996:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575430784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.479045:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444544.479078:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783444544.479098:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444544.479116:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444544.479125:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575430528 00000100:00100000:2.0:1783444544.479134:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575430528 00000100:00100000:2.0:1783444544.479210:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575431040 00000100:00100000:2.0:1783444544.479214:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575431040 00000100:00100000:2.0:1783444544.479224:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575431168 00000100:00100000:2.0:1783444544.479227:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575431168 00000100:00100000:2.0:1783444544.479236:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575431296 00000100:00100000:2.0:1783444544.479239:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575431296 00000100:00100000:2.0:1783444544.479248:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575431424 00000100:00100000:2.0:1783444544.479250:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575431424 00000100:00100000:2.0:1783444544.479257:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575431552 00000100:00100000:2.0:1783444544.479259:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575431552 00000100:00100000:2.0:1783444544.479271:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1783444544.479278:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:95276:x1870073575430528:12345-0@lo:104: 00010000:00010000:2.0:1783444544.479294:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.479349:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444544.479359:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575430656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.479389:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444544.479444:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575430784 00000100:00100000:1.0:1783444544.479449:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575430784 00010000:00010000:1.0:1783444544.479474:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383370c expref: 24 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444544.479483:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444544.479491:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444544.479512:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575430656 00000100:00100000:1.0:1783444544.479517:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575430656 00010000:00010000:1.0:1783444544.479532:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833736 expref: 25 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.483577:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783444544.483601:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+8:95276:x1870073575430528:12345-0@lo:104: Request processed in 4316us (7766us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.483628:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1783444544.483816:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1783444544.483832:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:95276:x1870073575431040:12345-0@lo:104: 00010000:00010000:2.0:1783444544.483856:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.483964:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783444544.483970:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+7:95276:x1870073575431040:12345-0@lo:104: Request processed in 145us (8052us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.483976:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1783444544.483991:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1783444544.483998:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+6:95276:x1870073575431168:12345-0@lo:104: 00010000:00010000:2.0:1783444544.484006:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.484043:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783444544.484048:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+6:95276:x1870073575431168:12345-0@lo:104: Request processed in 51us (8073us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.484054:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1783444544.484067:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1783444544.484073:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3824c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+5:95276:x1870073575431296:12345-0@lo:104: 00010000:00010000:2.0:1783444544.484081:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.484114:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783444544.484119:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3824c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+5:95276:x1870073575431296:12345-0@lo:104: Request processed in 47us (8077us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.484125:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1783444544.484165:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1783444544.484173:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95276:x1870073575431424:12345-0@lo:104: 00010000:00010000:2.0:1783444544.484182:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.484218:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1783444544.484225:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95276:x1870073575431424:12345-0@lo:104: Request processed in 54us (5126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.484231:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1783444544.484243:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1783444544.484249:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:95276:x1870073575431552:12345-0@lo:104: 00010000:00010000:2.0:1783444544.484257:0:6488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.484286:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1783444544.484290:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+3:95276:x1870073575431552:12345-0@lo:104: Request processed in 42us (5173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.484296:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1783444544.484464:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430528:0@lo:104: 00000100:00100000:0.0:1783444544.484476:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431040:0@lo:104: 00000100:00100000:0.0:1783444544.484484:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431168:0@lo:104: 00000100:00100000:0.0:1783444544.484491:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431296:0@lo:104: 00000100:00100000:0.0:1783444544.484498:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431424:0@lo:104: 00000100:00100000:0.0:1783444544.484505:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575431552:0@lo:104: 00010000:00010000:1.0:1783444544.488828:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783444544.488849:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.488864:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444544.488869:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.488881:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444544.488889:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444544.488896:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444544.489027:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489035:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444544.489063:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489071:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513b400/0x42cb6883e38336e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336e9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489126:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783444544.489130:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489136:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ba00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444544.489139:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489146:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444544.489154:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444544.489159:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444544.489172:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489177:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444544.489192:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489199:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513ba00/0x42cb6883e38336d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336db expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489207:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783444544.489210:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489225:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444544.489228:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489247:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444544.489254:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444544.489260:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444544.489272:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489277:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444544.489282:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489289:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513a400/0x42cb6883e38336aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336b1 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489299:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783444544.489302:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489308:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444544.489312:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489328:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444544.489336:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444544.489341:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444544.489352:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489357:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444544.489362:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489370:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c0030e00/0x42cb6883e383368e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833695 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489378:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444544.489381:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489387:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444544.489390:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489397:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444544.489403:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444544.489413:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444544.489424:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489430:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444544.489435:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489441:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf90a00/0x42cb6883e3833656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e383365d expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489450:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444544.489453:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489459:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444544.489461:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489468:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444544.489475:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444544.489480:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444544.489489:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489494:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444544.489502:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489509:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf91e00/0x42cb6883e383357d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833584 expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.489523:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444544.489524:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444544.489526:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444544.491492:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1783444544.491517:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3634:x1870073575430784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.491539:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.491550:0:19646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383370c expref: 25 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.491567:0:19646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e383370c expref: 25 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.491587:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e383370c expref: 25 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.491604:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.491704:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575430784:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (12658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.491807:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1783444544.491828:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1783444544.491883:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575431808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444544.491910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444544.491965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444544.492004:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575432320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.492021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444544.492055:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444544.492061:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575431936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.492078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444544.492104:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557847040 00000100:00100000:1.0:1783444544.492113:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557847040 00010000:00010000:1.0:1783444544.492139:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 10 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.492158:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575431808 00000100:00100000:1.0:1783444544.492160:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575431808 00010000:00010000:1.0:1783444544.492172:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 24 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.492181:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575432320 00000100:00100000:1.0:1783444544.492184:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575432320 00010000:00010000:1.0:1783444544.492194:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383357d expref: 25 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.492204:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575431936 00000100:00100000:1.0:1783444544.492207:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575431936 00010000:00010000:1.0:1783444544.492214:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38336aa expref: 26 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.492225:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2584 00000100:00100000:1.0:1783444544.492230:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557847040:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.492321:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.492326:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 10 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.492336:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 10 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.492359:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.492407:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557847040:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 175us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444544.492414:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2584 00000100:00100000:1.0:1783444544.492429:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1783444544.492519:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+26:3633:x1870073575431808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.492529:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.492534:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 26 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.492543:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 26 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.492554:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26400/0x42cb6883e38336db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38336d4 expref: 26 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.492565:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.492593:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3633:x1870073575431808:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444544.492599:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1783444544.492624:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1783444544.492630:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3633:x1870073575432320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.492642:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.492647:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383357d expref: 24 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.492655:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e383357d expref: 24 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.492784:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513a600/0x42cb6883e3833584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e383357d expref: 24 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.492851:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.492930:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3633:x1870073575432320:12345-0@lo:103:ldlm_bl.0 Request processed in 297us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444544.492940:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1783444544.492974:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1783444544.492984:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3633:x1870073575431936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.492999:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.493006:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38336aa expref: 22 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493018:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38336aa expref: 22 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493036:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91600/0x42cb6883e38336b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38336aa expref: 22 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493045:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.493064:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575431936:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444544.493070:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1783444544.493119:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575431936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.493129:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575431808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.493135:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575432320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.493190:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444544.493242:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575432064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.493268:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444544.493282:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783444544.493287:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575431680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.493317:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444544.493326:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575432192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.493341:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444544.493357:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575430912 00000100:00100000:1.0:1783444544.493363:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575430912 00010000:00010000:1.0:1783444544.493380:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38336fe expref: 21 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.493394:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575432064 00000100:00100000:1.0:1783444544.493397:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575432064 00010000:00010000:1.0:1783444544.493404:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383368e expref: 22 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.493412:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575431680 00000100:00100000:1.0:1783444544.493414:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575431680 00010000:00010000:1.0:1783444544.493421:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 23 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.493430:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575432192 00000100:00100000:1.0:1783444544.493432:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575432192 00010000:00010000:1.0:1783444544.493439:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833656 expref: 24 pid: 94361 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.493465:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1783444544.493470:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575430912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.493485:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.493489:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38336fe expref: 24 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493498:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38336fe expref: 24 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493509:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0030200/0x42cb6883e3833705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38336fe expref: 24 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493518:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.493543:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3635:x1870073575430912:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444544.493549:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1783444544.493563:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1783444544.493569:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3635:x1870073575432064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.493576:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.493580:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383368e expref: 22 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493589:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e383368e expref: 22 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493598:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91800/0x42cb6883e3833695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e383368e expref: 22 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493618:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.493640:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3635:x1870073575432064:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444544.493655:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1783444544.493667:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:1.0:1783444544.493673:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3635:x1870073575431680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.493680:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.493685:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 20 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493694:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 20 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493705:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91200/0x42cb6883e38336e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e38336e2 expref: 20 pid: 94360 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493715:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.493735:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3635:x1870073575431680:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444544.493741:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:1.0:1783444544.493752:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:1.0:1783444544.493757:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:3635:x1870073575432192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.493767:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444544.493772:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833656 expref: 18 pid: 94361 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.493784:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833656 expref: 18 pid: 94361 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444544.493801:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1783444544.493899:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513b800/0x42cb6883e383365d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833656 expref: 18 pid: 94361 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444544.493915:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557846912 00000100:00100000:3.0:1783444544.493925:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557846912 00010000:00010000:1.0:1783444544.493930:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444544.493958:0:6491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 10 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.493970:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:3635:x1870073575432192:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444544.493980:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1783444544.493992:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2592 00000100:00100000:3.0:1783444544.494003:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557846912:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783444544.494015:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783444544.494023:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575431680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444544.494024:0:6491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 10 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.494045:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575432192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444544.494053:0:6491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 10 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.494061:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575432064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444544.494089:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444544.494089:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575430912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444544.494136:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575430784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444544.494151:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557846912:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 147us (366us total) trans 0 rc 0/0 00010000:00010000:1.0:1783444544.494159:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444544.494174:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2592 00010000:00010000:1.0:1783444544.496897:0:95276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e07 expref: 9 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.496918:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575429888:192.168.204.20@tcp:104: 00010000:00010000:1.0:1783444544.496935:0:95276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27400/0x42cb6883e383374b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df9 expref: 8 pid: 94365 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444544.496949:0:95276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95276:1870073575430016:192.168.204.20@tcp:104: 00010000:00010000:3.0:1783444544.496991:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444544.497006:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444544.497021:0:95276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444544.498208:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:3634:x1870073575430656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783444544.498236:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444544.498247:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833736 expref: 16 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498267:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833736 expref: 16 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498292:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513ac00/0x42cb6883e383373d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833736 expref: 16 pid: 94359 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498311:0:6492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498344:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498366:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498374:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498382:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498389:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498396:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444544.498402:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498410:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498437:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444544.498448:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444544.498500:0:95276:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.498535:0:95276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444544.498543:0:95276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a38 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444544.498565:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+15:3634:x1870073575430656:12345-0@lo:103:ldlm_bl.0 Request processed in 400us (19172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444544.498589:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1783444544.498715:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575430656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444544.541872:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444545.568758:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783444545.821039:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783444545.821050:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368dd221800 from 58 10000000:01000000:2.0:1783444545.821057:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783444545.821125:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.821140:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.821153:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444545.821194:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575432448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.821301:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444545.821361:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d4dd8600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.821647:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575432448 00000100:00100000:3.0:1783444545.821659:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575432448 00000100:00100000:3.0:1783444545.821736:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783444545.821746:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575432448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444545.821764:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444545.821782:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833a3f expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.823200:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 16 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.823216:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 16 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.823228:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71600, rc 0) 00000100:00100000:3.0:1783444545.823323:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575432448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1578us (2022us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.823334:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783444545.823507:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575432448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444545.823528:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.823539:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444545.823652:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575432576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.823696:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444545.823824:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d4dd8600 going to sleep for 11 seconds 00000100:00100000:0.0:1783444545.826742:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575432576 00000100:00100000:0.0:1783444545.826763:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575432576 00000100:00100000:0.0:1783444545.826870:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783444545.826883:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575432576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.827751:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575432576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 867us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444545.827761:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783444545.828268:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575432576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.828338:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575432704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.828414:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444545.828506:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d4dd8600 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.828551:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575432704 00000100:00100000:3.0:1783444545.828557:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575432704 00000100:00100000:3.0:1783444545.828611:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783444545.828620:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575432704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.828769:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575432704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.828853:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783444545.828935:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575432704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.833089:0:95281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95281:1870073575432832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.833216:0:95281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.833290:0:95281:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974900 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.833489:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575432832 00000100:00100000:3.0:1783444545.833499:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575432832 00000100:00100000:3.0:1783444545.833563:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783444545.833573:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:95281:x1870073575432832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444545.833783:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:95281:x1870073575432832:12345-0@lo:502:llog_process_th.0 Request processed in 209us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.833823:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783444545.834683:0:95281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95281:1870073575432832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.834748:0:95281:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95281:1870073575432960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.834821:0:95281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.834860:0:95281:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974900 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.834970:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575432960 00000100:00100000:3.0:1783444545.834976:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575432960 00000100:00100000:3.0:1783444545.835052:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783444545.835062:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:95281:x1870073575432960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444545.835170:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:95281:x1870073575432960:12345-0@lo:502:llog_process_th.0 Request processed in 108us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.835178:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783444545.835260:0:95281:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95281:1870073575432960:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783444545.835281:0:95281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1783444545.835757:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1783444545.835785:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444545.835828:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.835842:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444545.835854:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783444545.835857:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:0.0:1783444545.835860:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444545.835894:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.835902:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.835912:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444545.835930:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.835973:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.848909:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575433088 00000100:00100000:1.0:1783444545.848931:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575433088 00000100:00100000:1.0:1783444545.851127:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783444545.851150:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575433088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444545.851174:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444545.851278:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833a4d expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.851322:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 17 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.851335:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 17 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.851365:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f000, rc 0) 00000100:00100000:1.0:1783444545.851468:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575433088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 327us (15492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.851476:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783444545.852537:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444545.852575:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444545.852615:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.852629:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444545.852739:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.852821:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444545.852847:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444545.852881:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575433216 00000100:00100000:2.0:1783444545.852891:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575433216 00000100:00100000:2.0:1783444545.852940:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783444545.853068:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575433216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.853304:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575433216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444545.853312:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783444545.853415:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.853450:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.853506:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444545.853528:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444545.853590:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575433344 00000100:00100000:1.0:1783444545.853595:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575433344 00000100:00100000:1.0:1783444545.853632:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783444545.853640:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575433344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.854091:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575433344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 451us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.854099:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783444545.854274:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.854785:0:95282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95282:1870073575433472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444545.854894:0:95282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444545.854928:0:95282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1783444545.855188:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575433472 00000100:00100000:2.0:1783444545.855197:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575433472 00000100:00100000:2.0:1783444545.855322:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783444545.855332:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:95282:x1870073575433472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444545.855476:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:95282:x1870073575433472:12345-0@lo:502:llog_process_th.0 Request processed in 145us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444545.855484:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783444545.857889:0:95282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95282:1870073575433472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444545.858153:0:95282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444545.858172:0:95282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444545.858176:0:95282:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1783444545.858183:0:95282:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1783444545.858206:0:95282:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:1.0:1783444545.860209:0:95282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95282:1870073575433600:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783444545.860434:0:95283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9368dd221800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783444545.860438:0:95283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368dd221800 4 00000100:00100000:1.0:1783444545.865488:0:95282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.865600:0:95282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974180 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.865765:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575433600 00000100:00100000:3.0:1783444545.865778:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575433600 00000100:00100000:3.0:1783444545.865874:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783444545.865885:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:95282:x1870073575433600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444545.866102:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:95282:x1870073575433600:12345-0@lo:502:llog_process_th.0 Request processed in 218us (5390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.866111:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783444545.868746:0:95282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95282:1870073575433600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783444545.868854:0:95282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444545.868869:0:95282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444545.868872:0:95282:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1783444545.868878:0:95282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:2.0:1783444545.869160:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:2.0:1783444545.869195:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783444545.869209:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.869255:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444545.869269:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783444545.869273:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 58 10000000:01000000:2.0:1783444545.869276:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783444545.869323:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.869332:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.869342:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444545.869368:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.869446:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444545.869494:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d4dd8480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444545.869826:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575433728 00000100:00100000:0.0:1783444545.869841:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575433728 00000100:00100000:0.0:1783444545.869897:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783444545.869907:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575433728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444545.869923:0:94361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444545.869939:0:94361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833a5b expref: -99 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.869967:0:94361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 18 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.869979:0:94361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 18 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.869988:0:94361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645200, rc 0) 00000100:00100000:0.0:1783444545.870039:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575433728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444545.870046:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783444545.870196:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444545.870210:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.870220:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444545.870435:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.870465:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.870496:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.870846:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575433856 00000100:00100000:3.0:1783444545.870853:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575433856 00000100:00100000:3.0:1783444545.870891:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783444545.870899:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575433856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.871056:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575433856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.871064:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783444545.871979:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.872031:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.872089:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444545.872118:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.872185:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575433984 00000100:00100000:3.0:1783444545.872190:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575433984 00000100:00100000:3.0:1783444545.872230:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783444545.872238:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575433984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.872491:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575433984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.872498:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783444545.872837:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575433984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.873422:0:95284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95284:1870073575434112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444545.873466:0:95284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444545.873499:0:95284:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.873606:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575434112 00000100:00100000:3.0:1783444545.873611:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575434112 00000100:00100000:3.0:1783444545.874166:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783444545.874176:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:95284:x1870073575434112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444545.874407:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+18:95284:x1870073575434112:12345-0@lo:502:llog_process_th.0 Request processed in 232us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.874415:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783444545.874494:0:95284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95284:1870073575434112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444545.874574:0:95284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95284:1870073575434240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444545.874623:0:95284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444545.875217:0:95284:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444545.885462:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575434240 00000100:00100000:2.0:1783444545.885485:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575434240 00000100:00100000:2.0:1783444545.885657:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783444545.885672:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:95284:x1870073575434240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444545.885953:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+18:95284:x1870073575434240:12345-0@lo:502:llog_process_th.0 Request processed in 284us (11328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444545.885962:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783444545.892106:0:95284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95284:1870073575434240:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783444545.892177:0:95284:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1783444545.892873:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1783444545.892908:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444545.892940:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.892953:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444545.892964:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783444545.892967:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1783444545.892970:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783444545.893018:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.893026:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.893035:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444545.893063:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575434368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.893148:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444545.893203:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d4dd8480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444545.893267:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575434368 00000100:00100000:0.0:1783444545.893275:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575434368 00000100:00100000:0.0:1783444545.893333:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783444545.893343:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575434368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444545.893359:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444545.893376:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833a69 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.893403:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 19 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.893415:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 19 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.893425:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7644600, rc 0) 00000100:00100000:0.0:1783444545.893471:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575434368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444545.893479:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783444545.893539:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575434368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444545.893553:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.893575:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444545.893649:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575434496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.893676:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444545.893690:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.893694:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575434496 00000100:00100000:3.0:1783444545.893700:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575434496 00000100:00100000:3.0:1783444545.893739:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783444545.893747:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575434496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.894049:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575434496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.894056:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783444545.894412:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575434496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.894449:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575434624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.894494:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444545.894603:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575434624 00000100:00100000:2.0:1783444545.894608:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575434624 00000100:00100000:2.0:1783444545.894658:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783444545.894666:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575434624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.894767:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575434624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444545.894775:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783444545.894922:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444545.894936:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575434624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.896719:0:95285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95285:1870073575434752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.896827:0:95285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.896874:0:95285:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.896984:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575434752 00000100:00100000:3.0:1783444545.896992:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575434752 00000100:00100000:3.0:1783444545.897044:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783444545.897054:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:95285:x1870073575434752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444545.897188:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:95285:x1870073575434752:12345-0@lo:502:llog_process_th.0 Request processed in 135us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.897196:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783444545.897460:0:95285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95285:1870073575434752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444545.897488:0:95285:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444545.897502:0:95285:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444545.897505:0:95285:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1783444545.897510:0:95285:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1783444545.897601:0:95285:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:1.0:1783444545.897628:0:95285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95285:1870073575434880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.897683:0:95285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.897703:0:95285:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.897968:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575434880 00000100:00100000:3.0:1783444545.897974:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575434880 00000100:00100000:3.0:1783444545.898008:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783444545.898017:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:95285:x1870073575434880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444545.898090:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:95285:x1870073575434880:12345-0@lo:502:llog_process_th.0 Request processed in 73us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.898097:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783444545.900618:0:95285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95285:1870073575434880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783444545.900689:0:95285:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783444545.900697:0:95285:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783444545.900700:0:95285:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1783444545.900705:0:95285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:0.0:1783444545.901074:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:0.0:1783444545.901108:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783444545.901124:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.901137:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444545.901150:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783444545.901153:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 58 10000000:01000000:0.0:1783444545.901156:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783444545.901199:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.901208:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.901227:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444545.901261:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.901354:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444545.901403:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9369015d96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.901533:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575435008 00000100:00100000:3.0:1783444545.901540:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575435008 00000100:00100000:3.0:1783444545.901605:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783444545.901615:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575435008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444545.901631:0:94361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444545.901647:0:94361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833a77 expref: -99 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.901675:0:94361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 20 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.901687:0:94361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 20 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.901697:0:94361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70400, rc 0) 00000100:00100000:3.0:1783444545.901750:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575435008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.901764:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783444545.901992:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444545.902008:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.902017:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444545.902083:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.902117:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.902155:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974840 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.902218:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575435136 00000100:00100000:3.0:1783444545.902223:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575435136 00000100:00100000:3.0:1783444545.902260:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783444545.902268:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575435136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.902394:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575435136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.902401:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783444545.902536:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.902571:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.902631:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.902654:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974840 going to sleep for 11 seconds 00000100:00100000:1.0:1783444545.902670:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575435264 00000100:00100000:1.0:1783444545.902674:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575435264 00000100:00100000:1.0:1783444545.902698:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783444545.902705:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575435264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.902828:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575435264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.902835:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783444545.902879:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.903099:0:95286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95286:1870073575435392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.903133:0:95286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.903152:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575435392 00000100:00100000:1.0:1783444545.903155:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575435392 00000100:00100000:1.0:1783444545.903172:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783444545.903178:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:95286:x1870073575435392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.903473:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:95286:x1870073575435392:12345-0@lo:502:llog_process_th.0 Request processed in 294us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.903481:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783444545.903577:0:95286:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444545.903600:0:95286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95286:1870073575435392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.903640:0:95286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95286:1870073575435520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.903680:0:95286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.903993:0:95286:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.904779:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575435520 00000100:00100000:3.0:1783444545.904919:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575435520 00000100:00100000:3.0:1783444545.904968:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783444545.904977:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:95286:x1870073575435520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444545.905118:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:95286:x1870073575435520:12345-0@lo:502:llog_process_th.0 Request processed in 141us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.905126:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783444545.905239:0:95286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95286:1870073575435520:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444545.905279:0:95286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1783444545.905541:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1783444545.905569:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444545.905591:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.905605:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444545.905616:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783444545.905619:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783444545.905622:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444545.905657:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.905672:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.905682:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444545.905704:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.905752:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.905812:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444545.906043:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575435648 00000100:00100000:1.0:1783444545.906048:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575435648 00000100:00100000:1.0:1783444545.906087:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783444545.906095:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575435648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444545.906105:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444545.906121:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833a85 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.906146:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 21 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.906157:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 21 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.906168:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583e400, rc 0) 00000100:00100000:1.0:1783444545.906202:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575435648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.906209:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783444545.912385:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444545.912427:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.912444:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444545.912577:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.912682:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.912739:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491180 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.912770:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575435776 00000100:00100000:3.0:1783444545.912777:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575435776 00000100:00100000:3.0:1783444545.912873:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783444545.912884:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575435776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.913043:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575435776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.913052:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783444545.913110:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.913138:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.913183:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.913198:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444545.913464:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575435904 00000100:00100000:1.0:1783444545.913469:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575435904 00000100:00100000:1.0:1783444545.913497:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783444545.913505:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575435904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.913615:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575435904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.913628:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783444545.916006:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575435904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444545.920350:0:95287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1783444545.931509:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1783444545.931588:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783444545.931605:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.931619:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444545.938809:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783444545.938822:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 58 10000000:01000000:2.0:1783444545.938830:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783444545.938903:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.938917:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444545.938930:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444545.938963:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.939061:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444545.939118:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d4dd8480 going to sleep for 11 seconds 00000100:00100000:1.0:1783444545.939217:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575436032 00000100:00100000:1.0:1783444545.939227:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575436032 00000100:00100000:1.0:1783444545.939309:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783444545.939320:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575436032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444545.939337:0:94361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444545.939355:0:94361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833a93 expref: -99 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.939393:0:94361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 22 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.939405:0:94361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 22 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.939417:0:94361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583fc00, rc 0) 00000100:00100000:1.0:1783444545.939471:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575436032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.939478:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783444545.943616:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444545.943658:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.943673:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444545.943843:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.943942:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.943986:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444545.944162:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575436160 00000100:00100000:0.0:1783444545.944170:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575436160 00000100:00100000:0.0:1783444545.944222:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783444545.944232:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575436160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444545.944415:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575436160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444545.944424:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783444545.945258:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.945318:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.945429:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.945471:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491180 going to sleep for 11 seconds 00000100:00100000:1.0:1783444545.945535:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575436288 00000100:00100000:1.0:1783444545.945541:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575436288 00000100:00100000:1.0:1783444545.945679:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783444545.945689:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575436288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444545.945836:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575436288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.945844:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783444545.946198:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.948182:0:95288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95288:1870073575436416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444545.948304:0:95288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.948360:0:95288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444545.948428:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575436416 00000100:00100000:2.0:1783444545.948438:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575436416 00000100:00100000:2.0:1783444545.948497:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783444545.948508:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:95288:x1870073575436416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444545.948706:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:95288:x1870073575436416:12345-0@lo:502:llog_process_th.0 Request processed in 199us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444545.948715:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783444545.949006:0:95288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd15b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95288:1870073575436416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.949073:0:95288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95288:1870073575436544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444545.949448:0:95288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444545.949489:0:95288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974900 going to sleep for 11 seconds 00000100:00100000:2.0:1783444545.949540:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575436544 00000100:00100000:2.0:1783444545.949547:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575436544 00000100:00100000:2.0:1783444545.949595:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783444545.949610:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:95288:x1870073575436544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444545.949688:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:95288:x1870073575436544:12345-0@lo:502:llog_process_th.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444545.949696:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783444545.950558:0:95288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95288:1870073575436544:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444545.950611:0:95288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1783444545.951929:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1783444545.951970:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444545.951986:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.952000:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444545.952011:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783444545.952014:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1783444545.952018:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783444545.952071:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.952080:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.952097:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444545.952127:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.952213:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.952372:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444545.954728:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575436672 00000100:00100000:2.0:1783444545.954753:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575436672 00000100:00100000:1.0:1783444545.955058:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783444545.955072:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575436672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444545.955095:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444545.955120:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833aa1 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.955155:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.955168:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444545.955179:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583e000, rc 0) 00000100:00100000:1.0:1783444545.955298:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575436672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (3086us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444545.955305:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783444545.955433:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444545.955455:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.955466:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444545.955587:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.955631:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.956215:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444545.956338:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575436800 00000100:00100000:2.0:1783444545.956346:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575436800 00000100:00100000:2.0:1783444545.956558:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783444545.956568:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575436800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.956774:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575436800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444545.956782:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783444545.957000:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.957046:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.957105:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.957127:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:3.0:1783444545.957140:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575436928 00000100:00100000:3.0:1783444545.957144:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575436928 00000100:00100000:3.0:1783444545.957167:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783444545.957173:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575436928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.957274:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575436928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444545.957281:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783444545.957325:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575436928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783444545.959497:0:95289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783444545.959964:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783444545.959999:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783444545.960014:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.960048:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444545.960062:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783444545.960065:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:3.0:1783444545.960068:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783444545.960117:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.960125:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.960138:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444545.960169:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575437056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.960325:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.960639:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:0.0:1783444545.960695:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575437056 00000100:00100000:0.0:1783444545.960706:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575437056 00000100:00100000:0.0:1783444545.960831:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783444545.960844:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575437056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444545.960865:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444545.960885:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833aaf expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.960916:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 24 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.960929:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 24 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444545.960954:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7644400, rc 0) 00000100:00100000:0.0:1783444545.961014:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575437056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444545.961022:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783444545.961110:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575437056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444545.961126:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.961136:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444545.961211:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575437184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444545.961243:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444545.961710:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491000 going to sleep for 11 seconds 00000100:00100000:2.0:1783444545.961773:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575437184 00000100:00100000:2.0:1783444545.961779:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575437184 00000100:00100000:2.0:1783444545.961839:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783444545.961848:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575437184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444545.961937:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575437184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (693us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783444545.961945:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783444545.962026:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575437184:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783444545.962058:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783444545.962066:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444545.962075:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444546.058267:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444546.058527:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557847168 00000100:00100000:2.0:1783444546.058538:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557847168 00000100:00100000:2.0:1783444546.058619:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:2.0:1783444546.058629:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557847168:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444546.058647:0:94361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444546.058684:0:94361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e54 expref: -99 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444546.058714:0:94361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 9 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444546.058725:0:94361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 9 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444546.058734:0:94361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27c00, rc 0) 00000100:00100000:2.0:1783444546.058847:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557847168:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 219us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444546.058854:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:2.0:1783444546.069326:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444546.069555:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557847296 00000100:00100000:0.0:1783444546.069565:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557847296 00000100:00100000:0.0:1783444546.069628:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:0.0:1783444546.069639:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557847296:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444546.069820:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557847296:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 182us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444546.069828:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:0.0:1783444546.073836:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444546.073985:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557847424 00000100:00100000:3.0:1783444546.073995:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557847424 00000100:00100000:3.0:1783444546.074053:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:3.0:1783444546.074064:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557847424:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444546.074221:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557847424:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 158us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444546.074229:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:3.0:1783444546.085001:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444546.085075:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557847552 00000100:00100000:1.0:1783444546.085087:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557847552 00000100:00100000:1.0:1783444546.085148:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:1.0:1783444546.085158:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:73349:x1870073557847552:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783444546.085519:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:73349:x1870073557847552:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 348us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444546.085533:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:0.0:1783444546.097679:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444546.097783:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557847680 00000100:00100000:3.0:1783444546.097825:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557847680 00000100:00100000:3.0:1783444546.097884:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:3.0:1783444546.097895:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:73349:x1870073557847680:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783444546.098063:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:73349:x1870073557847680:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 170us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444546.098071:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:2.0:1783444546.103176:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444546.103918:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557847808 00000100:00100000:0.0:1783444546.103928:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557847808 00000100:00100000:0.0:1783444546.103988:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:0.0:1783444546.103999:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557847808:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444546.104014:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444546.104033:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e5b expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444546.104061:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 10 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444546.104072:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 10 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444546.104100:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645a00, rc 0) 00000100:00100000:0.0:1783444546.104163:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557847808:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 165us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444546.104170:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:3.0:1783444546.105936:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444546.106257:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557847936 00000100:00100000:0.0:1783444546.106266:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557847936 00000100:00100000:0.0:1783444546.106320:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:0.0:1783444546.106329:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557847936:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444546.106681:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557847936:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 352us (752us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783444546.106690:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00010000:00010000:3.0:1783444546.604934:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444547.360123:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444547.360149:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575437312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444547.360214:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444547.360263:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575437312 00000100:00100000:3.0:1783444547.360271:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575437312 00000100:00100000:3.0:1783444547.360324:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1783444547.360334:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575437312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444547.360363:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444547.360402:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575437312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444547.360410:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00080000:3.0:1783444547.360431:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444547.360462:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575437312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444547.362153:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783444547.362171:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575437440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444547.362222:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444547.362490:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575437440 00000100:00100000:1.0:1783444547.362498:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575437440 00000100:00100000:1.0:1783444547.362612:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1783444547.362621:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575437440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444547.362645:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444547.362691:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575437440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444547.362697:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00080000:1.0:1783444547.362717:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444547.362749:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575437440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444547.370758:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444547.370783:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575437568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444547.370877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444547.371191:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575437568 00000100:00100000:2.0:1783444547.371199:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575437568 00000100:00100000:2.0:1783444547.371257:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:2.0:1783444547.371266:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575437568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444547.371300:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:2.0:1783444547.371920:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575437568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 652us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444547.371928:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:0.0:1783444547.379862:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575437568:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783444547.616352:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444547.659455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444547.659496:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444547.659557:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444547.659578:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444547.659606:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444547.659632:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557848192 00000100:00100000:0.0:1783444547.659632:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557848320 00000100:00100000:3.0:1783444547.659641:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557848192 00000100:00100000:0.0:1783444547.659641:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557848320 00000100:00100000:1.0:1783444547.659694:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557848448 00000100:00100000:1.0:1783444547.659698:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557848448 00000100:00100000:3.0:1783444547.661360:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1172 00000100:00100000:3.0:1783444547.661374:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2404:x1870073557848192:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444547.661453:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2404:x1870073557848192:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 83us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444547.661475:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1172 00000100:00100000:3.0:1783444547.668715:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557848576 00000100:00100000:3.0:1783444547.668729:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557848576 00000100:00100000:0.0:1783444547.668885:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1173 00000100:00100000:0.0:1783444547.668899:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557848320:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444547.669724:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557848320:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 827us (10142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.669733:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1173 00000100:00100000:0.0:1783444547.669765:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557848064 00000100:00100000:0.0:1783444547.669783:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557848064 00000100:00100000:0.0:1783444547.669832:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:0.0:1783444547.669839:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557848064:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444547.669866:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557848064:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (10309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.669872:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:1.0:1783444547.670325:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2553 00000100:00100000:1.0:1783444547.670335:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557848448:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444547.670365:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557848448:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 33us (10868us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444547.670372:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2553 00000100:00080000:2.0:1783444547.678211:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444547.678223:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444547.678227:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444547.678230:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444547.698386:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2554 00000100:00100000:3.0:1783444547.698399:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557848576:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444547.698485:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557848576:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 89us (38878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444547.698493:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2554 00000100:00100000:0.0:1783444547.869832:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575437824:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.869897:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.869928:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575438336:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.869953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.869972:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575438848:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.869990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.870013:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783444547.870019:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575437696:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871203:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.871244:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575438208:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871271:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.871287:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575438720:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871305:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.871331:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575437952:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871350:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.871363:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575438464:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871379:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.871395:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783444547.871407:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575438080:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871425:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.871440:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575438592:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871458:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444547.871516:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575438336 00000100:00100000:0.0:1783444547.871523:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575438336 00000100:00100000:0.0:1783444547.871577:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:0.0:1783444547.871584:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575438336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871632:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575438336:12345-0@lo:400:kworker.0 Request processed in 48us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.871639:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:0.0:1783444547.871658:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575437824 00000100:00100000:0.0:1783444547.871661:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575437824 00000100:00100000:0.0:1783444547.871685:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575438848 00000100:00100000:0.0:1783444547.871687:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575438848 00000100:00100000:0.0:1783444547.871695:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575438208 00000100:00100000:0.0:1783444547.871697:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575438208 00000100:00100000:0.0:1783444547.871707:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575437952 00000100:00100000:0.0:1783444547.871709:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575437952 00000100:00100000:0.0:1783444547.871717:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575438464 00000100:00100000:0.0:1783444547.871719:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575438464 00000100:00100000:0.0:1783444547.871727:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575438080 00000100:00100000:0.0:1783444547.871729:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575438080 00000100:00100000:0.0:1783444547.871739:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1783444547.871743:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575437824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871767:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575437824:12345-0@lo:400:kworker.0 Request processed in 24us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.871773:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1783444547.871782:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1783444547.871808:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575438848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871831:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575438848:12345-0@lo:400:kworker.0 Request processed in 24us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.871836:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1783444547.871846:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1783444547.871851:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575438208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871874:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575438208:12345-0@lo:400:kworker.0 Request processed in 23us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.871880:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1783444547.871890:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1783444547.871895:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575437952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871924:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575437952:12345-0@lo:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.871930:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1783444547.871940:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1783444547.871946:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575438464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.871969:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575438464:12345-0@lo:400:kworker.0 Request processed in 23us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.871974:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1783444547.871985:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1783444547.871990:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575438080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872013:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1870073575438080:12345-0@lo:400:kworker.0 Request processed in 24us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.872019:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1783444547.872055:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575438720 00000100:00100000:0.0:1783444547.872064:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575438720 00000100:00100000:0.0:1783444547.872089:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575438592 00000100:00100000:0.0:1783444547.872092:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575438592 00000100:00100000:0.0:1783444547.872112:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1783444547.872119:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575438720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872146:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575438720:12345-0@lo:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.872152:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1783444547.872161:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1783444547.872165:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575438592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872186:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575438592:12345-0@lo:400:kworker.0 Request processed in 21us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444547.872191:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00080000:0.0:1783444547.872207:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444547.872211:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444547.872213:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444547.872215:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444547.872244:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1870073575438080:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872253:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575438592:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872260:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575437952:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872268:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575438464:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872296:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575438208:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872304:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575438720:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872313:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575437824:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872331:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575438336:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.872339:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575438848:0@lo:400:kworker.0 00000100:00100000:2.0:1783444547.873661:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575437696 00000100:00100000:2.0:1783444547.873671:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575437696 00000100:00100000:2.0:1783444547.873723:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783444547.873732:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c54d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575437696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444547.873808:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c54d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575437696:12345-0@lo:400:kworker.0 Request processed in 77us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444547.873816:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783444547.873863:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575437696:0@lo:400:kworker.0 00000100:00100000:0.0:1783444547.878923:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575438976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444547.878988:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444547.879333:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575438976 00000100:00100000:1.0:1783444547.879342:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575438976 00000100:00100000:1.0:1783444547.879396:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:1.0:1783444547.879406:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575438976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444547.879439:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444749312 avail 1298509824 00000100:00100000:1.0:1783444547.879500:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575438976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444547.879515:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:1.0:1783444547.879584:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575438976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444548.381391:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444548.381415:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575439104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444548.381506:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444548.381563:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575439104 00000100:00100000:3.0:1783444548.381571:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575439104 00000100:00100000:3.0:1783444548.381616:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1783444548.381626:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575439104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444548.381648:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444548.381700:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575439104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444548.381707:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1783444548.381935:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575439232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444548.381963:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444548.381996:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575439232 00000100:00100000:3.0:1783444548.382000:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575439232 00000100:00100000:3.0:1783444548.382021:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:3.0:1783444548.382028:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575439232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444548.382056:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444548.382089:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575439232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444548.382095:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:3.0:1783444548.382132:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575439232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444548.399273:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575439104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783444548.637132:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783444549.442299:0:95387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd95fa93a0 20000000:00000080:0.0:1783444549.442316:0:95387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9368e70de800 uarg=0000000000000000 00000040:00100000:0.0:1783444549.443147:0:95387:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:0.0:1783444549.443154:0:95387:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1783444549.443172:0:95387:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:2.0:1783444549.443541:0:95388:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 39 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:2.0:1783444549.443588:0:95388:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 39 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:2.0:1783444549.443606:0:95388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:0.0:1783444549.443887:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:0.0:1783444549.443963:0:95387:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:0.0:1783444549.443979:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:0.0:1783444549.443992:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:0.0:1783444549.444004:0:95387:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:2.0:1783444549.444288:0:95389:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 40 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:2.0:1783444549.444315:0:95389:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 40 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:2.0:1783444549.444326:0:95389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:0.0:1783444549.444454:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:0.0:1783444549.444463:0:95387:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:0.0:1783444549.444547:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:0.0:1783444549.444568:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:0.0:1783444549.444580:0:95387:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1783444549.446715:0:95390:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 41 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1783444549.446772:0:95390:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 41 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1783444549.447228:0:95390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:2.0:1783444549.447622:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:2.0:1783444549.447638:0:95387:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1783444549.447653:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:2.0:1783444549.447666:0:95387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:2.0:1783444549.447679:0:95387:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783444549.447698:0:95387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447716:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447725:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447732:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 23 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447753:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447760:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 23 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447768:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447774:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 23 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447781:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447969:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447981:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 9 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447988:0:95387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444549.447995:0:95387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.448177:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.448195:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 9 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.448209:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439360:192.168.204.20@tcp:104: 00010000:00010000:3.0:1783444549.448328:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 9 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.448337:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 9 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.448346:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439488:192.168.204.20@tcp:104: 00010000:00010000:3.0:1783444549.448392:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.448400:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 23 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.448409:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439616:0@lo:104: 00000100:00100000:3.0:1783444549.448450:0:95387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444549.448609:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.448618:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 23 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.448626:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439744:0@lo:104: 00000100:00100000:3.0:1783444549.448665:0:95387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444549.455974:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 23 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.455991:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 23 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.457074:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439872:0@lo:104: 00000100:00100000:3.0:1783444549.457136:0:95387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444549.459778:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444549.459882:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444549.459925:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557848832 00000100:00100000:0.0:1783444549.459934:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557848832 00010000:00010000:0.0:1783444549.459976:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 10 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.460038:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557848704 00000100:00100000:0.0:1783444549.460042:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557848704 00010000:00010000:0.0:1783444549.460057:0:6490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 11 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.460079:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2593 00000100:00100000:0.0:1783444549.460089:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28921b6e-3bc9-4a81-ae87-1992169ba754+11:2403:x1870073557848832:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.460103:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.460109:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 11 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.460119:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 11 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.460140:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.460186:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28921b6e-3bc9-4a81-ae87-1992169ba754+11:2403:x1870073557848832:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 99us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.460194:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2593 00000100:00100000:0.0:1783444549.460235:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2594 00000100:00100000:0.0:1783444549.460242:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557848704:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.460249:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.460254:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 10 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.460265:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 10 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.460285:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.460304:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557848704:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 62us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.460311:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2594 00000100:00100000:1.0:1783444549.462576:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575439616 00000100:00100000:1.0:1783444549.462590:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575439616 00000100:00100000:1.0:1783444549.462665:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575439744 00000100:00100000:1.0:1783444549.462669:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575439744 00000100:00100000:1.0:1783444549.462685:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783444549.462692:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95387:x1870073575439616:12345-0@lo:104: 00010000:00010000:1.0:1783444549.462708:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.462867:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444549.462874:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95387:x1870073575439616:12345-0@lo:104: Request processed in 182us (14424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444549.462881:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783444549.462909:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783444549.462915:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:95387:x1870073575439744:12345-0@lo:104: 00010000:00010000:1.0:1783444549.462923:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.466401:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.466420:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 23 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.466447:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440000:0@lo:104: 00000100:00100000:3.0:1783444549.466508:0:95387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444549.466538:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 23 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.466546:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 23 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.466556:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440128:0@lo:104: 00000100:00100000:3.0:1783444549.466597:0:95387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783444549.466827:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.466836:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 23 pid: 94359 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.466845:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440256:0@lo:104: 00010000:00010000:3.0:1783444549.466868:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 23 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.466876:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 23 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.466883:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440384:0@lo:104: 00010000:00010000:3.0:1783444549.466976:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.466984:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 23 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.466993:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440512:0@lo:104: 00010000:00010000:3.0:1783444549.467083:0:95387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 23 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.467091:0:95387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 23 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.467099:0:95387:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440640:0@lo:104: 00000100:00100000:3.0:1783444549.467125:0:95387:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491180 going to sleep for 11 seconds 00010000:00010000:3.0:1783444549.467149:0:95387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7645a00/0x42cb6883e3833ac4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e5b expref: 9 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.467164:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439360:192.168.204.20@tcp:104: 00010000:00010000:3.0:1783444549.467174:0:95387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c27c00/0x42cb6883e3833abd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e54 expref: 8 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.467182:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439488:192.168.204.20@tcp:104: 00000100:00100000:3.0:1783444549.467191:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439616:0@lo:104: 00000100:00100000:3.0:1783444549.467199:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439744:0@lo:104: 00000100:00100000:2.0:1783444549.467339:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783444549.467357:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444549.467378:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444549.467387:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444549.467394:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444549.467401:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1783444549.467407:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1783444549.468832:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575439872 00000100:00100000:3.0:1783444549.468842:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575439872 00000100:00100000:3.0:1783444549.468881:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1783444549.468889:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575440000 00000100:00100000:2.0:1783444549.469052:0:95391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575440128 00000100:00100000:2.0:1783444549.469056:0:95391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575440128 00000100:00100000:2.0:1783444549.469069:0:95391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575440256 00000100:00100000:2.0:1783444549.469071:0:95391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575440256 00000100:00100000:2.0:1783444549.469079:0:95391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575440384 00000100:00100000:2.0:1783444549.469081:0:95391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575440384 00000100:00100000:2.0:1783444549.469089:0:95391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575440512 00000100:00100000:2.0:1783444549.469091:0:95391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575440512 00000100:00100000:2.0:1783444549.469098:0:95391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575440640 00000100:00100000:2.0:1783444549.469100:0:95391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575440640 00000100:00100000:2.0:1783444549.469114:0:95391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1783444549.469122:0:95391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+9:95387:x1870073575439872:12345-0@lo:104: 00010000:00010000:2.0:1783444549.469137:0:95391:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444549.469221:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575440000 00000100:00100000:3.0:1783444549.469265:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575439872:0@lo:104: 00010000:00010000:0.0:1783444549.470215:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783444549.470224:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470233:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444549.470238:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470247:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444549.470255:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444549.470261:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444549.470302:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470309:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444549.470334:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470341:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71200/0x42cb6883e3833aaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833ab6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470370:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444549.470373:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470379:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444549.470383:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470390:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444549.470397:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444549.470403:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444549.470417:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470422:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444549.470452:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470460:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d71a00/0x42cb6883e3833aa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833aa8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470469:0:10323:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783444549.470483:0:10323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470500:0:10323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27400 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444549.470503:0:10323:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470520:0:10323:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444549.470528:0:10323:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444549.470533:0:10323:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783444549.470547:0:10323:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470553:0:10323:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783444549.470560:0:10323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470567:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833a93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a9a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.470576:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444549.470578:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444549.470580:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444549.470777:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575440768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.470846:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444549.470971:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575440896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.470996:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444549.471122:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444549.471129:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575441024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.471150:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444549.471181:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575440768 00000100:00100000:0.0:1783444549.471186:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575440768 00010000:00010000:0.0:1783444549.471212:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 24 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.471234:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575440896 00000100:00100000:0.0:1783444549.471237:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575440896 00010000:00010000:0.0:1783444549.471250:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 25 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.471265:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575441024 00000100:00100000:0.0:1783444549.471268:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575441024 00010000:00010000:0.0:1783444549.471279:0:6492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 26 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.471297:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:0.0:1783444549.471305:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+26:3634:x1870073575440768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.471317:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.471323:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 26 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.471333:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 26 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.471347:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ab6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833aaf expref: 26 pid: 94360 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.471360:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.471396:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3634:x1870073575440768:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.471403:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:0.0:1783444549.471419:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:0.0:1783444549.471425:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575440896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.471433:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.471436:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 24 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.471445:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 24 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.471456:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583e000/0x42cb6883e3833aa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833aa1 expref: 24 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.471464:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.472569:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3635:x1870073575440896:12345-0@lo:103:ldlm_bl.0 Request processed in 1141us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.472577:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:0.0:1783444549.472598:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1783444549.472678:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3635:x1870073575441024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.472689:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.472694:0:6492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.472705:0:6492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.472718:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583fc00/0x42cb6883e3833a9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833a93 expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.472738:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.472763:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3635:x1870073575441024:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.472769:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1783444549.472836:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575440768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444549.472920:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575441024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783444549.472928:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575440896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444549.473049:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783444549.473058:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+10:95387:x1870073575439744:12345-0@lo:104: Request processed in 10142us (24390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444549.473065:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783444549.473099:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783444549.473106:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c725f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:95387:x1870073575440128:12345-0@lo:104: 00010000:00010000:1.0:1783444549.473116:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473155:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444549.473160:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c725f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+9:95387:x1870073575440128:12345-0@lo:104: Request processed in 56us (6563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444549.473165:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:1.0:1783444549.473177:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444549.473182:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473189:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444549.473193:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473200:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444549.473207:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444549.473212:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444549.473237:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473243:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444549.473255:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473270:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c7645c00/0x42cb6883e3833a77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a7e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473279:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.473280:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.473282:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444549.473294:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1783444549.473300:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:95387:x1870073575440256:12345-0@lo:104: 00010000:00010000:1.0:1783444549.473307:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473336:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444549.473340:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+8:95387:x1870073575440256:12345-0@lo:104: Request processed in 41us (5983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444549.473345:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:1.0:1783444549.473355:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444549.473360:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473366:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27600 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444549.473369:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473376:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444549.473382:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444549.473397:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444549.473411:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473416:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444549.473422:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473441:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833a69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a70 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473450:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.473452:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.473453:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444549.473467:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783444549.473483:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:95387:x1870073575440384:12345-0@lo:104: 00010000:00010000:1.0:1783444549.473491:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473534:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444549.473539:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+7:95387:x1870073575440384:12345-0@lo:104: Request processed in 66us (6161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444549.473545:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783444549.473559:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1783444549.473565:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:95387:x1870073575440512:12345-0@lo:104: 00010000:00010000:1.0:1783444549.473572:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473626:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783444549.473632:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+6:95387:x1870073575440512:12345-0@lo:104: Request processed in 67us (6244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444549.473637:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:1.0:1783444549.473650:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783444549.473654:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473659:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444549.473662:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473668:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444549.473674:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444549.473680:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444549.473695:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473701:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444549.473713:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473720:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833a5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a62 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473738:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444549.473741:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473747:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444549.473749:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473756:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444549.473762:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444549.473768:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444549.473781:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473815:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444549.473822:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473828:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c7644000/0x42cb6883e3833a4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a54 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.473836:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.473838:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.473839:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444549.473863:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575441408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444549.473910:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444549.473938:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783444549.473943:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575441536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783444549.473960:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444549.473982:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1783444549.473989:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+5:95387:x1870073575440640:12345-0@lo:104: 00010000:00010000:1.0:1783444549.473996:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474024:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444549.474029:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+5:95387:x1870073575440640:12345-0@lo:104: Request processed in 42us (6634us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444549.474034:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:1.0:1783444549.474047:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444549.474051:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474057:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27e00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444549.474060:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474067:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444549.474072:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444549.474077:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444549.474094:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474104:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444549.474110:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474116:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833a3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a46 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474125:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.474126:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.474128:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444549.474144:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1783444549.474150:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95387:x1870073575440000:12345-0@lo:104: 00010000:00010000:1.0:1783444549.474157:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474188:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783444549.474193:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+4:95387:x1870073575440000:12345-0@lo:104: Request processed in 43us (7685us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444549.474199:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:1.0:1783444549.474211:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444549.474214:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474220:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70a00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:1.0:1783444549.474222:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474228:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444549.474239:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444549.474243:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783444549.474258:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474263:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444549.474268:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474273:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6d70a00/0x42cb6883e3833a85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833a8c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.474284:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.474286:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444549.474287:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444549.474654:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444549.474684:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440000:0@lo:104: 00000100:00100000:3.0:1783444549.474695:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440128:0@lo:104: 00000100:00100000:3.0:1783444549.474702:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440256:0@lo:104: 00000100:00100000:3.0:1783444549.474709:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440384:0@lo:104: 00000100:00100000:3.0:1783444549.474716:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440512:0@lo:104: 00000100:00100000:3.0:1783444549.474734:0:95387:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95387:1870073575440640:0@lo:104: 00010000:00010000:3.0:1783444549.474777:0:95387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.475178:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575441408 00000100:00100000:0.0:1783444549.475186:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575441408 00010000:00010000:0.0:1783444549.475209:0:8436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 21 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.475233:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575441536 00000100:00100000:0.0:1783444549.475236:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575441536 00010000:00010000:0.0:1783444549.475246:0:8436:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 22 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.475259:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:0.0:1783444549.475265:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3635:x1870073575441408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.475274:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.475278:0:8436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.475287:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.475298:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7645200/0x42cb6883e3833a62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833a5b expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.475310:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.475353:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3635:x1870073575441408:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.475359:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:0.0:1783444549.475374:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1783444549.475380:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3635:x1870073575441536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.475389:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.475393:0:8436:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 20 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.475402:0:8436:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 20 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.475412:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583f000/0x42cb6883e3833a54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833a4d expref: 20 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.475421:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.475455:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3635:x1870073575441536:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.475461:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1783444549.475491:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575441152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.475530:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444549.475555:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575441664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.475574:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444549.475590:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783444549.475595:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575441280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.475751:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444549.475768:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575441792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.475820:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444549.475845:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575441152 00000100:00100000:0.0:1783444549.475849:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575441152 00010000:00010000:0.0:1783444549.475863:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 19 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.475875:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575441664 00000100:00100000:0.0:1783444549.475878:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575441664 00010000:00010000:0.0:1783444549.475887:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 20 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.475961:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575441280 00000100:00100000:0.0:1783444549.475964:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575441280 00010000:00010000:0.0:1783444549.475974:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 21 pid: 94359 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.475983:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575441792 00000100:00100000:0.0:1783444549.475985:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575441792 00010000:00010000:0.0:1783444549.475992:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 22 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444549.476002:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1783444549.476071:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3633:x1870073575441152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.476082:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.476086:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476094:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476103:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d70400/0x42cb6883e3833a7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833a77 expref: 22 pid: 94361 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476117:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.476145:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575441152:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.476152:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1783444549.476184:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1783444549.476189:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+20:3633:x1870073575441664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.476195:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.476199:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 20 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476207:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 20 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476217:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6d71600/0x42cb6883e3833a46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833a3f expref: 20 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476226:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.476243:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+19:3633:x1870073575441664:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.476249:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1783444549.476259:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1783444549.476264:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+18:3633:x1870073575441280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.476270:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.476274:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 18 pid: 94359 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476281:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 18 pid: 94359 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476296:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c7644600/0x42cb6883e3833a70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833a69 expref: 18 pid: 94359 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476305:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.476323:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+17:3633:x1870073575441280:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.476328:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1783444549.476339:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:0.0:1783444549.476344:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+16:3633:x1870073575441792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.476350:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444549.476354:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 16 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476363:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 16 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476371:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583e400/0x42cb6883e3833a8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833a85 expref: 16 pid: 94365 timeout: 3640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476382:0:26215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476390:0:26215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476403:0:26215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476410:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.476421:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.477141:0:26215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.477148:0:26215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:0.0:1783444549.477152:0:26215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.477160:0:26215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.477172:0:26215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444549.477184:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444549.477218:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c89ab73b-dbb2-4305-b221-37cc64d61227+15:3633:x1870073575441792:12345-0@lo:103:ldlm_bl.0 Request processed in 873us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444549.477225:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:0.0:1783444549.477270:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575441536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.477280:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575441408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.477307:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575441280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.477314:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575441792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.477321:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575441152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444549.477326:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575441664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444549.477357:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444549.478028:0:95387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.478038:0:95387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444549.478044:0:95387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c6c26600/0x42cb6883e3833acb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444549.479484:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444549.479709:0:95391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1783444549.479721:0:95391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c89ab73b-dbb2-4305-b221-37cc64d61227+3:95387:x1870073575439872:12345-0@lo:104: Request processed in 10596us (22582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444549.479730:0:95391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:1.0:1783444549.663815:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444550.686208:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444551.245313:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444551.245401:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557848960 00000100:00100000:0.0:1783444551.245412:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557848960 00000100:00100000:0.0:1783444551.245584:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:0.0:1783444551.245595:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c54d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+8:70972:x1870073557848960:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444551.245611:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444551.245631:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7644600/0x42cb6883e3833ad2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e62 expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.245659:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7644600/0x42cb6883e3833ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e62 expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.245670:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7644600/0x42cb6883e3833ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e62 expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.245680:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7644600, rc 0) 00000100:00100000:0.0:1783444551.245822:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c54d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557848960:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 229us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.245838:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:3.0:1783444551.253517:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444551.253601:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557849088 00000100:00100000:2.0:1783444551.253610:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557849088 00000100:00100000:2.0:1783444551.253660:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:2.0:1783444551.253671:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c338a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557849088:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.254982:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c338a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557849088:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 1299us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.255014:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:3.0:1783444551.258150:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444551.258331:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557849216 00000100:00100000:2.0:1783444551.258343:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557849216 00000100:00100000:2.0:1783444551.258399:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:2.0:1783444551.258409:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557849216:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.258567:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557849216:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 158us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.258575:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:1.0:1783444551.263397:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444551.263668:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557849344 00000100:00100000:0.0:1783444551.263679:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557849344 00000100:00100000:0.0:1783444551.263746:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:0.0:1783444551.263758:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c338b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:73368:x1870073557849344:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783444551.264494:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c338b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+9:73368:x1870073557849344:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 735us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.264504:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:1.0:1783444551.282582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444551.282739:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557849472 00000100:00100000:2.0:1783444551.282750:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557849472 00000100:00100000:2.0:1783444551.282839:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:2.0:1783444551.282849:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:73368:x1870073557849472:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783444551.283367:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+9:73368:x1870073557849472:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 518us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.283376:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:0.0:1783444551.307884:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444551.310036:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557849600 00000100:00100000:2.0:1783444551.310051:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557849600 00000100:00100000:2.0:1783444551.310128:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:2.0:1783444551.310139:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557849600:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444551.310158:0:94361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444551.310178:0:94361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6c26400/0x42cb6883e3833ad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e69 expref: -99 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.310222:0:94361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6c26400/0x42cb6883e3833ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e69 expref: 10 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.310234:0:94361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6c26400/0x42cb6883e3833ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e69 expref: 10 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.310245:0:94361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26400, rc 0) 00000100:00100000:2.0:1783444551.313606:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557849600:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 3456us (7861us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.313619:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 134 10000000:01000000:2.0:1783444551.337697:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783444551.337706:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368dd221800 from 61 10000000:01000000:2.0:1783444551.337711:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783444551.337775:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.337821:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.337840:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.337866:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575441920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.338464:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.338525:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.338594:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575441920 00000100:00100000:0.0:1783444551.338603:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575441920 00000100:00100000:0.0:1783444551.338663:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783444551.338673:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+15:6503:x1870073575441920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444551.338702:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444551.338717:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833ae0 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.338742:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833ae0 expref: 16 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.338754:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833ae0 expref: 16 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.338773:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7644400, rc 0) 00000100:00100000:0.0:1783444551.338854:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575441920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.338861:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783444551.340238:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575441920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444551.340279:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833ae7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.340307:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833ae7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.340521:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.340571:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.340615:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.343712:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575442048 00000100:00100000:0.0:1783444551.343738:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575442048 00000100:00100000:0.0:1783444551.344228:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783444551.344242:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575442048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.344439:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575442048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.344447:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783444551.344567:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444551.344623:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444551.344679:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.346096:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444551.352612:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974300 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.359023:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575442176 00000100:00100000:3.0:1783444551.359048:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575442176 00000100:00100000:3.0:1783444551.359111:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557849728 00000100:00100000:3.0:1783444551.359115:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557849728 00000100:00100000:3.0:1783444551.359140:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783444551.359152:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575442176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.359386:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575442176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (14706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444551.359395:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783444551.359448:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:3.0:1783444551.359457:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557849728:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.359576:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557849728:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 120us (13492us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444551.359585:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:0.0:1783444551.364724:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.370824:0:95392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95392:1870073575442304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.370924:0:95392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.370989:0:95392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.372988:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575442304 00000100:00100000:0.0:1783444551.373000:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575442304 00000100:00100000:0.0:1783444551.373068:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783444551.373079:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:95392:x1870073575442304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444551.373253:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:95392:x1870073575442304:12345-0@lo:502:llog_process_th.0 Request processed in 175us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.373269:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783444551.374527:0:95392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95392:1870073575442304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.374606:0:95392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95392:1870073575442432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.374665:0:95392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.374710:0:95392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.377922:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575442432 00000100:00100000:0.0:1783444551.377937:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575442432 00000100:00100000:0.0:1783444551.378025:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783444551.378037:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:95392:x1870073575442432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444551.378217:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+16:95392:x1870073575442432:12345-0@lo:502:llog_process_th.0 Request processed in 183us (3551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.378225:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783444551.378533:0:95392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95392:1870073575442432:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783444551.378572:0:95392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783444551.378755:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783444551.378781:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444551.378840:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833ae7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.378853:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833ae7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444551.378863:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783444551.378865:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:2.0:1783444551.378868:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783444551.378901:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.378909:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.378918:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.378939:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.378991:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.379029:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9480 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.379372:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575442560 00000100:00100000:0.0:1783444551.379378:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575442560 00000100:00100000:0.0:1783444551.379418:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783444551.379426:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+16:6503:x1870073575442560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444551.379437:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444551.379451:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7645000/0x42cb6883e3833af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833aee expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.379472:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7645000/0x42cb6883e3833af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833aee expref: 17 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.379493:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7645000/0x42cb6883e3833af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833aee expref: 17 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.379501:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645000, rc 0) 00000100:00100000:0.0:1783444551.379543:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575442560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.379550:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783444551.379655:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444551.379668:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833af5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.379677:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833af5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444551.379742:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.379771:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.379785:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.382202:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575442688 00000100:00100000:0.0:1783444551.382232:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575442688 00000100:00100000:0.0:1783444551.382306:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783444551.382316:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575442688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.382507:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575442688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.382515:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783444551.382949:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.383012:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.383071:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.383098:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.383115:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575442816 00000100:00100000:3.0:1783444551.383119:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575442816 00000100:00100000:3.0:1783444551.383145:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783444551.383152:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575442816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.383242:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575442816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444551.383250:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783444551.383299:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575442816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.383508:0:95393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95393:1870073575442944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.383544:0:95393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.383563:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575442944 00000100:00100000:3.0:1783444551.383567:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575442944 00000100:00100000:3.0:1783444551.383585:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783444551.383590:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:95393:x1870073575442944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.383665:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:95393:x1870073575442944:12345-0@lo:502:llog_process_th.0 Request processed in 73us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444551.383672:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783444551.383702:0:95393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c7491d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.383714:0:95393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95393:1870073575442944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444551.383750:0:95393:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783444551.383761:0:95393:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444551.383764:0:95393:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:3.0:1783444551.383770:0:95393:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1783444551.384503:0:95393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95393:1870073575443072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.384550:0:95393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.384579:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575443072 00000100:00100000:3.0:1783444551.384584:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575443072 00000100:00100000:3.0:1783444551.384608:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783444551.384615:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:95393:x1870073575443072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.384689:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:95393:x1870073575443072:12345-0@lo:502:llog_process_th.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444551.384697:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783444551.384734:0:95393:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.384748:0:95393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95393:1870073575443072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783444551.384767:0:95393:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783444551.384771:0:95393:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444551.384773:0:95393:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:3.0:1783444551.384777:0:95393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:3.0:1783444551.384841:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:3.0:1783444551.384861:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783444551.384872:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833af5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.384883:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833af5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444551.384894:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783444551.384897:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef0cd800 from 61 10000000:01000000:3.0:1783444551.384900:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783444551.384921:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.384940:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.384949:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444551.384963:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.384988:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.385006:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.385018:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575443200 00000100:00100000:3.0:1783444551.385021:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575443200 00000100:00100000:3.0:1783444551.385038:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783444551.385044:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+17:6503:x1870073575443200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444551.385052:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444551.385062:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c6d71400/0x42cb6883e3833b03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833afc expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.385081:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c6d71400/0x42cb6883e3833b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833afc expref: 18 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.385092:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c6d71400/0x42cb6883e3833b03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833afc expref: 18 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.385101:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71400, rc 0) 00000100:00100000:3.0:1783444551.385128:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575443200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444551.385134:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783444551.385170:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444551.385181:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.385190:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444551.385231:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.385255:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.385266:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.385275:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575443328 00000100:00100000:3.0:1783444551.385278:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575443328 00000100:00100000:3.0:1783444551.385292:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783444551.385297:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575443328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.385370:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575443328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444551.385376:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783444551.385403:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.385429:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.385462:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.385491:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c9d260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.385502:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575443456 00000100:00100000:3.0:1783444551.385505:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575443456 00000100:00100000:3.0:1783444551.385522:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783444551.385526:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575443456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.385587:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575443456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444551.385599:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783444551.385632:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.389924:0:95394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95394:1870073575443584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444551.390027:0:95394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444551.390076:0:95394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368cadbd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444551.390206:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575443584 00000100:00100000:2.0:1783444551.390214:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575443584 00000100:00100000:2.0:1783444551.390272:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783444551.390283:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:95394:x1870073575443584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444551.390420:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:95394:x1870073575443584:12345-0@lo:502:llog_process_th.0 Request processed in 138us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.390427:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783444551.390658:0:95394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95394:1870073575443584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444551.390720:0:95394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95394:1870073575443712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444551.390770:0:95394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444551.390821:0:95394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c69746c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444551.391252:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575443712 00000100:00100000:2.0:1783444551.391259:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575443712 00000100:00100000:2.0:1783444551.391308:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783444551.391316:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:95394:x1870073575443712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444551.391399:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+18:95394:x1870073575443712:12345-0@lo:502:llog_process_th.0 Request processed in 83us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.391406:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783444551.391822:0:95394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95394:1870073575443712:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783444551.391865:0:95394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1783444551.392612:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1783444551.392647:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783444551.392659:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.392671:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444551.392684:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783444551.392686:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:2.0:1783444551.392689:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783444551.392733:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.392755:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.392766:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.392805:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.392864:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444551.392990:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575443840 00000100:00100000:0.0:1783444551.392997:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575443840 00000100:00100000:0.0:1783444551.393038:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783444551.393047:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+18:6503:x1870073575443840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444551.393059:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444551.393074:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7644800/0x42cb6883e3833b11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833b0a expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.393095:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7644800/0x42cb6883e3833b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833b0a expref: 19 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.393106:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7644800/0x42cb6883e3833b11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b0a expref: 19 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.393115:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7644800, rc 0) 00000100:00100000:0.0:1783444551.393146:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575443840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.393153:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783444551.393518:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444551.393540:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444551.393555:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.393563:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.393621:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.393650:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.393675:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def300 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.404087:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575443968 00000100:00100000:0.0:1783444551.404119:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575443968 00000100:00100000:0.0:1783444551.404191:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783444551.404202:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575443968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.404392:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575443968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (10740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.404399:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783444551.405446:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575443968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.405523:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575444096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.405583:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.405626:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444551.405647:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575444096 00000100:00100000:2.0:1783444551.405653:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575444096 00000100:00100000:2.0:1783444551.405703:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783444551.405712:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575444096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.405859:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575444096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.405865:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783444551.405919:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575444096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444551.406977:0:95395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95395:1870073575444224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444551.407038:0:95395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444551.407077:0:95395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974300 going to sleep for 11 seconds 00000100:00100000:2.0:1783444551.407484:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575444224 00000100:00100000:2.0:1783444551.407490:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575444224 00000100:00100000:2.0:1783444551.407537:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783444551.407545:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:95395:x1870073575444224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444551.407694:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:95395:x1870073575444224:12345-0@lo:502:llog_process_th.0 Request processed in 149us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.407702:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783444551.408698:0:95395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95395:1870073575444224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444551.408758:0:95395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444551.408773:0:95395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444551.408776:0:95395:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:1.0:1783444551.408783:0:95395:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1783444551.409291:0:95395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95395:1870073575444352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444551.409352:0:95395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444551.409400:0:95395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c6974540 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.409542:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575444352 00000100:00100000:0.0:1783444551.409549:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575444352 00000100:00100000:0.0:1783444551.409603:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783444551.409613:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:95395:x1870073575444352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444551.409745:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+19:95395:x1870073575444352:12345-0@lo:502:llog_process_th.0 Request processed in 133us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.409752:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783444551.410386:0:95395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95395:1870073575444352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783444551.410419:0:95395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444551.410426:0:95395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444551.410428:0:95395:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:1.0:1783444551.410432:0:95395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:2.0:1783444551.418416:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:2.0:1783444551.418467:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783444551.418490:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.418505:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444551.418518:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783444551.418521:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368f9acf800 from 61 10000000:01000000:2.0:1783444551.418523:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783444551.418568:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.418576:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.418603:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.418631:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575444480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.418700:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.418754:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4defe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.418872:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575444480 00000100:00100000:1.0:1783444551.418880:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575444480 00000100:00100000:1.0:1783444551.418938:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783444551.418959:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+19:6503:x1870073575444480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444551.418993:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444551.419007:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583e000/0x42cb6883e3833b1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833b18 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.419032:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583e000/0x42cb6883e3833b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833b18 expref: 20 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.419043:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583e000/0x42cb6883e3833b1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b18 expref: 20 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.419052:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583e000, rc 0) 00000100:00100000:1.0:1783444551.419104:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575444480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.419111:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783444551.419249:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575444480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444551.419276:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.419285:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444551.419346:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575444608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.419374:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.419405:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.420645:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575444608 00000100:00100000:1.0:1783444551.420655:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575444608 00000100:00100000:1.0:1783444551.420697:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783444551.420705:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575444608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444551.420911:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575444608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.420918:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783444551.421328:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575444608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.421379:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575444736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.421433:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.421465:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.421666:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575444736 00000100:00100000:1.0:1783444551.421672:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575444736 00000100:00100000:1.0:1783444551.421712:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783444551.421728:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575444736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444551.421850:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575444736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.421867:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783444551.422429:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575444736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.425545:0:95396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95396:1870073575444864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444551.425638:0:95396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.425691:0:95396:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4deff00 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.425835:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575444864 00000100:00100000:0.0:1783444551.425845:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575444864 00000100:00100000:0.0:1783444551.425905:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783444551.425915:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:95396:x1870073575444864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444551.426658:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+20:95396:x1870073575444864:12345-0@lo:502:llog_process_th.0 Request processed in 741us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.426668:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783444551.427276:0:95396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95396:1870073575444864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444551.427361:0:95396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95396:1870073575444992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783444551.427416:0:95396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.427450:0:95396:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4deff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.443669:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575444992 00000100:00100000:1.0:1783444551.443687:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575444992 00000100:00100000:1.0:1783444551.443765:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783444551.443777:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:95396:x1870073575444992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444551.444027:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+20:95396:x1870073575444992:12345-0@lo:502:llog_process_th.0 Request processed in 252us (16610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.444034:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783444551.446420:0:95396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95396:1870073575444992:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783444551.446483:0:95396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1783444551.446746:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1783444551.446771:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783444551.446782:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.446837:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444551.446868:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783444551.446871:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1783444551.446874:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783444551.446925:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.446949:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.446959:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444551.447415:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.447697:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.447752:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.447862:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575445120 00000100:00100000:1.0:1783444551.447870:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575445120 00000100:00100000:1.0:1783444551.448226:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783444551.448239:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+20:6503:x1870073575445120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444551.448256:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444551.448284:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583f200/0x42cb6883e3833b2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833b26 expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.448311:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583f200/0x42cb6883e3833b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833b26 expref: 21 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.448322:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583f200/0x42cb6883e3833b2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b26 expref: 21 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.448331:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f200, rc 0) 00000100:00100000:1.0:1783444551.448383:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c513e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575445120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.448450:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444551.448465:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.448486:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.448552:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.448594:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.448629:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4deff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.449035:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575445248 00000100:00100000:3.0:1783444551.449041:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575445248 00000100:00100000:1.0:1783444551.452455:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783444551.452719:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783444551.452742:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575445248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.453533:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c513e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575445248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 795us (4935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444551.453543:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783444551.453704:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.453767:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.454548:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.454590:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280900 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.454636:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575445376 00000100:00100000:0.0:1783444551.454643:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575445376 00000100:00100000:0.0:1783444551.454691:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783444551.454700:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575445376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.455385:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575445376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 685us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.455403:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783444551.455784:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444551.458456:0:95397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1783444551.458770:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1783444551.458833:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783444551.458846:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.458857:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444551.458866:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783444551.458869:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9368ef29c800 from 61 10000000:01000000:2.0:1783444551.458872:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783444551.458910:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.458917:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.458937:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.459288:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.459359:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.459394:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4defcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.459734:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575445504 00000100:00100000:1.0:1783444551.459749:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575445504 00000100:00100000:1.0:1783444551.459838:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783444551.459847:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:6503:x1870073575445504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444551.459860:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444551.459874:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583f800/0x42cb6883e3833b3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833b34 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.459910:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583f800/0x42cb6883e3833b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833b34 expref: 22 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.459921:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583f800/0x42cb6883e3833b3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b34 expref: 22 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.460401:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f800, rc 0) 00000100:00100000:1.0:1783444551.460461:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575445504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 615us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.460468:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783444551.460649:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444551.460665:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.460674:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.460749:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.460777:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.461389:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4defcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.461454:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575445632 00000100:00100000:1.0:1783444551.461460:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575445632 00000100:00100000:1.0:1783444551.461515:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783444551.461523:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575445632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444551.461662:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575445632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.461669:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783444551.462503:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.462562:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.462628:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.462655:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4defcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.462713:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575445760 00000100:00100000:1.0:1783444551.462718:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575445760 00000100:00100000:1.0:1783444551.462770:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783444551.462778:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575445760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.467507:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575445760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4718us (4867us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.467521:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783444551.467738:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575445760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.469231:0:95398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95398:1870073575445888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444551.469313:0:95398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444551.469353:0:95398:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0240 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.469537:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575445888 00000100:00100000:1.0:1783444551.469544:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575445888 00000100:00100000:1.0:1783444551.469596:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783444551.469605:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:95398:x1870073575445888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783444551.469743:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:95398:x1870073575445888:12345-0@lo:502:llog_process_th.0 Request processed in 137us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.469750:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783444551.470716:0:95398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95398:1870073575445888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.470811:0:95398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95398:1870073575446016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783444551.470872:0:95398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.470903:0:95398:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.472106:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575446016 00000100:00100000:0.0:1783444551.472115:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575446016 00000100:00100000:0.0:1783444551.472173:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783444551.472181:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:95398:x1870073575446016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783444551.472316:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:95398:x1870073575446016:12345-0@lo:502:llog_process_th.0 Request processed in 136us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.472324:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783444551.474044:0:95398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c89ab73b-dbb2-4305-b221-37cc64d61227:95398:1870073575446016:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783444551.474089:0:95398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1783444551.474390:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1783444551.474414:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783444551.474424:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.474436:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444551.474446:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783444551.474449:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1783444551.474452:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783444551.474496:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.474511:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.474521:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444551.474546:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.474604:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444551.474651:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.474710:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575446144 00000100:00100000:1.0:1783444551.474717:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575446144 00000100:00100000:1.0:1783444551.474771:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783444551.474780:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575446144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783444551.474816:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444551.474839:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583e600/0x42cb6883e3833b49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833b42 expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.474862:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583e600/0x42cb6883e3833b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833b42 expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.474874:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583e600/0x42cb6883e3833b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b42 expref: 23 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444551.474883:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583e600, rc 0) 00000100:00100000:1.0:1783444551.474937:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575446144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.474944:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783444551.475551:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444551.475567:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.475576:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444551.475639:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.475670:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.475691:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.478422:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575446272 00000100:00100000:1.0:1783444551.478442:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575446272 00000100:00100000:1.0:1783444551.478535:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783444551.478544:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575446272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783444551.478744:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575446272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.478751:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783444551.483246:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.483330:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783444551.483412:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444551.483451:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444551.484404:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575446400 00000100:00100000:1.0:1783444551.484412:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575446400 00000100:00100000:1.0:1783444551.484484:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783444551.484495:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c55d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575446400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783444551.484643:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c55d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575446400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444551.484651:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783444551.485534:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783444551.487908:0:95399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1783444551.493194:0:6503:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1783444551.493235:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783444551.493248:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.494211:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444551.494227:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783444551.494230:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9368c507b380 from 1 10000000:01000000:3.0:1783444551.494232:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783444551.494638:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.494648:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444551.494661:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444551.494705:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.494785:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444551.494923:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef280900 going to sleep for 11 seconds 00000100:00100000:0.0:1783444551.495455:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575446528 00000100:00100000:0.0:1783444551.495464:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575446528 00000100:00100000:0.0:1783444551.495526:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783444551.495535:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575446528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444551.495551:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444551.495565:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c7645600/0x42cb6883e3833b57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3833b50 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.495592:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c7645600/0x42cb6883e3833b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3833b50 expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.495602:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c7645600/0x42cb6883e3833b57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b50 expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.495618:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645600, rc 0) 00000100:00100000:0.0:1783444551.495669:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575446528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444551.495676:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783444551.496546:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783444551.496567:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.496577:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444551.496663:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783444551.496703:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444551.496746:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368c4def480 going to sleep for 11 seconds 00000100:00100000:3.0:1783444551.498022:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575446656 00000100:00100000:3.0:1783444551.498032:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575446656 00000100:00100000:3.0:1783444551.498084:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783444551.498094:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575446656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783444551.498210:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575446656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (1504us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783444551.498217:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783444551.498548:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575446656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783444551.498592:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783444551.498601:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444551.498610:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444551.711458:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444552.480013:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444552.480033:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575446784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783444552.480099:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444552.480145:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575446784 00000100:00100000:0.0:1783444552.480162:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575446784 00000100:00100000:0.0:1783444552.480213:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1783444552.480221:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575446784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783444552.480250:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444552.480286:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575446784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444552.480292:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00080000:0.0:1783444552.480310:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444552.480342:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575446784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444552.489572:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575446912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444552.489647:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444552.489706:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575446912 00000100:00100000:2.0:1783444552.489713:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575446912 00000100:00100000:2.0:1783444552.489751:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:2.0:1783444552.489759:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575446912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444552.489813:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:2.0:1783444552.489852:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575446912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.489858:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:2.0:1783444552.489899:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575446912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444552.491214:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444552.491230:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575447040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444552.491277:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444552.491319:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575447040 00000100:00100000:1.0:1783444552.491325:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575447040 00000100:00100000:1.0:1783444552.491370:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:1.0:1783444552.491378:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575447040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444552.491400:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444552.491441:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575447040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444552.491447:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00080000:1.0:1783444552.491484:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444552.491515:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575447040:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783444552.733984:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444552.780179:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444552.780217:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444552.780247:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444552.780264:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444552.780288:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444552.780314:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557850368 00000100:00100000:2.0:1783444552.780323:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557850368 00000100:00100000:2.0:1783444552.780367:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557850240 00000100:00100000:2.0:1783444552.780369:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557850240 00000100:00100000:2.0:1783444552.780390:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2557 00000100:00100000:2.0:1783444552.780398:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557850368:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444552.780477:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557850368:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.780484:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2557 00000100:00100000:2.0:1783444552.780499:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2558 00000100:00100000:2.0:1783444552.780505:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557850240:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444552.780527:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369005b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557850240:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.780532:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2558 00000100:00080000:2.0:1783444552.780550:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444552.780554:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783444552.780909:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557849856 00000100:00100000:3.0:1783444552.780914:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557849856 00000100:00100000:3.0:1783444552.780948:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:3.0:1783444552.780955:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557849856:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444552.780987:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557849856:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444552.780993:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:0.0:1783444552.781120:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557850112 00000100:00100000:0.0:1783444552.781124:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557850112 00000100:00100000:0.0:1783444552.781162:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557849984 00000100:00100000:0.0:1783444552.781165:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557849984 00000100:00100000:0.0:1783444552.781184:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1180 00000100:00100000:0.0:1783444552.781191:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557850112:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444552.781220:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557850112:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444552.781234:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1180 00000100:00100000:0.0:1783444552.781246:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1181 00000100:00100000:0.0:1783444552.781251:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2403:x1870073557849984:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444552.781273:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2403:x1870073557849984:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444552.781279:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1181 00000100:00080000:3.0:1783444552.783141:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444552.783148:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444552.989191:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783444552.989222:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575447168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444552.989294:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444552.989342:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575447168 00000100:00100000:1.0:1783444552.989350:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575447168 00000100:00100000:1.0:1783444552.989397:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:1.0:1783444552.989421:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575447168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783444552.989468:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444773888 avail 1298534400 00000100:00100000:1.0:1783444552.989516:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575447168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444552.989524:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00100000:1.0:1783444552.989569:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367cadac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575447168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444552.990522:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575447296:0@lo:400:kworker.0 00000100:00100000:0.0:1783444552.990572:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444552.990604:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575447808:0@lo:400:kworker.0 00000100:00100000:0.0:1783444552.990629:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444552.990644:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575448320:0@lo:400:kworker.0 00000100:00100000:0.0:1783444552.990665:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444552.990683:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783444552.990689:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575447424:0@lo:400:kworker.0 00000100:00100000:0.0:1783444552.990709:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444552.990723:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575447936:0@lo:400:kworker.0 00000100:00100000:0.0:1783444552.990744:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444552.990763:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575448448:0@lo:400:kworker.0 00000100:00100000:0.0:1783444552.990784:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444552.990836:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575447936 00000100:00100000:0.0:1783444552.990842:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575447936 00000100:00100000:0.0:1783444552.990878:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575448448 00000100:00100000:0.0:1783444552.990881:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575448448 00000100:00100000:0.0:1783444552.990922:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:2.0:1783444552.991583:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575447680:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.991619:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444552.991641:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575448192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.991662:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444552.991679:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575448704:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.991700:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444552.991731:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783444552.991738:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575447552:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.991760:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444552.991777:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575448064:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.991814:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444552.991830:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575448576:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.991849:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444552.991873:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575448320 00000100:00100000:2.0:1783444552.991877:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575448320 00000100:00100000:2.0:1783444552.991908:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:2.0:1783444552.991916:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575448320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.991978:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575448320:12345-0@lo:400:kworker.0 Request processed in 62us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.991996:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:2.0:1783444552.992020:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575447808 00000100:00100000:2.0:1783444552.992024:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575447808 00000100:00100000:2.0:1783444552.992041:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575447424 00000100:00100000:2.0:1783444552.992044:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575447424 00000100:00100000:2.0:1783444552.992055:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575447680 00000100:00100000:2.0:1783444552.992057:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575447680 00000100:00100000:2.0:1783444552.992067:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1783444552.992073:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575447808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.992102:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575447808:12345-0@lo:400:kworker.0 Request processed in 29us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.992108:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:2.0:1783444552.992117:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575448192 00000100:00100000:2.0:1783444552.992120:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575448192 00000100:00100000:2.0:1783444552.992131:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575448704 00000100:00100000:2.0:1783444552.992139:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575448704 00000100:00100000:2.0:1783444552.992153:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575447552 00000100:00100000:2.0:1783444552.992156:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575447552 00000100:00100000:2.0:1783444552.992171:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1783444552.992176:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575447424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.992207:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575447424:12345-0@lo:400:kworker.0 Request processed in 30us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.992213:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1783444552.992224:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1783444552.992230:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575447680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.992259:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575447680:12345-0@lo:400:kworker.0 Request processed in 29us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.992265:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1783444552.992276:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1783444552.992281:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575448192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.992306:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575448192:12345-0@lo:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.992311:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1783444552.992322:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1783444552.992328:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575448704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.992354:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575448704:12345-0@lo:400:kworker.0 Request processed in 26us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444552.992360:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1783444552.992372:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1783444552.992378:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575447552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.992403:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575447552:12345-0@lo:400:kworker.0 Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444552.993135:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575447296 00000100:00100000:1.0:1783444552.993142:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575447296 00000100:00100000:1.0:1783444552.993179:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783444552.993186:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575447296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444552.993228:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575447296:12345-0@lo:400:kworker.0 Request processed in 43us (2656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444552.993235:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783444552.993268:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575448064 00000100:00100000:1.0:1783444552.993271:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575448064 00000100:00100000:1.0:1783444552.993292:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575448576 00000100:00100000:1.0:1783444552.993294:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575448576 00000100:00100000:1.0:1783444552.993315:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1783444552.993322:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575448448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444552.993354:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575448448:12345-0@lo:400:kworker.0 Request processed in 33us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444552.993360:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1783444552.993385:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1783444552.993392:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575448064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444552.993440:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575448064:12345-0@lo:400:kworker.0 Request processed in 49us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444552.993456:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1783444552.993467:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1783444552.993473:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575448576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444552.993500:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575448576:12345-0@lo:400:kworker.0 Request processed in 28us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444552.993506:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:2.0:1783444552.993678:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1783444552.993811:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575447424:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993825:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c32ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575448448:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993835:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575447296:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993844:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575447808:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993854:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575448320:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993894:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575447552:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993904:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575448064:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993914:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575448576:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993924:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575447680:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993933:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575448192:0@lo:400:kworker.0 00000100:00100000:2.0:1783444552.993954:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575448704:0@lo:400:kworker.0 00000100:00100000:0.0:1783444552.994549:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575447936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444552.994616:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575447936:12345-0@lo:400:kworker.0 Request processed in 3676us (3870us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444552.994624:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00080000:2.0:1783444552.995832:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444552.995841:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444552.995844:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444552.995847:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444552.995891:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575447936:0@lo:400:kworker.0 00000100:00100000:0.0:1783444553.501073:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444553.501100:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575448832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444553.501184:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444553.501282:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575448832 00000100:00100000:3.0:1783444553.501290:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575448832 00000100:00100000:3.0:1783444553.501353:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1783444553.501363:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575448832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444553.501388:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444553.501452:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575448832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444553.501473:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1783444553.501618:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575448832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444553.501933:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575448960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444553.501963:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444553.502066:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575448960 00000100:00100000:1.0:1783444553.502071:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575448960 00000100:00100000:1.0:1783444553.502106:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1783444553.502114:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575448960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444553.502137:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444553.502182:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575448960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444553.502188:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1783444553.502258:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575448960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783444553.757298:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444554.781624:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444555.805379:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783444556.149732:0:95497:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 13:15:54 (1783444554) 00000100:00100000:3.0:1783444556.241630:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.241665:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557850624 00000100:00100000:3.0:1783444556.241674:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557850624 00000100:00100000:3.0:1783444556.241730:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1454 00000100:00100000:3.0:1783444556.241740:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+10:73550:x1870073557850624:12345-192.168.204.20@tcp:36:mkdir.0 00010000:00010000:3.0:1783444556.241816:0:66223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444556.241844:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e383396d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e0e expref: 10 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.241864:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:3.0:1783444556.241869:0:66223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444556.242439:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.242457:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.242467:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.242483:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.242491:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.242498:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783444556.243376:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783444556.252472:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252494:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252505:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.252525:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000086bce31 reply state 000000001c0ef395 transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252537:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252546:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444556.252549:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.252554:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783444556.252560:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1783444556.252571:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252577:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252583:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252590:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252596:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444556.252611:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252619:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252630:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:3.0:1783444556.252632:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444556.252636:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252643:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833b5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.252655:0:66223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000086bce31 reply state 000000001c0ef395 transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252663:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.252670:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9368d40f4e00) 00010000:00010000:3.0:1783444556.252672:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.252674:0:66223:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783444556.252812:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+11:73550:x1870073557850624:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 11069us (11185us total) trans 124554051585 rc 0/0 00000100:00100000:3.0:1783444556.252822:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1454 00000100:00100000:3.0:1783444556.277359:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.277484:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557850752 00000100:00100000:0.0:1783444556.277496:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557850752 00000100:00100000:0.0:1783444556.277558:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1455 00000100:00100000:0.0:1783444556.277569:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:73551:x1870073557850752:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444556.277595:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444556.277615:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e70 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.277679:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833b7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.277695:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.277721:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444556.277769:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444556.277773:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444556.277821:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.277850:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e70 expref: 13 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.277871:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833b7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e70 expref: 12 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.277880:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444556.277883:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444556.277887:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645c00, rc 0) 00000100:00100000:0.0:1783444556.277953:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+12:73551:x1870073557850752:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 386us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444556.277961:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1455 00000100:00100000:1.0:1783444556.286544:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.286618:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557851008 00000100:00100000:0.0:1783444556.286627:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557851008 00000100:00100000:0.0:1783444556.286686:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1456 00000100:00100000:0.0:1783444556.286696:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+12:73551:x1870073557851008:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444556.286716:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444556.286720:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783444556.286744:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833b7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e70 expref: 12 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.286781:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444556.286811:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444556.286826:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644000/0x42cb6883e3833b81 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e77 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.286967:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.286988:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.286998:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287010:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287017:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287024:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287080:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287087:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287094:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444556.287109:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1783444556.287122:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287130:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287137:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287143:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.287147:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287155:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287164:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444556.287167:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.287171:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287176:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833b96 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287190:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287196:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287202:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287214:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287219:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.287222:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287229:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287237:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444556.287239:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.287257:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287263:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833b88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287273:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287279:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287285:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287291:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.287294:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287309:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287317:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9368d40f4e00) 00010000:00010000:0.0:1783444556.287319:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.287322:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287328:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833b8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287351:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644000/0x42cb6883e3833b81 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e77 expref: 12 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287359:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444556.287362:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.287366:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644000/0x42cb6883e3833b81 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e77 expref: 12 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.287374:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7644000, rc 0) 00000100:00100000:0.0:1783444556.287440:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:73551:x1870073557851008:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 745us (904us total) trans 0 rc 301/301 00000100:00100000:0.0:1783444556.287448:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1456 00000100:00100000:2.0:1783444556.295073:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.295285:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557851136 00000100:00100000:0.0:1783444556.295297:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557851136 00000100:00100000:0.0:1783444556.295366:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1457 00000100:00100000:0.0:1783444556.295377:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+11:73551:x1870073557851136:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1783444556.295418:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444556.295440:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833b9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e7e expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.295505:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645800/0x42cb6883e3833ba4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.295519:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645800/0x42cb6883e3833ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.295530:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645800/0x42cb6883e3833ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444556.295576:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444556.295580:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444556.295600:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645800/0x42cb6883e3833ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.295625:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833b9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e7e expref: 13 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.295644:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645800/0x42cb6883e3833ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e7e expref: 12 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.295653:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444556.295655:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444556.295659:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645800, rc 0) 00000100:00100000:0.0:1783444556.295722:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+12:73551:x1870073557851136:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 347us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444556.295729:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1457 00000100:00100000:3.0:1783444556.307914:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.308618:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557851392 00000100:00100000:2.0:1783444556.308629:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557851392 00000100:00100000:2.0:1783444556.308702:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1458 00000100:00100000:2.0:1783444556.308713:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+12:73551:x1870073557851392:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1783444556.308732:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444556.308753:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e85 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.308855:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.308869:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.308891:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.308903:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.308910:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.308918:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444556.309232:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1783444556.309449:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309458:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309464:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309475:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309480:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444556.309485:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309493:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309505:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:2.0:1783444556.309508:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444556.309511:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309517:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309528:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309533:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309537:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309540:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444556.309543:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309556:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309562:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9368d40f4e00) 00010000:00010000:2.0:1783444556.309564:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444556.309567:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309572:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833bb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309604:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833bab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e85 expref: 14 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309614:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:2.0:1783444556.309617:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783444556.309620:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e85 expref: 14 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.309629:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26600, rc 0) 00000100:00100000:2.0:1783444556.309685:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+13:73551:x1870073557851392:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 974us (1783us total) trans 124554051586 rc 301/301 00000100:00100000:2.0:1783444556.309692:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1458 00000100:00100000:2.0:1783444556.315049:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.315176:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557851648 00000100:00100000:0.0:1783444556.315185:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557851648 00000100:00100000:0.0:1783444556.315237:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1459 00000100:00100000:0.0:1783444556.315255:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+13:73551:x1870073557851648:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1783444556.315330:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.315355:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.315367:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.315506:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff421dc4 reply state 00000000602bf2f3 transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.315520:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.315527:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444556.315530:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1783444556.315534:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783444556.315540:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000100:00100000:0.0:1783444556.315605:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+15:73551:x1870073557851648:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 358us (562us total) trans 124554051587 rc 0/0 00000100:00100000:0.0:1783444556.315612:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1459 00000100:00100000:3.0:1783444556.318311:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.318442:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557851904 00000100:00100000:1.0:1783444556.318450:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557851904 00000100:00100000:1.0:1783444556.318496:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 245 00000100:00100000:1.0:1783444556.318505:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+15:73551:x1870073557851904:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1783444556.318691:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+16:73551:x1870073557851904:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 185us (385us total) trans 124554051588 rc 0/0 00000100:00100000:1.0:1783444556.318709:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 245 00000100:00100000:3.0:1783444556.332788:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.336657:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557852032 00000100:00100000:0.0:1783444556.336670:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557852032 00000100:00100000:1.0:1783444556.336860:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1460 00000100:00100000:1.0:1783444556.336869:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+16:73552:x1870073557852032:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.336893:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.336912:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833bce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e8c expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.336989:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337004:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337015:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337026:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337033:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337039:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337111:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ee00/0x42cb6883e3833be3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337119:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ee00/0x42cb6883e3833be3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337137:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ee00/0x42cb6883e3833be3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444556.337173:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1783444556.337177:0:67017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444556.337207:0:67017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ee00/0x42cb6883e3833be3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337219:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337225:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337231:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337237:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337242:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.337392:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337403:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337416:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:1.0:1783444556.337419:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.337424:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337440:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833bd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337452:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337458:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337464:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337469:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fe00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.337472:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337478:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337486:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9368d40f4e00) 00010000:00010000:1.0:1783444556.337489:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.337492:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337499:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833bdc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337526:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833bce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e8c expref: 18 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.337550:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ee00/0x42cb6883e3833be3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e8c expref: 17 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.338089:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.338092:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783444556.338094:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583ee00, rc 0) 00000100:00100000:1.0:1783444556.338158:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+17:73552:x1870073557852032:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1288us (5377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444556.338166:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1460 00000100:00100000:2.0:1783444556.345103:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.349112:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557852288 00000100:00100000:0.0:1783444556.349123:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557852288 00000100:00100000:0.0:1783444556.349216:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1461 00000100:00100000:0.0:1783444556.349232:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+17:73552:x1870073557852288:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444556.349259:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444556.349278:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833bea lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e93 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349376:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349404:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349415:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349429:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349436:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349442:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783444556.349706:0:66226:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x323:0x0], count =95 00000004:00080000:0.0:1783444556.349713:0:66226:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x323:0x0]+95 in llog 00000004:00080000:0.0:1783444556.349729:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x382:0x0], index 0: 0 00010000:00010000:0.0:1783444556.349878:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833bff lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349888:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833bff lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349905:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833bff lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349948:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349956:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.349962:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351163:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351174:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.351179:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351187:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351201:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444556.351204:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.351208:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351216:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833bf1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.351233:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d83f780c reply state 00000000b6649412 transno 124554051589 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351419:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351427:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff9368f57c6a00) 00010000:00010000:0.0:1783444556.351430:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.351433:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783444556.351470:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833bea lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e93 expref: 20 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351485:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833bff lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e93 expref: 19 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.351493:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:0.0:1783444556.351495:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444556.351497:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645c00, rc 0) 00000100:00100000:0.0:1783444556.351568:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+20:73552:x1870073557852288:12345-192.168.204.20@tcp:101:touch.0 Request processed in 2337us (6474us total) trans 124554051589 rc 0/0 00000100:00100000:0.0:1783444556.351577:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1461 00000100:00100000:1.0:1783444556.356754:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.356905:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557852544 00000100:00100000:3.0:1783444556.356928:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557852544 00000100:00100000:3.0:1783444556.356992:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1462 00000100:00100000:3.0:1783444556.357002:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+20:73552:x1870073557852544:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:3.0:1783444556.357057:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444556.357080:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833bff lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e93 expref: 20 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.357099:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:3.0:1783444556.357109:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444556.357154:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.357166:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.357176:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.357284:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c281cbfe reply state 000000000f75c352 transno 124554051590 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.357297:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.357303:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368d40f4900) 00010000:00010000:3.0:1783444556.357306:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.357308:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444556.357619:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+21:73552:x1870073557852544:12345-192.168.204.20@tcp:36:touch.0 Request processed in 617us (871us total) trans 124554051590 rc 0/0 00000100:00100000:3.0:1783444556.357627:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1462 00000100:00100000:3.0:1783444556.361335:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.361375:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557852672 00000100:00100000:3.0:1783444556.361392:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557852672 00000100:00100000:3.0:1783444556.361440:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1463 00000100:00100000:3.0:1783444556.361450:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+21:73552:x1870073557852672:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.361473:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.361491:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e3833c14 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939e9a expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.361539:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e3833c14 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e9a expref: 22 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.361554:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71800/0x42cb6883e3833c14 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e9a expref: 22 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.361571:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368d40f4900) 00010000:00010000:3.0:1783444556.361575:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444556.361579:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71800, rc 0) 00000100:00100000:3.0:1783444556.361624:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+22:73552:x1870073557852672:12345-192.168.204.20@tcp:101:touch.0 Request processed in 175us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444556.361631:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1463 00000100:00100000:2.0:1783444556.374110:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.377605:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557852800 00000100:00100000:1.0:1783444556.377616:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557852800 00000100:00100000:1.0:1783444556.377673:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5925 00000100:00100000:1.0:1783444556.377683:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557852800:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444556.377931:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2403:x1870073557852800:12345-192.168.204.20@tcp:2:touch.0 Request processed in 249us (3829us total) trans 4294969455 rc 0/0 00000100:00100000:1.0:1783444556.377939:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5925 00000100:00080000:2.0:1783444556.378584:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444556.384676:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.387748:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557853056 00000100:00100000:0.0:1783444556.387761:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557853056 00000100:00100000:0.0:1783444556.387917:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 246 00000100:00100000:0.0:1783444556.387934:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+22:73552:x1870073557853056:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:0.0:1783444556.388608:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+23:73552:x1870073557853056:12345-192.168.204.20@tcp:35:touch.0 Request processed in 674us (3938us total) trans 124554051591 rc 0/0 00000100:00100000:0.0:1783444556.388616:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 246 00000001:00080000:2.0:1783444556.390236:0:94354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051591 is committed 00010000:00010000:0.0:1783444556.394214:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394237:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394258:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394265:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.394270:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394279:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394295:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9368d40f4e00) 00010000:00010000:0.0:1783444556.394299:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.394304:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394310:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833b65 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394332:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394338:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394350:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394355:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.394365:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394372:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394390:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444556.394393:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.394397:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394404:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833b6c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394420:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394427:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394433:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394437:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.394440:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394446:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394454:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444556.394457:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783444556.394465:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394472:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833bc7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394485:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394492:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394498:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394503:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.394506:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394512:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394520:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff9368f57c6a00) 00010000:00010000:0.0:1783444556.394522:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.394525:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394531:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833bf8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394545:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394562:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394568:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394573:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.394576:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394582:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394590:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368d40f4900) 00010000:00010000:0.0:1783444556.394592:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.394595:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.394601:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833c0d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444556.405611:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.405680:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557853312 00000100:00100000:2.0:1783444556.405689:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557853312 00000100:00100000:2.0:1783444556.405744:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1464 00000100:00100000:2.0:1783444556.405753:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+12:73552:x1870073557853312:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:2.0:1783444556.405776:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444556.405817:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833c1b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ea1 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.406066:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.406080:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.406091:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.406105:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.406112:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.406118:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783444556.410639:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x383:0x0], index 0: 0 00010000:00010000:2.0:1783444556.410864:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833c30 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.410882:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833c30 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.410907:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833c30 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.410963:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.410983:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.410989:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.410995:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.411002:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444556.411007:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.411014:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.411028:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:2.0:1783444556.411031:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444556.411036:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.411043:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833c22 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444556.413929:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000386ef4c8 reply state 00000000a86c8047 transno 124554051592 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.413961:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.414139:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff9368c59a7900) 00010000:00010000:2.0:1783444556.414144:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444556.414148:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783444556.414199:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833c1b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ea1 expref: 15 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.414217:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833c30 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ea1 expref: 14 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.414225:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:2.0:1783444556.414227:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783444556.414229:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c27a00, rc 0) 00000100:00100000:2.0:1783444556.414478:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+15:73552:x1870073557853312:12345-192.168.204.20@tcp:101:touch.0 Request processed in 8585us (8734us total) trans 124554051592 rc 0/0 00000100:00100000:2.0:1783444556.414488:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1464 00000100:00100000:3.0:1783444556.417660:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.417831:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557853568 00000100:00100000:2.0:1783444556.417841:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557853568 00000100:00100000:2.0:1783444556.417896:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1465 00000100:00100000:2.0:1783444556.417905:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+15:73552:x1870073557853568:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:2.0:1783444556.417973:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444556.417998:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833c30 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ea1 expref: 15 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.418014:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:2.0:1783444556.418030:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444556.418077:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.418090:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.418100:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444556.418198:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c719098c reply state 000000004e650d69 transno 124554051593 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.418211:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.418217:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7300) 00010000:00010000:2.0:1783444556.418220:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444556.418222:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444556.418299:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+16:73552:x1870073557853568:12345-192.168.204.20@tcp:36:touch.0 Request processed in 395us (647us total) trans 124554051593 rc 0/0 00000100:00100000:2.0:1783444556.418307:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1465 00000100:00100000:1.0:1783444556.422186:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.434279:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557853696 00000100:00100000:2.0:1783444556.434290:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557853696 00000100:00100000:2.0:1783444556.434702:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1466 00000100:00100000:2.0:1783444556.434711:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+16:73552:x1870073557853696:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:2.0:1783444556.434733:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444556.434751:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e3833c45 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ea8 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.434825:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e3833c45 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ea8 expref: 17 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.434848:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030e00/0x42cb6883e3833c45 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ea8 expref: 17 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.434866:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7300) 00010000:00010000:2.0:1783444556.434870:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783444556.434874:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c0030e00, rc 0) 00000100:00100000:2.0:1783444556.434942:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+17:73552:x1870073557853696:12345-192.168.204.20@tcp:101:touch.0 Request processed in 231us (12761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444556.434949:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1466 00000100:00100000:3.0:1783444556.445758:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.445855:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557853824 00000100:00100000:1.0:1783444556.445865:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557853824 00000100:00100000:1.0:1783444556.445926:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5926 00000100:00100000:1.0:1783444556.445936:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2404:x1870073557853824:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444556.446131:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557853824:12345-192.168.204.20@tcp:2:touch.0 Request processed in 196us (381us total) trans 4294969456 rc 0/0 00000100:00100000:1.0:1783444556.446150:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5926 00000100:00100000:1.0:1783444556.468134:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.468222:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557854080 00000100:00100000:3.0:1783444556.468232:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557854080 00000100:00100000:3.0:1783444556.468297:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 247 00000100:00100000:3.0:1783444556.468307:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+17:73552:x1870073557854080:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.468606:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+18:73552:x1870073557854080:12345-192.168.204.20@tcp:35:touch.0 Request processed in 300us (480us total) trans 124554051594 rc 0/0 00000100:00100000:3.0:1783444556.468614:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 247 00000100:00100000:1.0:1783444556.475095:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.475127:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557854336 00000100:00100000:1.0:1783444556.475136:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557854336 00000100:00100000:1.0:1783444556.475201:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1467 00000100:00100000:1.0:1783444556.475210:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+18:73552:x1870073557854336:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.475234:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.475265:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833c4c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939eaf expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.475584:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.475600:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.475611:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.475624:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.475631:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.475637:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.475922:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x384:0x0], index 0: 0 00010000:00010000:1.0:1783444556.477827:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833c61 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477841:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833c61 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477852:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833c61 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477885:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477893:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477899:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477906:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477912:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.477916:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477936:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.477949:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.477952:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.477957:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.480446:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c53 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.480466:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000264d1fa3 reply state 0000000005319be5 transno 124554051595 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.480480:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.480488:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff9367c98c8500) 00010000:00010000:1.0:1783444556.480491:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.480495:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.480537:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833c4c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939eaf expref: 21 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.480559:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833c61 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939eaf expref: 20 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.480566:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9367c98c8e00) 00010000:00010000:1.0:1783444556.480568:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.480570:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583ea00, rc 0) 00000100:00100000:1.0:1783444556.480630:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+21:73552:x1870073557854336:12345-192.168.204.20@tcp:101:touch.0 Request processed in 5421us (5543us total) trans 124554051595 rc 0/0 00000100:00100000:1.0:1783444556.480639:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1467 00000100:00100000:0.0:1783444556.494528:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.494565:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557854592 00000100:00100000:0.0:1783444556.494574:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557854592 00000100:00100000:0.0:1783444556.494627:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1468 00000100:00100000:0.0:1783444556.494637:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+21:73552:x1870073557854592:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:0.0:1783444556.494696:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444556.494721:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833c61 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939eaf expref: 21 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.494758:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9367c98c8e00) 00010000:00010000:0.0:1783444556.494769:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444556.494846:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.494859:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.494869:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.495742:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000540e141d reply state 0000000035329706 transno 124554051596 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.495754:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.495760:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9368f57c6a00) 00010000:00010000:0.0:1783444556.495763:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.495765:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444556.495876:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+22:73552:x1870073557854592:12345-192.168.204.20@tcp:36:touch.0 Request processed in 1240us (1358us total) trans 124554051596 rc 0/0 00000100:00100000:0.0:1783444556.495884:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1468 00000100:00100000:3.0:1783444556.499225:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.502290:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557854720 00000100:00100000:3.0:1783444556.502304:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557854720 00000100:00100000:3.0:1783444556.503540:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1469 00000100:00100000:3.0:1783444556.503554:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+22:73552:x1870073557854720:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.503581:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.503601:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70a00/0x42cb6883e3833c76 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939eb6 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.503658:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70a00/0x42cb6883e3833c76 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939eb6 expref: 23 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.503673:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70a00/0x42cb6883e3833c76 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939eb6 expref: 23 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.503707:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9368f57c6a00) 00010000:00010000:3.0:1783444556.503710:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444556.503714:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70a00, rc 0) 00000100:00100000:3.0:1783444556.503770:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+23:73552:x1870073557854720:12345-192.168.204.20@tcp:101:touch.0 Request processed in 221us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444556.503777:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1469 00000100:00100000:1.0:1783444556.511299:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.511489:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557854848 00000100:00100000:3.0:1783444556.511499:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557854848 00000100:00100000:3.0:1783444556.511568:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5927 00000100:00100000:3.0:1783444556.511577:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557854848:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:3.0:1783444556.511771:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557854848:12345-192.168.204.20@tcp:2:touch.0 Request processed in 195us (481us total) trans 4294969457 rc 0/0 00000100:00100000:3.0:1783444556.511779:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5927 00000100:00100000:3.0:1783444556.542519:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.542747:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557855104 00000100:00100000:1.0:1783444556.542758:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557855104 00000100:00100000:1.0:1783444556.542826:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 248 00000100:00100000:1.0:1783444556.542851:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+23:73552:x1870073557855104:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:1.0:1783444556.543135:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+24:73552:x1870073557855104:12345-192.168.204.20@tcp:35:touch.0 Request processed in 285us (625us total) trans 124554051597 rc 0/0 00000100:00100000:1.0:1783444556.543143:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 248 00000100:00100000:3.0:1783444556.545356:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.545757:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557855360 00000100:00100000:1.0:1783444556.545765:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557855360 00000100:00100000:1.0:1783444556.545826:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1470 00000100:00100000:1.0:1783444556.545835:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+24:73552:x1870073557855360:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.545854:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.545880:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c7d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ebd expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.546060:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.546075:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.546086:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.546099:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.546106:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.546112:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.546676:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x385:0x0], index 0: 0 00010000:00010000:1.0:1783444556.547058:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833c92 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547069:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833c92 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547078:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833c92 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547112:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547120:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547126:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547133:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547139:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.547143:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547150:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547162:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.547165:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.547176:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547183:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833c84 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.547199:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e4e0c20 reply state 00000000373dc185 transno 124554051598 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547211:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547217:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff9367c98c8800) 00010000:00010000:1.0:1783444556.547220:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.547222:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.547422:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833c7d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ebd expref: 27 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547438:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833c92 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ebd expref: 26 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.547446:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:1.0:1783444556.547449:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.547451:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f000, rc 0) 00000100:00100000:1.0:1783444556.547509:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+27:73552:x1870073557855360:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1675us (2165us total) trans 124554051598 rc 0/0 00000100:00100000:1.0:1783444556.547517:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1470 00000100:00100000:1.0:1783444556.550585:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.550648:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557855616 00000100:00100000:3.0:1783444556.550658:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557855616 00000100:00100000:3.0:1783444556.550711:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1471 00000100:00100000:3.0:1783444556.550719:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+27:73552:x1870073557855616:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:3.0:1783444556.550779:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444556.550824:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833c92 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ebd expref: 27 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.550844:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:3.0:1783444556.550854:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444556.550913:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.550933:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.550943:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.551044:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000419b8673 reply state 00000000596e33b2 transno 124554051599 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.551076:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.551082:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:3.0:1783444556.551085:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.551087:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444556.551162:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+28:73552:x1870073557855616:12345-192.168.204.20@tcp:36:touch.0 Request processed in 442us (582us total) trans 124554051599 rc 0/0 00000100:00100000:3.0:1783444556.551170:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1471 00000100:00100000:3.0:1783444556.553825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.553901:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557855744 00000100:00100000:1.0:1783444556.553909:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557855744 00000100:00100000:1.0:1783444556.553975:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1472 00000100:00100000:1.0:1783444556.553984:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+28:73552:x1870073557855744:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.554083:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.554100:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e3833ca7 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ec4 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.554147:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e3833ca7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ec4 expref: 29 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.554160:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e400/0x42cb6883e3833ca7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ec4 expref: 29 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.554177:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:1.0:1783444556.554180:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783444556.554183:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583e400, rc 0) 00000100:00100000:1.0:1783444556.554235:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+29:73552:x1870073557855744:12345-192.168.204.20@tcp:101:touch.0 Request processed in 252us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444556.554252:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1472 00000100:00100000:3.0:1783444556.557484:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.557556:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557855872 00000100:00100000:1.0:1783444556.557565:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557855872 00000100:00100000:1.0:1783444556.557615:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5928 00000100:00100000:1.0:1783444556.557623:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2404:x1870073557855872:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444556.557815:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2404:x1870073557855872:12345-192.168.204.20@tcp:2:touch.0 Request processed in 192us (336us total) trans 4294969458 rc 0/0 00000100:00100000:1.0:1783444556.557823:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5928 00000100:00100000:3.0:1783444556.560545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.560648:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557856128 00000100:00100000:1.0:1783444556.560656:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557856128 00000100:00100000:1.0:1783444556.560715:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 249 00000100:00100000:1.0:1783444556.560724:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+29:73552:x1870073557856128:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:1.0:1783444556.561002:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+30:73552:x1870073557856128:12345-192.168.204.20@tcp:35:touch.0 Request processed in 277us (460us total) trans 124554051600 rc 0/0 00000100:00100000:1.0:1783444556.561009:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 249 00000100:00100000:3.0:1783444556.564388:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.564647:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557856384 00000100:00100000:1.0:1783444556.564656:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557856384 00000100:00100000:1.0:1783444556.564707:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1473 00000100:00100000:1.0:1783444556.564716:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+30:73552:x1870073557856384:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.564743:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.564763:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833cae lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ecb expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.565052:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.565066:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.565078:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.565092:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.565099:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.565106:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.566491:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x386:0x0], index 0: 0 00010000:00010000:1.0:1783444556.566625:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833cc3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566637:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833cc3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566647:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833cc3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566677:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566685:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566691:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566699:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566704:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fa00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.566708:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566715:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566726:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.566729:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.566742:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.566749:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833cb5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.567465:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036a55ca7 reply state 000000001fc3fbd9 transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.567480:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.567488:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff9367c98c8a00) 00010000:00010000:1.0:1783444556.567490:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.567493:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.567533:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833cae lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ecb expref: 33 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.567551:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833cc3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ecb expref: 32 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.567559:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:1.0:1783444556.567561:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.567563:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583ec00, rc 0) 00000100:00100000:1.0:1783444556.567675:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+33:73552:x1870073557856384:12345-192.168.204.20@tcp:101:touch.0 Request processed in 2958us (3303us total) trans 124554051601 rc 0/0 00000100:00100000:1.0:1783444556.567684:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1473 00000100:00100000:3.0:1783444556.577604:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.577681:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557856640 00000100:00100000:0.0:1783444556.577691:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557856640 00000100:00100000:0.0:1783444556.577746:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1474 00000100:00100000:0.0:1783444556.577755:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+33:73552:x1870073557856640:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:0.0:1783444556.577846:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444556.577882:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833cc3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ecb expref: 33 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.577903:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:0.0:1783444556.577914:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444556.578082:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.578096:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.578108:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.578210:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066277edf reply state 000000005e532a05 transno 124554051602 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.578222:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.578229:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9368f57c6c00) 00010000:00010000:0.0:1783444556.578232:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.578235:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444556.578443:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73552:x1870073557856640:12345-192.168.204.20@tcp:36:touch.0 Request processed in 688us (847us total) trans 124554051602 rc 0/0 00000100:00100000:0.0:1783444556.578452:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1474 00000100:00100000:2.0:1783444556.581623:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.581696:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557856768 00000100:00100000:3.0:1783444556.581705:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557856768 00000100:00100000:3.0:1783444556.581757:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1475 00000100:00100000:3.0:1783444556.581766:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73552:x1870073557856768:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.581817:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.581837:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e3833cd8 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ed2 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.581887:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e3833cd8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ed2 expref: 35 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.581901:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70400/0x42cb6883e3833cd8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ed2 expref: 35 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.581945:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9368f57c6c00) 00010000:00010000:3.0:1783444556.581948:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444556.581952:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70400, rc 0) 00000100:00100000:3.0:1783444556.582175:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+35:73552:x1870073557856768:12345-192.168.204.20@tcp:101:touch.0 Request processed in 408us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444556.582183:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1475 00000100:00100000:3.0:1783444556.585519:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.585628:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557856896 00000100:00100000:2.0:1783444556.585637:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557856896 00000100:00100000:2.0:1783444556.585686:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5929 00000100:00100000:2.0:1783444556.585695:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2403:x1870073557856896:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:2.0:1783444556.585933:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2403:x1870073557856896:12345-192.168.204.20@tcp:2:touch.0 Request processed in 239us (419us total) trans 4294969459 rc 0/0 00000100:00100000:2.0:1783444556.585941:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5929 00000100:00100000:0.0:1783444556.589662:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.589775:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557857152 00000100:00100000:3.0:1783444556.589783:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557857152 00000100:00100000:3.0:1783444556.589886:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 250 00000100:00100000:3.0:1783444556.589894:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd12b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+35:73552:x1870073557857152:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.590689:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd12b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+36:73552:x1870073557857152:12345-192.168.204.20@tcp:35:touch.0 Request processed in 793us (1031us total) trans 124554051603 rc 0/0 00000100:00100000:3.0:1783444556.590698:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 250 00000100:00100000:1.0:1783444556.593877:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.594052:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557857408 00000100:00100000:3.0:1783444556.594061:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557857408 00000100:00100000:3.0:1783444556.594109:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1476 00000100:00100000:3.0:1783444556.594117:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+36:73552:x1870073557857408:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.594139:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.594158:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71a00/0x42cb6883e3833cdf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ed9 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594265:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594297:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594308:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594322:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594330:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594337:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444556.594619:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x387:0x0], index 0: 0 00010000:00010000:3.0:1783444556.594729:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833cf4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594739:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833cf4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594746:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833cf4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594775:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594782:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594827:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594840:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594848:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444556.594852:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594861:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594873:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444556.594876:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444556.594881:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594888:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833ce6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.594901:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c746f8b reply state 0000000098b00b13 transno 124554051604 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594912:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.594929:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff9368d40f4200) 00010000:00010000:3.0:1783444556.594932:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.594934:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783444556.594960:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71a00/0x42cb6883e3833cdf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ed9 expref: 39 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.595875:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833cf4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ed9 expref: 38 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.595893:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:3.0:1783444556.595896:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444556.595899:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70200, rc 0) 00000100:00100000:3.0:1783444556.596032:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+39:73552:x1870073557857408:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1914us (2167us total) trans 124554051604 rc 0/0 00000100:00100000:3.0:1783444556.596041:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1476 00000100:00100000:0.0:1783444556.599648:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.599725:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557857664 00000100:00100000:3.0:1783444556.599734:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557857664 00000100:00100000:3.0:1783444556.599814:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1477 00000100:00100000:3.0:1783444556.599823:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+39:73552:x1870073557857664:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:3.0:1783444556.599884:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444556.599909:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833cf4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ed9 expref: 39 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.599938:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:3.0:1783444556.599951:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444556.600005:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.600017:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.600027:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.600121:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fff2033 reply state 00000000d95760d9 transno 124554051605 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.600151:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.600157:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4d00) 00010000:00010000:3.0:1783444556.600161:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.600163:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444556.600443:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+40:73552:x1870073557857664:12345-192.168.204.20@tcp:36:touch.0 Request processed in 620us (800us total) trans 124554051605 rc 0/0 00000100:00100000:3.0:1783444556.600451:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1477 00000100:00100000:0.0:1783444556.602985:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.603096:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557857792 00000100:00100000:3.0:1783444556.603105:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557857792 00000100:00100000:3.0:1783444556.603153:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1478 00000100:00100000:3.0:1783444556.603163:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+40:73552:x1870073557857792:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.603184:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.603202:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833d09 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ee0 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.603261:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833d09 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ee0 expref: 41 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.603276:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71200/0x42cb6883e3833d09 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ee0 expref: 41 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.603293:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4d00) 00010000:00010000:3.0:1783444556.603295:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444556.603299:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71200, rc 0) 00000100:00100000:3.0:1783444556.603352:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+41:73552:x1870073557857792:12345-192.168.204.20@tcp:101:touch.0 Request processed in 190us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444556.603371:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1478 00000100:00100000:2.0:1783444556.606866:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.607052:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557857920 00000100:00100000:1.0:1783444556.607060:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557857920 00000100:00100000:1.0:1783444556.607126:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5930 00000100:00100000:1.0:1783444556.607135:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2404:x1870073557857920:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444556.607324:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557857920:12345-192.168.204.20@tcp:2:touch.0 Request processed in 190us (464us total) trans 4294969460 rc 0/0 00000100:00100000:1.0:1783444556.607332:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5930 00000100:00100000:0.0:1783444556.611942:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.612070:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557858176 00000100:00100000:3.0:1783444556.612079:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557858176 00000100:00100000:3.0:1783444556.612132:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 251 00000100:00100000:3.0:1783444556.612141:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+41:73552:x1870073557858176:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.612429:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+42:73552:x1870073557858176:12345-192.168.204.20@tcp:35:touch.0 Request processed in 288us (494us total) trans 124554051606 rc 0/0 00000100:00100000:3.0:1783444556.612438:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 251 00000100:00100000:0.0:1783444556.615282:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.615470:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557858432 00000100:00100000:1.0:1783444556.615478:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557858432 00000100:00100000:1.0:1783444556.615524:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1479 00000100:00100000:1.0:1783444556.615532:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+42:73552:x1870073557858432:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.615551:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.615569:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833d10 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ee7 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.615654:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.615667:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.615678:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.615691:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.615698:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.615704:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.616172:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x388:0x0], index 0: 0 00010000:00010000:1.0:1783444556.616550:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d25 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616560:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d25 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616567:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d25 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616600:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616606:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616612:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616618:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616624:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.616628:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616635:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616647:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.616650:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.616662:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616668:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d17 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.616684:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082398f2d reply state 00000000f2988e98 transno 124554051607 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616694:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616699:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff9367c98c8100) 00010000:00010000:1.0:1783444556.616701:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.616704:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.616733:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833d10 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ee7 expref: 45 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616748:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d25 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ee7 expref: 44 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.616754:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9367c98c8d00) 00010000:00010000:1.0:1783444556.616756:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.616758:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f400, rc 0) 00000100:00100000:1.0:1783444556.617029:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+45:73552:x1870073557858432:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1496us (1751us total) trans 124554051607 rc 0/0 00000100:00100000:1.0:1783444556.617037:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1479 00000100:00100000:2.0:1783444556.620649:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.620729:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557858688 00000100:00100000:3.0:1783444556.620738:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557858688 00000100:00100000:3.0:1783444556.620824:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1480 00000100:00100000:3.0:1783444556.620835:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+45:73552:x1870073557858688:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:3.0:1783444556.620883:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444556.620905:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d25 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ee7 expref: 45 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.620932:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9367c98c8d00) 00010000:00010000:3.0:1783444556.620942:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444556.620994:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.621007:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.621017:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.621126:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003eb83f94 reply state 000000002b123ac0 transno 124554051608 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.621139:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.621145:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:3.0:1783444556.621147:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.621149:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444556.621218:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+46:73552:x1870073557858688:12345-192.168.204.20@tcp:36:touch.0 Request processed in 385us (575us total) trans 124554051608 rc 0/0 00000100:00100000:3.0:1783444556.621225:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1480 00000100:00100000:0.0:1783444556.623725:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.624183:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557858816 00000100:00100000:3.0:1783444556.624192:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557858816 00000100:00100000:3.0:1783444556.624335:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1481 00000100:00100000:3.0:1783444556.624354:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+46:73552:x1870073557858816:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.624385:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.624403:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71a00/0x42cb6883e3833d3a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939eee expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.624450:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71a00/0x42cb6883e3833d3a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939eee expref: 47 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.624463:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71a00/0x42cb6883e3833d3a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939eee expref: 47 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.624479:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:3.0:1783444556.624494:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444556.624497:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71a00, rc 0) 00000100:00100000:3.0:1783444556.624548:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+47:73552:x1870073557858816:12345-192.168.204.20@tcp:101:touch.0 Request processed in 196us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444556.631239:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1481 00000100:00100000:1.0:1783444556.631628:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.631703:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557858944 00000100:00100000:2.0:1783444556.631712:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557858944 00000100:00100000:2.0:1783444556.631756:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5931 00000100:00100000:2.0:1783444556.631765:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557858944:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:2.0:1783444556.632443:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+12:2404:x1870073557858944:12345-192.168.204.20@tcp:2:touch.0 Request processed in 677us (814us total) trans 4294969461 rc 0/0 00000100:00100000:2.0:1783444556.632466:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5931 00000100:00100000:2.0:1783444556.635525:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.636156:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557859200 00000100:00100000:1.0:1783444556.636167:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557859200 00000100:00100000:3.0:1783444556.637551:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 252 00000100:00100000:3.0:1783444556.637569:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+47:73552:x1870073557859200:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.639665:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+48:73552:x1870073557859200:12345-192.168.204.20@tcp:35:touch.0 Request processed in 2096us (4140us total) trans 124554051609 rc 0/0 00000100:00100000:3.0:1783444556.641075:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 252 00000100:00100000:0.0:1783444556.644615:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.644896:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557859456 00000100:00100000:3.0:1783444556.644906:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557859456 00000100:00100000:3.0:1783444556.644971:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1482 00000100:00100000:3.0:1783444556.644980:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+48:73552:x1870073557859456:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.645005:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.645024:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d41 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ef5 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.645129:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.645144:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.645156:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.645171:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.645192:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.645199:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444556.645931:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x389:0x0], index 0: 0 00010000:00010000:3.0:1783444556.646115:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a400/0x42cb6883e3833d56 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646138:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a400/0x42cb6883e3833d56 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646147:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a400/0x42cb6883e3833d56 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646178:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646186:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646192:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646199:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646206:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444556.646209:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646228:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646449:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444556.646453:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444556.646458:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646465:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833d48 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.646480:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9f8615c reply state 00000000836bbcf7 transno 124554051610 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646491:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646497:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff9368d40f4a00) 00010000:00010000:3.0:1783444556.646500:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.646502:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783444556.646530:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d41 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ef5 expref: 51 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646543:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a400/0x42cb6883e3833d56 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ef5 expref: 50 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.646552:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4b00) 00010000:00010000:3.0:1783444556.646554:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444556.646556:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a400, rc 0) 00000100:00100000:3.0:1783444556.646629:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+51:73552:x1870073557859456:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1649us (2020us total) trans 124554051610 rc 0/0 00000100:00100000:3.0:1783444556.646636:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1482 00000100:00100000:1.0:1783444556.659505:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.659859:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557859712 00000100:00100000:3.0:1783444556.659870:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557859712 00000100:00100000:3.0:1783444556.660551:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1483 00000100:00100000:3.0:1783444556.660562:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+51:73552:x1870073557859712:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:3.0:1783444556.660616:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444556.660640:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a400/0x42cb6883e3833d56 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ef5 expref: 51 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.660658:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4b00) 00010000:00010000:3.0:1783444556.660668:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444556.660725:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.660737:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.660747:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.660883:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001305781d reply state 00000000b648abe3 transno 124554051611 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.660895:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.660901:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4700) 00010000:00010000:3.0:1783444556.660904:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.660929:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444556.661345:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:73552:x1870073557859712:12345-192.168.204.20@tcp:36:touch.0 Request processed in 776us (1840us total) trans 124554051611 rc 0/0 00000100:00100000:3.0:1783444556.661353:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1483 00000100:00100000:3.0:1783444556.686563:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.686715:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557859840 00000100:00100000:1.0:1783444556.686725:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557859840 00000100:00100000:1.0:1783444556.686780:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1484 00000100:00100000:1.0:1783444556.686807:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+52:73552:x1870073557859840:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.686832:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.686852:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d6b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939efc expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.687108:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d6b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939efc expref: 53 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.687122:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e200/0x42cb6883e3833d6b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939efc expref: 53 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.687138:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4700) 00010000:00010000:1.0:1783444556.687141:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783444556.687145:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583e200, rc 0) 00000100:00100000:1.0:1783444556.687239:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+53:73552:x1870073557859840:12345-192.168.204.20@tcp:101:touch.0 Request processed in 450us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444556.687247:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1484 00000100:00100000:0.0:1783444556.759495:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.759700:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557859968 00000100:00100000:2.0:1783444556.759710:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557859968 00000100:00100000:2.0:1783444556.759883:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5932 00000100:00100000:2.0:1783444556.759895:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+12:2403:x1870073557859968:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:2.0:1783444556.760129:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+13:2403:x1870073557859968:12345-192.168.204.20@tcp:2:touch.0 Request processed in 235us (641us total) trans 4294969462 rc 0/0 00000100:00100000:2.0:1783444556.760138:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5932 00000100:00100000:0.0:1783444556.762254:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.762338:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557860224 00000100:00100000:3.0:1783444556.762347:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557860224 00000100:00100000:3.0:1783444556.762447:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00100000:3.0:1783444556.762458:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+53:73552:x1870073557860224:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.762717:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+54:73552:x1870073557860224:12345-192.168.204.20@tcp:35:touch.0 Request processed in 260us (467us total) trans 124554051612 rc 0/0 00000100:00100000:3.0:1783444556.762724:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00100000:3.0:1783444556.765178:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.765268:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557860480 00000100:00100000:1.0:1783444556.765276:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557860480 00000100:00100000:1.0:1783444556.765368:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1485 00000100:00100000:1.0:1783444556.765389:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+54:73552:x1870073557860480:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.765416:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.765440:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833d72 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f03 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.765557:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.765571:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.765581:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.765593:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.765599:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.765604:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.765940:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38a:0x0], index 0: 0 00010000:00010000:1.0:1783444556.766079:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833d87 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766087:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833d87 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766094:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833d87 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766124:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766141:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766147:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766154:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766160:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.766164:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766171:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766182:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.766185:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.766189:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766195:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833d79 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.766210:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002828d03e reply state 00000000439a9bbd transno 124554051613 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766219:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766225:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff9367c98c8600) 00010000:00010000:1.0:1783444556.766238:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.766241:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.766269:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833d72 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f03 expref: 57 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766283:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833d87 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f03 expref: 56 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.766290:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8200) 00010000:00010000:1.0:1783444556.766292:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.766295:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583fa00, rc 0) 00000100:00100000:1.0:1783444556.766346:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+57:73552:x1870073557860480:12345-192.168.204.20@tcp:101:touch.0 Request processed in 969us (1172us total) trans 124554051613 rc 0/0 00000100:00100000:1.0:1783444556.766354:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1485 00000100:00100000:0.0:1783444556.769079:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.769202:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557860736 00000100:00100000:1.0:1783444556.769210:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557860736 00000100:00100000:1.0:1783444556.769261:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1486 00000100:00100000:1.0:1783444556.769269:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+57:73552:x1870073557860736:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:1.0:1783444556.769314:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444556.769334:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833d87 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f03 expref: 57 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.769361:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8200) 00010000:00010000:1.0:1783444556.769371:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444556.769422:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.769433:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.769452:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.769534:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f29896d reply state 00000000d0e163ce transno 124554051614 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.769545:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.769552:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8400) 00010000:00010000:1.0:1783444556.769555:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.769557:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444556.769709:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+58:73552:x1870073557860736:12345-192.168.204.20@tcp:36:touch.0 Request processed in 440us (636us total) trans 124554051614 rc 0/0 00000100:00100000:1.0:1783444556.769716:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1486 00000100:00100000:0.0:1783444556.771696:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.771772:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557860864 00000100:00100000:3.0:1783444556.771780:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557860864 00000100:00100000:3.0:1783444556.772107:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1487 00000100:00100000:3.0:1783444556.772116:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+58:73552:x1870073557860864:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.772137:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.772155:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a400/0x42cb6883e3833d9c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f0a expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.772198:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a400/0x42cb6883e3833d9c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f0a expref: 59 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.772211:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a400/0x42cb6883e3833d9c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f0a expref: 59 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.772242:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8400) 00010000:00010000:3.0:1783444556.772246:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444556.772249:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513a400, rc 0) 00000100:00100000:3.0:1783444556.772287:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+59:73552:x1870073557860864:12345-192.168.204.20@tcp:101:touch.0 Request processed in 172us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444556.772294:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1487 00000100:00100000:2.0:1783444556.781135:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.781219:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557860992 00000100:00100000:0.0:1783444556.781229:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557860992 00000100:00100000:0.0:1783444556.781285:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5933 00000100:00100000:0.0:1783444556.781295:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+13:2404:x1870073557860992:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:0.0:1783444556.781525:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+14:2404:x1870073557860992:12345-192.168.204.20@tcp:2:touch.0 Request processed in 231us (398us total) trans 4294969463 rc 0/0 00000100:00100000:0.0:1783444556.781533:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5933 00000100:00100000:0.0:1783444556.787558:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.787711:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557861248 00000100:00100000:3.0:1783444556.787721:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557861248 00000100:00100000:2.0:1783444556.787970:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 254 00000100:00100000:2.0:1783444556.787983:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+59:73552:x1870073557861248:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:2.0:1783444556.788251:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+60:73552:x1870073557861248:12345-192.168.204.20@tcp:35:touch.0 Request processed in 270us (700us total) trans 124554051615 rc 0/0 00000100:00100000:2.0:1783444556.788260:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 254 00000100:00100000:2.0:1783444556.810579:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.811013:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557861504 00000100:00100000:1.0:1783444556.811023:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557861504 00000100:00100000:1.0:1783444556.811080:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1488 00000100:00100000:1.0:1783444556.811089:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+60:73552:x1870073557861504:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.811114:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.811133:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833da3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f11 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811231:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811246:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811273:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811289:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811295:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811302:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.811590:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38b:0x0], index 0: 0 00010000:00010000:1.0:1783444556.811707:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833db8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811715:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833db8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811723:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833db8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811752:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811759:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811765:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811772:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811783:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583ec00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.811810:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811819:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811836:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.811839:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.811844:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811851:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ec00/0x42cb6883e3833daa lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.811864:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad3d0183 reply state 000000006903f033 transno 124554051616 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811875:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811882:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff9367c98c8200) 00010000:00010000:1.0:1783444556.811884:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.811887:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.811912:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e3833da3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f11 expref: 63 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811926:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833db8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f11 expref: 62 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.811943:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9367c98c8b00) 00010000:00010000:1.0:1783444556.811945:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.811947:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11a00, rc 0) 00000100:00100000:1.0:1783444556.812004:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+63:73552:x1870073557861504:12345-192.168.204.20@tcp:101:touch.0 Request processed in 917us (1433us total) trans 124554051616 rc 0/0 00000100:00100000:1.0:1783444556.812012:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1488 00000100:00100000:3.0:1783444556.816382:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.816502:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557861760 00000100:00100000:0.0:1783444556.816512:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557861760 00000100:00100000:0.0:1783444556.816568:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1489 00000100:00100000:0.0:1783444556.816577:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+63:73552:x1870073557861760:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:0.0:1783444556.816628:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444556.816653:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833db8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f11 expref: 63 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.816672:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9367c98c8b00) 00010000:00010000:0.0:1783444556.816682:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444556.816736:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.816748:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.816769:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.817026:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000674f7a5d reply state 000000004d00d017 transno 124554051617 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.817039:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.817046:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9368f57c6300) 00010000:00010000:0.0:1783444556.817049:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.817051:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444556.817132:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+64:73552:x1870073557861760:12345-192.168.204.20@tcp:36:touch.0 Request processed in 555us (766us total) trans 124554051617 rc 0/0 00000100:00100000:0.0:1783444556.817140:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1489 00000100:00100000:2.0:1783444556.820557:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.820624:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557861888 00000100:00100000:1.0:1783444556.820632:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557861888 00000100:00100000:1.0:1783444556.820686:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1490 00000100:00100000:1.0:1783444556.820695:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+64:73552:x1870073557861888:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.820719:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.820736:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11400/0x42cb6883e3833dcd lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f18 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.820782:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11400/0x42cb6883e3833dcd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f18 expref: 65 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.820899:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11400/0x42cb6883e3833dcd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f18 expref: 65 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.820917:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9368f57c6300) 00010000:00010000:1.0:1783444556.820920:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783444556.820924:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11400, rc 0) 00000100:00100000:1.0:1783444556.821064:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+65:73552:x1870073557861888:12345-192.168.204.20@tcp:101:touch.0 Request processed in 369us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444556.821086:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1490 00000100:00100000:2.0:1783444556.829050:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.829425:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557862016 00000100:00100000:1.0:1783444556.829434:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557862016 00000100:00100000:1.0:1783444556.829484:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5934 00000100:00100000:1.0:1783444556.829494:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+14:2404:x1870073557862016:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444556.829688:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+15:2404:x1870073557862016:12345-192.168.204.20@tcp:2:touch.0 Request processed in 195us (646us total) trans 4294969464 rc 0/0 00000100:00100000:1.0:1783444556.829697:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5934 00010000:00010000:0.0:1783444556.831476:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444556.835113:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.835206:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557862272 00000100:00100000:3.0:1783444556.835215:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557862272 00000100:00100000:3.0:1783444556.835271:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 255 00000100:00100000:3.0:1783444556.835280:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+65:73552:x1870073557862272:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.835633:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+66:73552:x1870073557862272:12345-192.168.204.20@tcp:35:touch.0 Request processed in 353us (527us total) trans 124554051618 rc 0/0 00000100:00100000:3.0:1783444556.835642:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 255 00000100:00100000:3.0:1783444556.842064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.842187:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557862528 00000100:00100000:1.0:1783444556.842196:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557862528 00000100:00100000:1.0:1783444556.842280:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1491 00000100:00100000:1.0:1783444556.842290:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+66:73552:x1870073557862528:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.842314:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.842333:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833dd4 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f1f expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.842450:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.842464:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.842476:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.842491:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.842515:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.842522:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.842835:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38c:0x0], index 0: 0 00010000:00010000:1.0:1783444556.842954:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833de9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.842977:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833de9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.842985:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833de9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843017:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843024:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843030:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843037:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843043:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.843048:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843066:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843079:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.843082:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.843087:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843093:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833ddb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.843106:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8fafbce reply state 00000000c80a5d8a transno 124554051619 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843117:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843124:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff9367c98c8b00) 00010000:00010000:1.0:1783444556.843126:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.843128:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.843155:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833dd4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f1f expref: 69 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843170:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833de9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f1f expref: 68 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.843177:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8d00) 00010000:00010000:1.0:1783444556.843179:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.843182:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11e00, rc 0) 00000100:00100000:1.0:1783444556.843348:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+69:73552:x1870073557862528:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1059us (1293us total) trans 124554051619 rc 0/0 00000100:00100000:1.0:1783444556.843356:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1491 00000100:00100000:0.0:1783444556.849508:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.850498:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557862784 00000100:00100000:1.0:1783444556.850509:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557862784 00000100:00100000:1.0:1783444556.850601:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1492 00000100:00100000:1.0:1783444556.850611:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+69:73552:x1870073557862784:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:1.0:1783444556.850665:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444556.850691:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833de9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f1f expref: 69 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.850711:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8d00) 00010000:00010000:1.0:1783444556.850724:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444556.851662:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.851678:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.851689:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.851960:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057605236 reply state 00000000263efedb transno 124554051620 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.851973:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.851980:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:1.0:1783444556.851995:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.851999:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444556.852088:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+70:73552:x1870073557862784:12345-192.168.204.20@tcp:36:touch.0 Request processed in 1477us (2587us total) trans 124554051620 rc 0/0 00000100:00100000:1.0:1783444556.852095:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1492 00000100:00100000:0.0:1783444556.855866:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.856045:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557862912 00000100:00100000:3.0:1783444556.856054:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557862912 00000100:00100000:3.0:1783444556.856103:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1493 00000100:00100000:3.0:1783444556.856112:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+70:73552:x1870073557862912:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.856139:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.856159:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833dfe lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f26 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.856229:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833dfe lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f26 expref: 71 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.856244:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b800/0x42cb6883e3833dfe lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f26 expref: 71 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.856261:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:3.0:1783444556.856264:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444556.856268:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513b800, rc 0) 00000100:00100000:3.0:1783444556.856323:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+71:73552:x1870073557862912:12345-192.168.204.20@tcp:101:touch.0 Request processed in 212us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444556.856331:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1493 00000100:00100000:3.0:1783444556.858533:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.858712:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557863040 00000100:00100000:1.0:1783444556.858719:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557863040 00000100:00100000:1.0:1783444556.858927:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5935 00000100:00100000:1.0:1783444556.858937:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+15:2403:x1870073557863040:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444556.859118:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+16:2403:x1870073557863040:12345-192.168.204.20@tcp:2:touch.0 Request processed in 182us (590us total) trans 4294969465 rc 0/0 00000100:00100000:1.0:1783444556.859125:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5935 00000100:00100000:0.0:1783444556.862257:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.862325:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557863296 00000100:00100000:2.0:1783444556.862334:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557863296 00000100:00100000:2.0:1783444556.862393:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 256 00000100:00100000:2.0:1783444556.862402:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd12b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+71:73552:x1870073557863296:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:2.0:1783444556.862661:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd12b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+72:73552:x1870073557863296:12345-192.168.204.20@tcp:35:touch.0 Request processed in 260us (412us total) trans 124554051621 rc 0/0 00000100:00100000:2.0:1783444556.862683:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 256 00000100:00100000:0.0:1783444556.865955:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.866074:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557863552 00000100:00100000:3.0:1783444556.866083:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557863552 00000100:00100000:3.0:1783444556.866136:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1494 00000100:00100000:3.0:1783444556.866146:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+72:73552:x1870073557863552:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.866170:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.866189:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833e05 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f2d expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866287:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866300:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866329:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866355:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866363:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866380:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444556.866687:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38d:0x0], index 0: 0 00010000:00010000:3.0:1783444556.866839:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833e1a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866849:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833e1a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866856:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833e1a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866886:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866893:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866899:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866905:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866917:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444556.866921:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866930:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866942:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444556.866945:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444556.866949:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866956:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3833e0c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444556.866982:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027d6a800 reply state 00000000c0a667ae transno 124554051622 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866992:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.866998:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff9368d40f4b00) 00010000:00010000:3.0:1783444556.867001:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444556.867003:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783444556.867028:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3833e05 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f2d expref: 75 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.867041:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833e1a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f2d expref: 74 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.867059:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368d40f4f00) 00010000:00010000:3.0:1783444556.867061:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444556.867063:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91200, rc 0) 00000100:00100000:3.0:1783444556.867113:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+75:73552:x1870073557863552:12345-192.168.204.20@tcp:101:touch.0 Request processed in 969us (1165us total) trans 124554051622 rc 0/0 00000100:00100000:3.0:1783444556.867121:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1494 00000100:00100000:3.0:1783444556.870014:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.870141:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557863808 00000100:00100000:0.0:1783444556.870152:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557863808 00000100:00100000:0.0:1783444556.870210:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1495 00000100:00100000:0.0:1783444556.870220:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+75:73552:x1870073557863808:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:0.0:1783444556.870269:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444556.870292:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3833e1a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f2d expref: 75 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.870329:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368d40f4f00) 00010000:00010000:0.0:1783444556.870352:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444556.870416:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.870428:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.870437:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.870546:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2915dfc reply state 00000000520c10d8 transno 124554051623 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.870558:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.870565:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:0.0:1783444556.870568:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.870570:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444556.870888:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+76:73552:x1870073557863808:12345-192.168.204.20@tcp:36:touch.0 Request processed in 668us (881us total) trans 124554051623 rc 0/0 00000100:00100000:0.0:1783444556.870896:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1495 00000100:00100000:0.0:1783444556.872346:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.872426:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557863936 00000100:00100000:3.0:1783444556.872433:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557863936 00000100:00100000:3.0:1783444556.872510:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1496 00000100:00100000:3.0:1783444556.872519:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+76:73552:x1870073557863936:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.872535:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.872549:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91800/0x42cb6883e3833e2f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f34 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.872586:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91800/0x42cb6883e3833e2f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f34 expref: 77 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.872599:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91800/0x42cb6883e3833e2f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f34 expref: 77 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.872614:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:3.0:1783444556.872616:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444556.872620:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91800, rc 0) 00000100:00100000:3.0:1783444556.872661:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+77:73552:x1870073557863936:12345-192.168.204.20@tcp:101:touch.0 Request processed in 144us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444556.872678:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1496 00000100:00100000:2.0:1783444556.882392:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.882463:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557864064 00000100:00100000:3.0:1783444556.882473:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557864064 00000100:00100000:3.0:1783444556.882529:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5936 00000100:00100000:3.0:1783444556.882539:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+16:2403:x1870073557864064:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:3.0:1783444556.882766:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+17:2403:x1870073557864064:12345-192.168.204.20@tcp:2:touch.0 Request processed in 221us (385us total) trans 4294969466 rc 0/0 00000100:00100000:3.0:1783444556.882775:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5936 00000100:00100000:2.0:1783444556.888718:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.889176:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557864320 00000100:00100000:3.0:1783444556.889186:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557864320 00000100:00100000:3.0:1783444556.889237:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 257 00000100:00100000:3.0:1783444556.889246:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+77:73552:x1870073557864320:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.889571:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+78:73552:x1870073557864320:12345-192.168.204.20@tcp:35:touch.0 Request processed in 326us (862us total) trans 124554051624 rc 0/0 00000100:00100000:3.0:1783444556.889580:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 257 00000100:00100000:1.0:1783444556.902114:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.902181:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557864576 00000100:00100000:3.0:1783444556.902191:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557864576 00000100:00100000:3.0:1783444556.902299:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1497 00000100:00100000:3.0:1783444556.902310:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+78:73552:x1870073557864576:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444556.902353:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444556.902385:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3833e36 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f3b expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.902492:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.902525:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.902537:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.902553:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.902559:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444556.902565:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783444556.902917:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38e:0x0], index 0: 0 00010000:00010000:0.0:1783444556.903135:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833e4b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903145:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833e4b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903164:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833e4b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903199:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903205:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903210:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903216:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903222:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.903226:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903233:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903245:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444556.903248:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.903252:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903258:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3833e3d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.903272:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e33afd75 reply state 000000006f8576fb transno 124554051625 ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903290:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903296:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff9368d40f4c00) 00010000:00010000:0.0:1783444556.903299:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.903301:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783444556.903331:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3833e36 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f3b expref: 81 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903345:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833e4b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f3b expref: 80 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.903353:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368f57c6f00) 00010000:00010000:0.0:1783444556.903355:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444556.903357:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645a00, rc 0) 00000100:00100000:0.0:1783444556.903436:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+81:73552:x1870073557864576:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1127us (1330us total) trans 124554051625 rc 0/0 00000100:00100000:0.0:1783444556.903444:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1497 00000100:00100000:0.0:1783444556.908287:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.908459:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557864832 00000100:00100000:2.0:1783444556.908468:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557864832 00000100:00100000:2.0:1783444556.908533:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1498 00000100:00100000:2.0:1783444556.908544:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+81:73552:x1870073557864832:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:2.0:1783444556.908597:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444556.908635:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833e4b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f3b expref: 81 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.908654:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368f57c6f00) 00010000:00010000:2.0:1783444556.908664:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444556.908718:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.908729:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.908739:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444556.908879:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a625d0a reply state 00000000acccb554 transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.908892:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.908898:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:2.0:1783444556.908909:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444556.908912:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444556.909098:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+82:73552:x1870073557864832:12345-192.168.204.20@tcp:36:touch.0 Request processed in 555us (816us total) trans 124554051626 rc 0/0 00000100:00100000:2.0:1783444556.909107:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1498 00000100:00100000:2.0:1783444556.911971:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.912660:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557864960 00000100:00100000:1.0:1783444556.912669:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557864960 00000100:00100000:1.0:1783444556.912718:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1499 00000100:00100000:1.0:1783444556.912727:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+82:73552:x1870073557864960:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.912749:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.912768:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3833e60 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f42 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.912847:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3833e60 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f42 expref: 83 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.912861:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10800/0x42cb6883e3833e60 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f42 expref: 83 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.912898:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:1.0:1783444556.912902:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783444556.912905:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10800, rc 0) 00000100:00100000:1.0:1783444556.913100:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+83:73552:x1870073557864960:12345-192.168.204.20@tcp:101:touch.0 Request processed in 373us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444556.913107:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1499 00000100:00100000:1.0:1783444556.921946:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.922085:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557865088 00000100:00100000:0.0:1783444556.922094:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557865088 00000100:00100000:0.0:1783444556.922177:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5937 00000100:00100000:0.0:1783444556.922187:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+17:2404:x1870073557865088:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:0.0:1783444556.922412:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+18:2404:x1870073557865088:12345-192.168.204.20@tcp:2:touch.0 Request processed in 226us (630us total) trans 4294969467 rc 0/0 00000100:00100000:0.0:1783444556.922420:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5937 00000100:00100000:1.0:1783444556.925084:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.925168:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557865344 00000100:00100000:3.0:1783444556.925176:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557865344 00000100:00100000:3.0:1783444556.925253:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 258 00000100:00100000:3.0:1783444556.925263:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+83:73552:x1870073557865344:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.925569:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+84:73552:x1870073557865344:12345-192.168.204.20@tcp:35:touch.0 Request processed in 306us (492us total) trans 124554051627 rc 0/0 00000100:00100000:3.0:1783444556.925577:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 258 00000100:00100000:2.0:1783444556.928077:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.928192:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557865600 00000100:00100000:1.0:1783444556.928200:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557865600 00000100:00100000:1.0:1783444556.928291:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1500 00000100:00100000:1.0:1783444556.928301:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+84:73552:x1870073557865600:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.928322:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.928343:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e3833e67 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f49 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.928465:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.928479:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.928490:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.928503:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.928527:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.928534:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.929100:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38f:0x0], index 0: 0 00010000:00010000:1.0:1783444556.929237:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833e7c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929248:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833e7c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929257:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833e7c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929290:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929298:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929305:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929311:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929316:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.929320:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929339:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929351:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.929353:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.929358:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929365:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833e6e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.929390:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000630a68b0 reply state 00000000cda42a00 transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929402:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929408:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff9367c98c8d00) 00010000:00010000:1.0:1783444556.929410:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.929413:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.929439:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e3833e67 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f49 expref: 87 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929452:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833e7c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f49 expref: 86 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.929460:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:1.0:1783444556.929462:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.929465:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10a00, rc 0) 00000100:00100000:1.0:1783444556.929750:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+87:73552:x1870073557865600:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1448us (1679us total) trans 124554051628 rc 0/0 00000100:00100000:1.0:1783444556.929758:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1500 00000100:00100000:1.0:1783444556.933033:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.933131:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557865856 00000100:00100000:2.0:1783444556.933140:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557865856 00000100:00100000:2.0:1783444556.933229:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1501 00000100:00100000:2.0:1783444556.933240:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+87:73552:x1870073557865856:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:2.0:1783444556.933296:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444556.933320:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833e7c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f49 expref: 87 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.933350:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:2.0:1783444556.933361:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444556.933418:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.933431:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.933440:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444556.933534:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001df57f1c reply state 000000000e2703c4 transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.933545:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.933564:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9368c59a7500) 00010000:00010000:2.0:1783444556.933566:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444556.933569:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444556.933661:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+88:73552:x1870073557865856:12345-192.168.204.20@tcp:36:touch.0 Request processed in 421us (634us total) trans 124554051629 rc 0/0 00000100:00100000:2.0:1783444556.933668:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1501 00000100:00100000:3.0:1783444556.935539:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.935723:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557865984 00000100:00100000:0.0:1783444556.935730:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557865984 00000100:00100000:0.0:1783444556.935778:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1502 00000100:00100000:0.0:1783444556.935805:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+88:73552:x1870073557865984:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444556.935828:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444556.935846:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833e91 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f50 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.935894:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833e91 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f50 expref: 89 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.935907:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645200/0x42cb6883e3833e91 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f50 expref: 89 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.935925:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9368c59a7500) 00010000:00010000:0.0:1783444556.935929:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783444556.935932:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645200, rc 0) 00000100:00100000:0.0:1783444556.935992:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+89:73552:x1870073557865984:12345-192.168.204.20@tcp:101:touch.0 Request processed in 205us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444556.935999:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1502 00000100:00100000:3.0:1783444556.939407:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.939492:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557866112 00000100:00100000:2.0:1783444556.939501:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557866112 00000100:00100000:3.0:1783444556.940077:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5938 00000100:00100000:3.0:1783444556.940090:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+18:2404:x1870073557866112:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:3.0:1783444556.940319:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+19:2404:x1870073557866112:12345-192.168.204.20@tcp:2:touch.0 Request processed in 232us (919us total) trans 4294969468 rc 0/0 00000100:00100000:3.0:1783444556.940335:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5938 00000100:00100000:1.0:1783444556.943097:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.943198:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557866368 00000100:00100000:2.0:1783444556.943207:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557866368 00000100:00100000:2.0:1783444556.943297:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 259 00000100:00100000:2.0:1783444556.943306:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+89:73552:x1870073557866368:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:2.0:1783444556.943573:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+90:73552:x1870073557866368:12345-192.168.204.20@tcp:35:touch.0 Request processed in 266us (481us total) trans 124554051630 rc 0/0 00000100:00100000:2.0:1783444556.943582:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 259 00000100:00100000:1.0:1783444556.946022:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.946389:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557866624 00000100:00100000:2.0:1783444556.946399:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557866624 00000100:00100000:2.0:1783444556.946453:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1503 00000100:00100000:2.0:1783444556.946462:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+90:73552:x1870073557866624:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:2.0:1783444556.946485:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444556.946504:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833e98 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f57 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.946601:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.946627:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.946652:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.946667:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.946674:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.946680:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783444556.947242:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x390:0x0], index 0: 0 00010000:00010000:2.0:1783444556.947368:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833ead lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947388:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833ead lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947397:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833ead lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947430:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947437:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947443:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947450:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947463:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444556.947468:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947475:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947487:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:2.0:1783444556.947490:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444556.947494:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947501:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c27a00/0x42cb6883e3833e9f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444556.947515:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5b77d8d reply state 0000000020067386 transno 124554051631 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947526:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947532:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff9368c59a7400) 00010000:00010000:2.0:1783444556.947534:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444556.947536:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783444556.947570:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031a00/0x42cb6883e3833e98 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f57 expref: 93 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947584:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833ead lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f57 expref: 92 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.947602:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368c59a7f00) 00010000:00010000:2.0:1783444556.947604:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783444556.947607:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6c26200, rc 0) 00000100:00100000:2.0:1783444556.947922:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+93:73552:x1870073557866624:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1459us (1926us total) trans 124554051631 rc 0/0 00000100:00100000:2.0:1783444556.947930:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1503 00000100:00100000:3.0:1783444556.951430:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.951501:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557866880 00000100:00100000:0.0:1783444556.951511:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557866880 00000100:00100000:0.0:1783444556.951567:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1504 00000100:00100000:0.0:1783444556.951577:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+93:73552:x1870073557866880:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:0.0:1783444556.951644:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444556.951667:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26200/0x42cb6883e3833ead lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f57 expref: 93 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.951700:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368c59a7f00) 00010000:00010000:0.0:1783444556.951710:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444556.951771:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.951783:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.951825:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.951992:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000681c7a68 reply state 000000001a8e4630 transno 124554051632 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.952005:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.952012:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368f57c6500) 00010000:00010000:0.0:1783444556.952015:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.952017:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444556.952085:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+94:73552:x1870073557866880:12345-192.168.204.20@tcp:36:touch.0 Request processed in 509us (663us total) trans 124554051632 rc 0/0 00000100:00100000:0.0:1783444556.952093:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1504 00000100:00100000:1.0:1783444556.954471:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.954683:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557867008 00000100:00100000:0.0:1783444556.954691:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557867008 00000100:00100000:0.0:1783444556.954739:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1505 00000100:00100000:0.0:1783444556.954748:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+94:73552:x1870073557867008:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444556.954970:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444556.955001:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833ec2 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f5e expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.955049:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833ec2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f5e expref: 95 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.955062:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645a00/0x42cb6883e3833ec2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f5e expref: 95 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.955077:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368f57c6500) 00010000:00010000:0.0:1783444556.955080:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783444556.955083:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645a00, rc 0) 00000100:00100000:0.0:1783444556.955161:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+95:73552:x1870073557867008:12345-192.168.204.20@tcp:101:touch.0 Request processed in 413us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444556.955168:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1505 00000100:00100000:1.0:1783444556.960277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.960367:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557867136 00000100:00100000:3.0:1783444556.960386:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557867136 00000100:00100000:3.0:1783444556.960441:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5939 00000100:00100000:3.0:1783444556.960452:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:08efc25c-17e5-4d29-97d2-f1505f195a06+19:2403:x1870073557867136:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:3.0:1783444556.960665:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:08efc25c-17e5-4d29-97d2-f1505f195a06+20:2403:x1870073557867136:12345-192.168.204.20@tcp:2:touch.0 Request processed in 214us (397us total) trans 4294969469 rc 0/0 00000100:00100000:3.0:1783444556.960674:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5939 00000100:00100000:2.0:1783444556.962721:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.962902:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557867392 00000100:00100000:3.0:1783444556.962911:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557867392 00000100:00100000:3.0:1783444556.962998:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 260 00000100:00100000:3.0:1783444556.963009:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+95:73552:x1870073557867392:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.963263:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+96:73552:x1870073557867392:12345-192.168.204.20@tcp:35:touch.0 Request processed in 255us (546us total) trans 124554051633 rc 0/0 00000100:00100000:3.0:1783444556.963271:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 260 00000100:00100000:2.0:1783444556.965454:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.965551:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557867648 00000100:00100000:1.0:1783444556.965559:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557867648 00000100:00100000:1.0:1783444556.965640:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1506 00000100:00100000:1.0:1783444556.965650:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+96:73552:x1870073557867648:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.965671:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.965691:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e3833ec9 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f65 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.965834:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.965851:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.965864:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.965878:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.965885:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.965906:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.966225:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x391:0x0], index 0: 0 00010000:00010000:1.0:1783444556.966343:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833ede lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966353:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833ede lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966361:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833ede lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966403:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966410:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966417:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966423:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966430:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.966435:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966442:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966468:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.966471:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.966476:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966482:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833ed0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.966496:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007bbf3967 reply state 0000000071ed8c12 transno 124554051634 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966506:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966513:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff9367c98c8e00) 00010000:00010000:1.0:1783444556.966515:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.966518:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.966546:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e3833ec9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f65 expref: 99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966561:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833ede lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f65 expref: 98 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.966569:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9367c98c8c00) 00010000:00010000:1.0:1783444556.966572:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.966574:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11c00, rc 0) 00000100:00100000:1.0:1783444556.966629:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+99:73552:x1870073557867648:12345-192.168.204.20@tcp:101:touch.0 Request processed in 981us (1182us total) trans 124554051634 rc 0/0 00000100:00100000:1.0:1783444556.966636:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1506 00000100:00100000:1.0:1783444556.969260:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.969384:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557867904 00000100:00100000:2.0:1783444556.969394:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557867904 00000100:00100000:2.0:1783444556.969482:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1507 00000100:00100000:2.0:1783444556.969493:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+99:73552:x1870073557867904:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:2.0:1783444556.969547:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444556.969570:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833ede lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f65 expref: 99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.969587:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9367c98c8c00) 00010000:00010000:2.0:1783444556.969598:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444556.969650:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.969663:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.969672:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444556.969833:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003e52a5a reply state 00000000417334ab transno 124554051635 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.969845:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444556.969852:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9368c59a7e00) 00010000:00010000:2.0:1783444556.969855:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444556.969857:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444556.969948:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+100:73552:x1870073557867904:12345-192.168.204.20@tcp:36:touch.0 Request processed in 456us (695us total) trans 124554051635 rc 0/0 00000100:00100000:2.0:1783444556.969956:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1507 00000100:00100000:2.0:1783444556.972218:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.972310:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557868032 00000100:00100000:0.0:1783444556.972318:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557868032 00000100:00100000:0.0:1783444556.972439:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1508 00000100:00100000:0.0:1783444556.972450:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+100:73552:x1870073557868032:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444556.972471:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444556.972489:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644000/0x42cb6883e3833ef3 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f6c expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.972539:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644000/0x42cb6883e3833ef3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f6c expref: 101 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.972553:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644000/0x42cb6883e3833ef3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f6c expref: 101 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.972589:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9368c59a7e00) 00010000:00010000:0.0:1783444556.972593:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783444556.972597:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7644000, rc 0) 00000100:00100000:0.0:1783444556.972649:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+101:73552:x1870073557868032:12345-192.168.204.20@tcp:101:touch.0 Request processed in 201us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444556.972656:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1508 00000100:00100000:1.0:1783444556.974918:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.975175:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557868160 00000100:00100000:2.0:1783444556.975183:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557868160 00000100:00100000:2.0:1783444556.975236:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5940 00000100:00100000:2.0:1783444556.975246:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+20:2404:x1870073557868160:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:2.0:1783444556.975605:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+21:2404:x1870073557868160:12345-192.168.204.20@tcp:2:touch.0 Request processed in 358us (691us total) trans 4294969470 rc 0/0 00000100:00100000:2.0:1783444556.975614:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5940 00000100:00100000:1.0:1783444556.977995:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444556.978201:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557868416 00000100:00100000:2.0:1783444556.978209:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557868416 00000100:00100000:2.0:1783444556.978287:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 261 00000100:00100000:2.0:1783444556.978296:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+101:73552:x1870073557868416:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:2.0:1783444556.978555:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+102:73552:x1870073557868416:12345-192.168.204.20@tcp:35:touch.0 Request processed in 260us (567us total) trans 124554051636 rc 0/0 00000100:00100000:2.0:1783444556.978578:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 261 00000100:00100000:2.0:1783444556.980713:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.981004:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557868672 00000100:00100000:0.0:1783444556.981012:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557868672 00000100:00100000:0.0:1783444556.981103:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1509 00000100:00100000:0.0:1783444556.981114:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+102:73552:x1870073557868672:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444556.981137:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444556.981175:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e3833efa lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f73 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.981299:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.981313:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.981323:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.981338:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.981345:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.981360:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783444556.981743:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x392:0x0], index 0: 0 00010000:00010000:0.0:1783444556.981909:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e3833f0f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.981919:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e3833f0f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.981926:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e3833f0f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444556.981970:0:94373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c45e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94373:1870073575449088:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783444556.982020:0:94373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444556.982090:0:94373:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c56d1cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1783444556.982115:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.982124:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444556.982125:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575449088 00000100:00100000:2.0:1783444556.982130:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575449088 00010000:00010000:0.0:1783444556.982130:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.982136:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.982141:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6fe00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444556.982145:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.982154:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.982177:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444556.982180:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444556.982185:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.982191:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f01 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.982205:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b894cee reply state 0000000068b95089 transno 124554051637 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444556.982212:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5941 00010000:00010000:0.0:1783444556.982216:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444556.982219:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:94373:x1870073575449088:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1783444556.982222:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff9368f57c6100) 00010000:00010000:0.0:1783444556.982224:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.982227:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00080000:2.0:1783444556.982251:0:26201:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 930 00010000:00010000:0.0:1783444556.982255:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e3833efa lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f73 expref: 105 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.982267:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e3833f0f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f73 expref: 104 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.982274:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6000) 00010000:00010000:0.0:1783444556.982276:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444556.982278:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6f000, rc 0) 00000100:00100000:0.0:1783444556.982325:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+105:73552:x1870073557868672:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1213us (1618us total) trans 124554051637 rc 0/0 00000100:00100000:0.0:1783444556.982332:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1509 00000100:00080000:3.0:1783444556.985347:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444556.986249:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:94373:x1870073575449088:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4024us (4223us total) trans 4294969471 rc 0/0 00000100:00100000:2.0:1783444556.986262:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5941 00000100:00100000:2.0:1783444556.986510:0:94373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c45e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94373:1870073575449088:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783444556.986525:0:94373:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x392:0x0]-[0x280000401:0x3c1:0x0] 00000100:00100000:1.0:1783444556.986613:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.986698:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557868928 00000100:00100000:0.0:1783444556.986706:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557868928 00000100:00100000:0.0:1783444556.986753:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1510 00000100:00100000:0.0:1783444556.986762:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+105:73552:x1870073557868928:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:0.0:1783444556.986870:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444556.986897:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e3833f0f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f73 expref: 105 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.986915:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6000) 00010000:00010000:0.0:1783444556.986925:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444556.986987:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.987001:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.987011:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444556.987100:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2c68028 reply state 000000006fe1b00f transno 124554051638 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.987110:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444556.987116:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:0.0:1783444556.987118:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444556.987121:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444556.987189:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+106:73552:x1870073557868928:12345-192.168.204.20@tcp:36:touch.0 Request processed in 428us (577us total) trans 124554051638 rc 0/0 00000100:00100000:0.0:1783444556.987210:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1510 00000100:00100000:0.0:1783444556.988997:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.989068:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557869056 00000100:00100000:1.0:1783444556.989075:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557869056 00000100:00100000:1.0:1783444556.989119:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1511 00000100:00100000:1.0:1783444556.989126:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+106:73552:x1870073557869056:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.989144:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.989161:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833f24 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f7a expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.989202:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833f24 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f7a expref: 107 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.989214:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11000/0x42cb6883e3833f24 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f7a expref: 107 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.989228:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:1.0:1783444556.989230:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783444556.989234:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11000, rc 0) 00000100:00100000:1.0:1783444556.989277:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+107:73552:x1870073557869056:12345-192.168.204.20@tcp:101:touch.0 Request processed in 151us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444556.989283:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1511 00000100:00100000:2.0:1783444556.991023:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444556.991098:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557869184 00000100:00100000:0.0:1783444556.991106:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557869184 00000100:00100000:0.0:1783444556.991191:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5942 00000100:00100000:0.0:1783444556.991201:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+21:2403:x1870073557869184:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:0.0:1783444556.991390:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+22:2403:x1870073557869184:12345-192.168.204.20@tcp:2:touch.0 Request processed in 190us (370us total) trans 4294969472 rc 0/0 00000100:00100000:0.0:1783444556.991398:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5942 00000100:00100000:2.0:1783444556.993211:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444556.993293:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557869440 00000100:00100000:3.0:1783444556.993300:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557869440 00000100:00100000:3.0:1783444556.993366:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 262 00000100:00100000:3.0:1783444556.993385:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd12b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+107:73552:x1870073557869440:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444556.993664:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd12b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+108:73552:x1870073557869440:12345-192.168.204.20@tcp:35:touch.0 Request processed in 281us (456us total) trans 124554051639 rc 0/0 00000100:00100000:3.0:1783444556.993672:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 262 00000100:00100000:2.0:1783444556.996178:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444556.996388:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557869696 00000100:00100000:1.0:1783444556.996397:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557869696 00000100:00100000:1.0:1783444556.996480:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1512 00000100:00100000:1.0:1783444556.996489:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+108:73552:x1870073557869696:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444556.996523:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444556.996544:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f2b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f81 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.996749:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.996772:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.996785:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.996830:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.996838:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.996845:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444556.997209:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x393:0x0], index 0: 0 00010000:00010000:1.0:1783444556.997325:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833f40 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997443:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833f40 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997453:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833f40 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997501:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997509:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997515:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997523:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997529:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444556.997534:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997541:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997554:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444556.997557:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444556.997561:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997567:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f32 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444556.997580:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b32b432e reply state 000000006da943fe transno 124554051640 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997591:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997603:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff9367c98c8700) 00010000:00010000:1.0:1783444556.997606:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444556.997608:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444556.997815:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f2b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f81 expref: 111 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997835:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833f40 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f81 expref: 110 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444556.997843:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8000) 00010000:00010000:1.0:1783444556.997845:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444556.997848:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11e00, rc 0) 00000100:00100000:1.0:1783444556.997969:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+111:73552:x1870073557869696:12345-192.168.204.20@tcp:101:touch.0 Request processed in 1480us (1797us total) trans 124554051640 rc 0/0 00000100:00100000:1.0:1783444556.997978:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1512 00000100:00100000:2.0:1783444557.000314:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444557.000444:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557869952 00000100:00100000:1.0:1783444557.000453:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557869952 00000100:00100000:1.0:1783444557.000540:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1513 00000100:00100000:1.0:1783444557.000550:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+111:73552:x1870073557869952:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:1.0:1783444557.000607:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444557.000641:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833f40 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f81 expref: 111 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.000661:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8000) 00010000:00010000:1.0:1783444557.000673:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444557.000724:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.000749:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.000758:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444557.000894:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053e62283 reply state 0000000046c07ed8 transno 124554051641 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.000906:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.000913:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8300) 00010000:00010000:1.0:1783444557.000915:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444557.000918:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444557.000998:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9369018a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+112:73552:x1870073557869952:12345-192.168.204.20@tcp:36:touch.0 Request processed in 448us (688us total) trans 124554051641 rc 0/0 00000100:00100000:1.0:1783444557.001005:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1513 00000100:00100000:2.0:1783444557.002608:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444557.002720:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557870080 00000100:00100000:1.0:1783444557.002727:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557870080 00000100:00100000:1.0:1783444557.002858:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1514 00000100:00100000:1.0:1783444557.002867:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+112:73552:x1870073557870080:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444557.002887:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444557.002903:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e3833f55 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f88 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.002946:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e3833f55 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f88 expref: 113 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.002988:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10c00/0x42cb6883e3833f55 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f88 expref: 113 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.003005:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8300) 00010000:00010000:1.0:1783444557.003008:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783444557.003011:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10c00, rc 0) 00000100:00100000:1.0:1783444557.003049:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+113:73552:x1870073557870080:12345-192.168.204.20@tcp:101:touch.0 Request processed in 183us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444557.003055:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1514 00000100:00100000:2.0:1783444557.005001:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444557.005063:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557870208 00000100:00100000:1.0:1783444557.005069:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557870208 00000100:00100000:1.0:1783444557.005148:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5943 00000100:00100000:1.0:1783444557.005157:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+22:2404:x1870073557870208:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444557.005329:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+23:2404:x1870073557870208:12345-192.168.204.20@tcp:2:touch.0 Request processed in 173us (332us total) trans 4294969473 rc 0/0 00000100:00100000:1.0:1783444557.005337:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5943 00000100:00100000:0.0:1783444557.007293:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444557.007353:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557870464 00000100:00100000:2.0:1783444557.007360:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557870464 00000100:00100000:2.0:1783444557.007451:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 263 00000100:00100000:2.0:1783444557.007460:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+113:73552:x1870073557870464:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:2.0:1783444557.007712:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+114:73552:x1870073557870464:12345-192.168.204.20@tcp:35:touch.0 Request processed in 253us (424us total) trans 124554051642 rc 0/0 00000100:00100000:2.0:1783444557.007720:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 263 00000100:00100000:2.0:1783444557.010242:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444557.010336:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557870720 00000100:00100000:0.0:1783444557.010344:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557870720 00000100:00100000:0.0:1783444557.010430:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1515 00000100:00100000:0.0:1783444557.010439:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+114:73552:x1870073557870720:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444557.010461:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444557.010479:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e3833f5c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f8f expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.010581:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.010596:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.010606:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.010645:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.010652:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.010659:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783444557.010989:0:66225:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x394:0x0], index 0: 0 00010000:00010000:0.0:1783444557.011107:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e800/0x42cb6883e3833f71 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011117:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e800/0x42cb6883e3833f71 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011124:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e800/0x42cb6883e3833f71 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011155:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011163:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011168:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011174:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011181:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6fe00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444557.011190:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011199:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011210:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444557.011213:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444557.011217:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011223:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3833f63 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444557.011237:0:66225:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c0c119c reply state 0000000049780f15 transno 124554051643 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011247:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011253:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff9368f57c6000) 00010000:00010000:0.0:1783444557.011256:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444557.011258:0:66225:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783444557.011284:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e3833f5c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f8f expref: 117 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011297:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e800/0x42cb6883e3833f71 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f8f expref: 116 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.011304:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6f00) 00010000:00010000:0.0:1783444557.011306:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444557.011313:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6e800, rc 0) 00000100:00100000:0.0:1783444557.011379:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+117:73552:x1870073557870720:12345-192.168.204.20@tcp:101:touch.0 Request processed in 929us (1133us total) trans 124554051643 rc 0/0 00000100:00100000:0.0:1783444557.011387:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1515 00000100:00100000:3.0:1783444557.014121:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444557.014274:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557870976 00000100:00100000:0.0:1783444557.014282:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557870976 00000100:00100000:0.0:1783444557.014415:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1516 00000100:00100000:0.0:1783444557.014424:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c45e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+117:73552:x1870073557870976:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:0.0:1783444557.014478:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444557.014500:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e800/0x42cb6883e3833f71 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f8f expref: 117 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.014516:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6f00) 00010000:00010000:0.0:1783444557.014526:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444557.014569:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.014580:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.014589:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783444557.014688:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052c1bda4 reply state 0000000093838298 transno 124554051644 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.014699:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.014705:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:0.0:1783444557.014718:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444557.014721:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444557.014824:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c45e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+118:73552:x1870073557870976:12345-192.168.204.20@tcp:36:touch.0 Request processed in 400us (709us total) trans 124554051644 rc 0/0 00000100:00100000:0.0:1783444557.014831:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1516 00000100:00100000:2.0:1783444557.016251:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444557.016325:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557871104 00000100:00100000:3.0:1783444557.016387:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557871104 00000100:00100000:3.0:1783444557.016458:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1517 00000100:00100000:3.0:1783444557.016467:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+118:73552:x1870073557871104:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:3.0:1783444557.016483:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444557.016497:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91e00/0x42cb6883e3833f86 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f96 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444557.016534:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91e00/0x42cb6883e3833f86 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f96 expref: 119 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444557.016546:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91e00/0x42cb6883e3833f86 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f96 expref: 119 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444557.016560:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:3.0:1783444557.016563:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783444557.016566:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91e00, rc 0) 00000100:00100000:3.0:1783444557.016606:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+119:73552:x1870073557871104:12345-192.168.204.20@tcp:101:touch.0 Request processed in 141us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444557.016620:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1517 00000100:00100000:2.0:1783444557.018176:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444557.018266:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557871232 00000100:00100000:1.0:1783444557.018273:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557871232 00000100:00100000:1.0:1783444557.018353:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5944 00000100:00100000:1.0:1783444557.018362:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+23:2403:x1870073557871232:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444557.018584:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+24:2403:x1870073557871232:12345-192.168.204.20@tcp:2:touch.0 Request processed in 223us (412us total) trans 4294969474 rc 0/0 00000100:00100000:1.0:1783444557.018592:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5944 00000100:00100000:2.0:1783444557.020252:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444557.020313:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557871488 00000100:00100000:3.0:1783444557.020321:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557871488 00000100:00100000:3.0:1783444557.020393:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 264 00000100:00100000:3.0:1783444557.020402:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+119:73552:x1870073557871488:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:3.0:1783444557.020664:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+120:73552:x1870073557871488:12345-192.168.204.20@tcp:35:touch.0 Request processed in 262us (415us total) trans 124554051645 rc 0/0 00000100:00100000:3.0:1783444557.020670:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 264 00000100:00100000:0.0:1783444557.022620:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444557.023048:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557871744 00000100:00100000:1.0:1783444557.023069:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557871744 00000100:00100000:1.0:1783444557.023148:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1518 00000100:00100000:1.0:1783444557.023158:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+120:73552:x1870073557871744:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:1.0:1783444557.023180:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444557.023199:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833f8d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939f9d expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023294:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023306:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023318:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023329:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023336:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023343:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783444557.023675:0:66226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x395:0x0], index 0: 0 00010000:00010000:1.0:1783444557.023816:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833fa2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023824:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833fa2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023842:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833fa2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023876:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023884:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023890:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023897:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023904:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444557.023908:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023916:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023928:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444557.023931:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444557.023936:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023943:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e3833f94 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444557.023968:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b1bba4a reply state 00000000501179df transno 124554051646 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023987:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.023995:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff9367c98c8000) 00010000:00010000:1.0:1783444557.023997:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444557.023999:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783444557.024029:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e3833f8d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f9d expref: 123 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.024045:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833fa2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f9d expref: 122 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.024053:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8c00) 00010000:00010000:1.0:1783444557.024055:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444557.024057:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11c00, rc 0) 00000100:00100000:1.0:1783444557.024119:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e720c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+123:73552:x1870073557871744:12345-192.168.204.20@tcp:101:touch.0 Request processed in 962us (1510us total) trans 124554051646 rc 0/0 00000100:00100000:1.0:1783444557.024127:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1518 00000100:00100000:2.0:1783444557.026608:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444557.029496:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557872000 00000100:00100000:1.0:1783444557.029508:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557872000 00000100:00100000:1.0:1783444557.029627:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1519 00000100:00100000:1.0:1783444557.029638:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+123:73552:x1870073557872000:12345-192.168.204.20@tcp:36:touch.0 00010000:00010000:1.0:1783444557.029694:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444557.029719:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e3833fa2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939f9d expref: 123 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.029739:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8c00) 00010000:00010000:1.0:1783444557.029760:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444557.031086:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.031103:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.031113:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783444557.031219:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b49337bc reply state 00000000ec597939 transno 124554051647 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.031233:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444557.031239:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:1.0:1783444557.031242:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444557.031245:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444557.031333:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+124:73552:x1870073557872000:12345-192.168.204.20@tcp:36:touch.0 Request processed in 1696us (4729us total) trans 124554051647 rc 0/0 00000100:00100000:1.0:1783444557.031342:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1519 00000100:00100000:2.0:1783444557.033854:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444557.046071:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557872128 00000100:00100000:0.0:1783444557.046087:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557872128 00000100:00100000:0.0:1783444557.046177:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1520 00000100:00100000:0.0:1783444557.046187:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+124:73552:x1870073557872128:12345-192.168.204.20@tcp:101:touch.0 00010000:00010000:0.0:1783444557.046212:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444557.046233:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e800/0x42cb6883e3833fb7 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fa4 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.046294:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e800/0x42cb6883e3833fb7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fa4 expref: 125 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.046308:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e800/0x42cb6883e3833fb7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fa4 expref: 125 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444557.046325:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:0.0:1783444557.046329:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783444557.046333:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6e800, rc 0) 00000100:00100000:0.0:1783444557.049084:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+125:73552:x1870073557872128:12345-192.168.204.20@tcp:101:touch.0 Request processed in 2888us (15226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444557.049097:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1520 00000100:00100000:2.0:1783444557.052568:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444557.052711:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557872256 00000100:00100000:1.0:1783444557.052720:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557872256 00000100:00100000:1.0:1783444557.052771:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5945 00000100:00100000:1.0:1783444557.052780:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+24:2404:x1870073557872256:12345-192.168.204.20@tcp:2:touch.0 00000100:00100000:1.0:1783444557.053015:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2404:x1870073557872256:12345-192.168.204.20@tcp:2:touch.0 Request processed in 235us (454us total) trans 4294969475 rc 0/0 00000100:00100000:1.0:1783444557.053023:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5945 00000100:00100000:0.0:1783444557.055009:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444557.055173:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557872512 00000100:00100000:2.0:1783444557.055180:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557872512 00000100:00100000:2.0:1783444557.055227:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 265 00000100:00100000:2.0:1783444557.055235:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+125:73552:x1870073557872512:12345-192.168.204.20@tcp:35:touch.0 00000100:00100000:2.0:1783444557.055487:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+126:73552:x1870073557872512:12345-192.168.204.20@tcp:35:touch.0 Request processed in 252us (483us total) trans 124554051648 rc 0/0 00000100:00100000:2.0:1783444557.055496:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 265 00000100:00100000:0.0:1783444557.597733:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575449216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783444557.597839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444557.598060:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575449216 00000100:00100000:3.0:1783444557.598072:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575449216 00000100:00100000:3.0:1783444557.598137:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1783444557.598147:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575449216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783444557.598172:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444557.598223:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575449216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444557.598232:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1783444557.598278:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575449216:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783444557.598616:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783444557.599227:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575449344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444557.599269:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444557.599390:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444557.599400:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575449472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444557.599431:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444557.599461:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575449472 00000100:00100000:0.0:1783444557.599466:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575449472 00000100:00100000:0.0:1783444557.599500:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:0.0:1783444557.599506:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575449472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444557.599531:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444557.599564:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575449472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444557.599571:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:0.0:1783444557.599880:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575449472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444557.601192:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575449344 00000100:00100000:3.0:1783444557.601201:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575449344 00000100:00100000:3.0:1783444557.601270:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:3.0:1783444557.601281:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575449344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444557.601306:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444557.601383:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575449344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444557.601391:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:2.0:1783444557.602786:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575449344:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783444557.603641:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783444557.854964:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444557.899735:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444557.899778:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444557.900097:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557872640 00000100:00100000:3.0:1783444557.900107:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557872640 00000100:00100000:3.0:1783444557.900167:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:3.0:1783444557.900176:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557872640:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444557.900270:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557872640:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 94us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444557.900278:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:0.0:1783444557.900447:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557872896 00000100:00100000:0.0:1783444557.900452:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557872896 00000100:00100000:0.0:1783444557.900509:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1188 00000100:00100000:0.0:1783444557.900517:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557872896:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444557.900571:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557872896:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 55us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444557.900579:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1188 00000100:00080000:3.0:1783444557.900809:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444557.900896:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444557.900919:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444557.900963:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444557.901388:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557872768 00000100:00100000:3.0:1783444557.901393:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557872768 00000100:00100000:3.0:1783444557.901429:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1189 00000100:00100000:3.0:1783444557.901435:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+126:2403:x1870073557872768:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444557.901474:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+126:2403:x1870073557872768:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444557.901481:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1189 00000100:00100000:1.0:1783444557.901544:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557873152 00000100:00100000:1.0:1783444557.901548:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557873152 00000100:00100000:1.0:1783444557.901583:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557873024 00000100:00100000:1.0:1783444557.901586:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557873024 00000100:00100000:1.0:1783444557.901605:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2563 00000100:00100000:1.0:1783444557.901611:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557873152:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444557.901646:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557873152:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 35us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444557.901652:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2563 00000100:00100000:1.0:1783444557.901664:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2564 00000100:00100000:1.0:1783444557.901669:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2403:x1870073557873024:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444557.901688:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2403:x1870073557873024:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 19us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444557.901694:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2564 00000100:00080000:3.0:1783444557.902041:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444558.108994:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575449600:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.109074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444558.109169:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444558.109177:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575449984:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.109219:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444558.109256:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575450112:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.109277:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444558.109322:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444558.109328:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575450496:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.109360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444558.109396:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575450624:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.109417:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444558.109463:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783444558.109469:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575451008:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.109490:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444558.109525:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575451136:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.109564:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444558.109597:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575449984 00000100:00100000:0.0:1783444558.109604:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575449984 00000100:00100000:0.0:1783444558.110074:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575450112 00000100:00100000:0.0:1783444558.110079:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575450112 00000100:00100000:0.0:1783444558.110100:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575450624 00000100:00100000:0.0:1783444558.110103:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575450624 00000100:00100000:0.0:1783444558.110113:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575451136 00000100:00100000:0.0:1783444558.110115:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575451136 00000100:00100000:0.0:1783444558.110129:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1783444558.110137:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575449984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.110189:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575449984:12345-0@lo:400:kworker.0 Request processed in 52us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444558.110197:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1783444558.110235:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575449984:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.110273:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1783444558.110279:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575450112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.110312:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575450112:12345-0@lo:400:kworker.0 Request processed in 34us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444558.110319:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1783444558.110342:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575450112:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.110372:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1783444558.110378:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575450624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.110410:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575450624:12345-0@lo:400:kworker.0 Request processed in 32us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444558.110416:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1783444558.110438:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575450624:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.110455:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1783444558.110461:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575451136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.110492:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575451136:12345-0@lo:400:kworker.0 Request processed in 31us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444558.110498:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1783444558.110520:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575451136:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.110653:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575449856:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.110685:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444558.110715:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575450368:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.110746:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444558.110763:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575450880:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.110781:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444558.110829:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783444558.110835:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575449728:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.110857:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444558.110868:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575450240:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.110889:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444558.110904:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575450752:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.110921:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444558.110943:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575450496 00000100:00100000:2.0:1783444558.110947:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575450496 00000100:00100000:2.0:1783444558.110972:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575451008 00000100:00100000:2.0:1783444558.110974:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575451008 00000100:00100000:2.0:1783444558.110993:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575450368 00000100:00100000:2.0:1783444558.110995:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575450368 00000100:00100000:2.0:1783444558.111008:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575450880 00000100:00100000:2.0:1783444558.111010:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575450880 00000100:00100000:2.0:1783444558.111025:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1783444558.111031:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575450496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111069:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575450496:12345-0@lo:400:kworker.0 Request processed in 37us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.111075:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1783444558.111085:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1783444558.111090:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575451008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111112:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575451008:12345-0@lo:400:kworker.0 Request processed in 22us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.111125:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1783444558.111135:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1783444558.111140:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575450368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111168:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575450368:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.111173:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1783444558.111182:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1783444558.111188:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575450880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111212:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575450880:12345-0@lo:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.111217:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1783444558.111239:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575450240 00000100:00100000:2.0:1783444558.111242:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575450240 00000100:00100000:2.0:1783444558.111265:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575450752 00000100:00100000:2.0:1783444558.111268:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575450752 00000100:00100000:2.0:1783444558.111283:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:2.0:1783444558.111289:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575450240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111320:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575450240:12345-0@lo:400:kworker.0 Request processed in 31us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.111325:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:2.0:1783444558.111336:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:2.0:1783444558.111341:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575450752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111380:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575450752:12345-0@lo:400:kworker.0 Request processed in 39us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.111386:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:2.0:1783444558.111435:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575450240:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111445:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575450752:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111453:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575450368:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111463:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575450880:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111490:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575451008:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111501:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575450496:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111521:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575449856 00000100:00100000:2.0:1783444558.111524:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575449856 00000100:00100000:2.0:1783444558.111544:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575449728 00000100:00100000:2.0:1783444558.111546:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575449728 00000100:00100000:2.0:1783444558.111559:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1783444558.111565:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575449856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111599:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575449856:12345-0@lo:400:kworker.0 Request processed in 34us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.111606:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1783444558.111628:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575449856:0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111645:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1783444558.111651:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575449728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444558.111681:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575449728:12345-0@lo:400:kworker.0 Request processed in 31us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.111687:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1783444558.111706:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575449728:0@lo:400:kworker.0 00000100:00100000:1.0:1783444558.112362:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575449600 00000100:00100000:1.0:1783444558.112369:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575449600 00000100:00100000:1.0:1783444558.112404:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783444558.112411:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575449600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444558.112460:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575449600:12345-0@lo:400:kworker.0 Request processed in 49us (3386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444558.112467:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783444558.112520:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575449600:0@lo:400:kworker.0 00000100:00100000:0.0:1783444558.116035:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444558.116058:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575451264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444558.116127:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444558.116386:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783444558.116393:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444558.116396:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444558.116399:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444558.117226:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575451264 00000100:00100000:2.0:1783444558.117249:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575451264 00000100:00100000:2.0:1783444558.117294:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:2.0:1783444558.117302:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575451264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444558.117338:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00100000:2.0:1783444558.117415:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575451264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444558.117423:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:1.0:1783444558.117512:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c509ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575451264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444558.621314:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575451392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783444558.621394:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444558.621470:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575451392 00000100:00100000:1.0:1783444558.621477:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575451392 00000100:00100000:1.0:1783444558.621521:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1783444558.621529:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575451392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783444558.621553:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1783444558.621607:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1870073575451392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444558.621614:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1783444558.621660:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575451392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783444558.622103:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575451520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444558.622146:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444558.622364:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575451520 00000100:00100000:3.0:1783444558.622369:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575451520 00000100:00100000:3.0:1783444558.622407:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:3.0:1783444558.622415:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575451520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444558.622429:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444558.622474:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575451520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444558.622480:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1783444558.622551:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575451520:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783444558.878743:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444559.188706:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444559.188980:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557873280 00000100:00100000:2.0:1783444559.188989:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557873280 00000100:00100000:2.0:1783444559.189061:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1521 00000100:00100000:2.0:1783444559.189071:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+126:73579:x1870073557873280:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1783444559.189109:0:71469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00100000:2.0:1783444559.189182:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+126:73579:x1870073557873280:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 112us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444559.189190:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1521 00000100:00080000:3.0:1783444559.190582:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444559.196052:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444559.197036:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557873408 00000100:00100000:2.0:1783444559.197047:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557873408 00000100:00100000:2.0:1783444559.197126:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1522 00000100:00100000:2.0:1783444559.197136:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:73579:x1870073557873408:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1783444559.197171:0:66226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:2.0:1783444559.197249:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:73579:x1870073557873408:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 114us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444559.197257:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1522 00000100:00080000:3.0:1783444559.197318:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444559.205309:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444559.208857:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557873536 00000100:00100000:3.0:1783444559.208870:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557873536 00000100:00100000:3.0:1783444559.208950:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2040 00000100:00100000:3.0:1783444559.208959:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+25:73579:x1870073557873536:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:3.0:1783444559.208987:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1783444559.209059:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+25:73579:x1870073557873536:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 102us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444559.209065:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2040 00000100:00080000:0.0:1783444559.209300:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444559.212301:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444559.212443:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557873664 00000100:00100000:2.0:1783444559.212465:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557873664 00000100:00100000:2.0:1783444559.212694:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2041 00000100:00100000:2.0:1783444559.212704:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+7:73579:x1870073557873664:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1783444559.212734:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444559.212837:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:08efc25c-17e5-4d29-97d2-f1505f195a06+7:73579:x1870073557873664:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 134us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444559.212844:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2041 00000100:00080000:0.0:1783444559.215938:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783444559.906403:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783444560.339759:0:94354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051648 is committed 00010000:00010000:3.0:1783444560.340541:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340557:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340565:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340572:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.340577:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340585:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340605:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff9368c59a7900) 00010000:00010000:3.0:1783444560.340608:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.340613:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340639:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26600/0x42cb6883e3833c29 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340669:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340675:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340681:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340686:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0030200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.340689:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340694:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340702:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7300) 00010000:00010000:3.0:1783444560.340705:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.340707:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340713:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0030200/0x42cb6883e3833c3e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340724:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340731:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340743:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340747:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583e800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.340750:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340757:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340766:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff9367c98c8500) 00010000:00010000:3.0:1783444560.340768:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.340771:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.340777:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e3833c5a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341062:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341069:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341075:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341080:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341083:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341100:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341110:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9368f57c6a00) 00010000:00010000:3.0:1783444560.341113:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341116:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341121:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e3833c6f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341134:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341140:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341144:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341149:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fc00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341151:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341156:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341162:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff9367c98c8800) 00010000:00010000:3.0:1783444560.341165:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341167:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341180:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fc00/0x42cb6883e3833c8b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341194:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341199:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341204:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341208:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d71600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341211:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341216:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341223:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:3.0:1783444560.341226:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341228:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341233:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3833ca0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341242:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341247:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341258:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341263:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583fe00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341266:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341272:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341278:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff9367c98c8a00) 00010000:00010000:3.0:1783444560.341280:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341283:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341288:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fe00/0x42cb6883e3833cbc lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341301:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341318:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341323:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341328:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341330:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341345:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341353:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9368f57c6c00) 00010000:00010000:3.0:1783444560.341355:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341357:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341362:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e3833cd1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341372:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341377:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341381:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341385:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341387:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341392:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341397:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff9368d40f4200) 00010000:00010000:3.0:1783444560.341399:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341401:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341411:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e3833ced lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341425:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341430:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341435:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341440:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341442:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341447:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341453:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4d00) 00010000:00010000:3.0:1783444560.341455:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341458:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341463:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e3833d02 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341471:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341476:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341487:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341492:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341495:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341500:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341508:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff9367c98c8100) 00010000:00010000:3.0:1783444560.341511:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341513:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341627:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f600/0x42cb6883e3833d1e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341643:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341649:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341654:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341658:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341661:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341676:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341686:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:3.0:1783444560.341688:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341691:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341697:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70200/0x42cb6883e3833d33 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341710:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341716:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341722:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341727:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.341729:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341735:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341742:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff9368d40f4a00) 00010000:00010000:3.0:1783444560.341744:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.341747:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341759:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3833d4f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341773:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341779:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.341785:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342601:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ac00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.342605:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342612:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342623:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4700) 00010000:00010000:3.0:1783444560.342625:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.342628:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342635:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ac00/0x42cb6883e3833d64 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342651:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342657:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342672:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342677:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583ea00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.342680:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342687:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342696:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff9367c98c8600) 00010000:00010000:3.0:1783444560.342698:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.342701:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342706:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583ea00/0x42cb6883e3833d80 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342722:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342729:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342735:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342739:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.342742:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342758:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342766:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8400) 00010000:00010000:3.0:1783444560.342769:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.342772:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.342778:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f400/0x42cb6883e3833d95 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344587:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344603:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344610:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344616:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c583f000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.344620:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344629:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344645:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff9367c98c8200) 00010000:00010000:3.0:1783444560.344648:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.344652:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344674:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583f000/0x42cb6883e3833db1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344705:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344712:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344718:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344723:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.344726:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344732:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344741:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9368f57c6300) 00010000:00010000:3.0:1783444560.344743:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.344746:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344751:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e3833dc6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344765:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344770:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344781:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344806:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.344810:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344817:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344826:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff9367c98c8b00) 00010000:00010000:3.0:1783444560.344829:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.344832:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344837:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3833de2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344854:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344860:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344865:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344870:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.344873:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344889:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344898:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:3.0:1783444560.344900:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.344902:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344908:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e3833df7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344919:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344926:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344932:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344936:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513bc00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.344939:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344944:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344951:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff9368d40f4b00) 00010000:00010000:3.0:1783444560.344953:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.344956:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344967:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3833e13 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344982:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344988:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344993:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.344997:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345000:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345005:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345013:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:3.0:1783444560.345015:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345018:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345024:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3833e28 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345034:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345040:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345051:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345056:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345058:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345063:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345072:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff9368d40f4c00) 00010000:00010000:3.0:1783444560.345074:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345077:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345082:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833e44 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345096:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345101:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345106:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345111:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345113:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345128:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345136:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:3.0:1783444560.345138:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345141:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345146:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031e00/0x42cb6883e3833e59 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345155:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345161:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345166:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345171:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345173:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345179:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345186:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff9367c98c8d00) 00010000:00010000:3.0:1783444560.345188:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345191:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345202:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e3833e75 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345216:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345221:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345227:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345232:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c0031200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345235:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345241:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345249:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9368c59a7500) 00010000:00010000:3.0:1783444560.345251:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345254:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345260:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c0031200/0x42cb6883e3833e8a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345271:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345276:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345289:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345293:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345296:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345303:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345323:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff9368c59a7400) 00010000:00010000:3.0:1783444560.345325:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345328:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345335:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6c26800/0x42cb6883e3833ea6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345349:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345355:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345360:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345364:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345366:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345380:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345390:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368f57c6500) 00010000:00010000:3.0:1783444560.345392:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345394:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345399:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3833ebb lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345409:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345415:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345420:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345425:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345427:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345433:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345441:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff9367c98c8e00) 00010000:00010000:3.0:1783444560.345443:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345445:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345458:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3833ed7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345475:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345481:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345486:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345492:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345494:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345500:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345507:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9368c59a7e00) 00010000:00010000:3.0:1783444560.345509:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345511:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345517:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3833eec lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345529:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345535:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345547:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345553:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6f600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345556:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345562:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345571:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff9368f57c6100) 00010000:00010000:3.0:1783444560.345573:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345576:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345581:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3833f08 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345597:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345603:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345609:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345614:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6ec00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345617:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345632:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345641:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:3.0:1783444560.345643:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345646:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345652:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833f1d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345663:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345670:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345676:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345681:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345684:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345690:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345698:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff9367c98c8700) 00010000:00010000:3.0:1783444560.345700:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345702:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345713:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e3833f39 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345729:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345734:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345739:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345744:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345747:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345752:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345760:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8300) 00010000:00010000:3.0:1783444560.345762:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345765:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345770:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3833f4e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345779:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345785:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345824:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345830:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6e400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345833:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345840:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345849:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff9368f57c6000) 00010000:00010000:3.0:1783444560.345851:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345854:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345860:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833f6a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345875:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345881:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345886:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345891:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6ee00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345894:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345911:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345921:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:3.0:1783444560.345923:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345926:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345931:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833f7f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345944:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345949:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345954:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345959:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.345961:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345966:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345972:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff9367c98c8000) 00010000:00010000:3.0:1783444560.345974:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.345976:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.345987:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3833f9b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.346002:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.346008:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.346014:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.346019:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.346022:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.346028:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.346036:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:3.0:1783444560.346038:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.346041:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.346047:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3833fb0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783444560.359934:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969475 is committed 00000001:00080000:2.0:1783444560.359958:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969471 is committed 00000100:00100000:2.0:1783444560.671421:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444560.671711:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557873920 00000100:00100000:3.0:1783444560.671720:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557873920 00000100:00100000:3.0:1783444560.671781:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1523 00000100:00100000:3.0:1783444560.671803:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+31:73621:x1870073557873920:12345-192.168.204.20@tcp:36:mcreate.0 00010000:00010000:3.0:1783444560.671864:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444560.671889:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645800/0x42cb6883e3833ba4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e7e expref: 31 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.671908:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:3.0:1783444560.671912:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444560.671972:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.671986:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.671995:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672009:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672016:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672022:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672374:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672382:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672389:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672402:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672408:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444560.672412:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672421:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672430:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:3.0:1783444560.672433:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444560.672436:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672442:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3833fbe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783444560.672454:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071eaa4ba reply state 000000004cabaa71 transno 124554051649 ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672464:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444560.672470:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368ddc46e00) 00010000:00010000:3.0:1783444560.672473:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444560.672475:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444560.672542:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c509ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+32:73621:x1870073557873920:12345-192.168.204.20@tcp:36:mcreate.0 Request processed in 753us (1128us total) trans 124554051649 rc 0/0 00000100:00100000:3.0:1783444560.672549:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1523 00000100:00100000:0.0:1783444560.747554:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444560.748035:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557874048 00000100:00100000:0.0:1783444560.748045:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557874048 00000100:00100000:0.0:1783444560.748099:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1524 00000100:00100000:0.0:1783444560.748108:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+32:73624:x1870073557874048:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1783444560.748130:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444560.748149:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3833fcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fab expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.748208:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e3833fd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.748221:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e3833fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.748233:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e3833fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444560.748279:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444560.748283:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444560.748318:0:71469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e3833fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.748343:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3833fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fab expref: 34 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.748360:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e3833fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fab expref: 33 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.748387:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444560.748391:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444560.748410:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6fc00, rc 0) 00000100:00100000:0.0:1783444560.748464:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+33:73624:x1870073557874048:12345-192.168.204.20@tcp:101:rm.0 Request processed in 357us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444560.748471:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1524 00000100:00100000:1.0:1783444560.761488:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444560.761644:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557874176 00000100:00100000:0.0:1783444560.761655:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557874176 00000100:00100000:0.0:1783444560.761715:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1525 00000100:00100000:0.0:1783444560.761726:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+33:73624:x1870073557874176:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1783444560.761748:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444560.761768:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f400/0x42cb6883e3833fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fb2 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.761886:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.761900:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.761912:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.761924:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.761930:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.761948:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762031:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833fef lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762039:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833fef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762046:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833fef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444560.762087:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1a:0x0]: returning size 0 00000004:00200000:0.0:1783444560.762090:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444560.762107:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833fef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762119:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833fef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762127:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762133:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762139:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762145:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762161:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6ee00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444560.762165:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762171:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762183:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444560.762186:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444560.762191:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762197:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e3833fe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762211:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762217:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762222:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762227:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6e400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444560.762230:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762235:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762251:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368ddc46e00) 00010000:00010000:0.0:1783444560.762253:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444560.762256:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762275:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3833fe8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762311:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f400/0x42cb6883e3833fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fb2 expref: 35 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762325:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833fef lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fb2 expref: 34 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444560.762331:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff9368e7860000) 00010000:00010000:0.0:1783444560.762334:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444560.762337:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6ec00, rc 0) 00000100:00100000:0.0:1783444560.762391:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73624:x1870073557874176:12345-192.168.204.20@tcp:101:rm.0 Request processed in 668us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444560.762410:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1525 00000100:00100000:2.0:1783444560.778411:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444560.782916:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557874432 00000100:00100000:2.0:1783444560.782932:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557874432 00000100:00100000:2.0:1783444560.782996:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1526 00000100:00100000:2.0:1783444560.783007:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73624:x1870073557874432:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1783444560.783063:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783444560.783094:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3833fef lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fb2 expref: 34 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783114:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff9368e7860000) 00010000:00010000:2.0:1783444560.783130:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e3833fd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fab expref: 33 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783140:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:2.0:1783444560.783143:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444560.783167:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783189:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783199:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783211:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783218:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783224:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783344:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783353:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783360:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783736:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783746:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783754:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783772:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783779:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.783784:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.784373:0:67017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783444560.785746:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785758:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785766:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785771:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444560.785776:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785785:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785888:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff9368c59a7a00) 00010000:00010000:2.0:1783444560.785891:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783444560.785896:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785913:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834004 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785937:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785943:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785949:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785955:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785961:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444560.785964:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785970:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785979:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:2.0:1783444560.785982:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444560.785985:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.785991:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e3833ff6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783444560.786002:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2a57391 reply state 00000000834c6c2a transno 124554051650 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.786022:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444560.786029:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368ddc46e00) 00010000:00010000:2.0:1783444560.786031:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444560.786035:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444560.786134:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73624:x1870073557874432:12345-192.168.204.20@tcp:36:rm.0 Request processed in 3124us (7739us total) trans 124554051650 rc 0/0 00000100:00100000:2.0:1783444560.786143:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1526 00010000:00010000:1.0:1783444560.787030:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444560.787039:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444560.787047:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756000 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:1.0:1783444560.787051:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444560.787058:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444560.787071:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff9368c59a7a00) 00010000:00010000:1.0:1783444560.787074:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783444560.787077:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444560.787083:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e383400b lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444560.787110:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444560.787112:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444560.787114:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444560.926236:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444561.953513:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444562.717030:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444562.717052:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575451648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444562.717121:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444562.717311:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575451648 00000100:00100000:1.0:1783444562.717320:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575451648 00000100:00100000:1.0:1783444562.717378:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1783444562.717388:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575451648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783444562.717417:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:1.0:1783444562.717432:0:8423:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c5970e00 x1870073575451648/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:183/0 lens 224/368 e 0 to 0 dl 1783444573 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444562.717476:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575451648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444562.717483:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1783444562.717648:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444562.717657:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575451776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444562.717684:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783444562.717764:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444562.717821:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575451648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783444562.717844:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575451776 00000100:00100000:3.0:1783444562.717847:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575451776 00000100:00100000:3.0:1783444562.717879:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:3.0:1783444562.717885:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575451776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783444562.717900:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444562.717932:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575451776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444562.717938:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:3.0:1783444562.717964:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575451776:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783444562.718152:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783444562.726322:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783444562.726345:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575451904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444562.726415:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444562.726547:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575451904 00000100:00100000:2.0:1783444562.726565:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575451904 00000100:00100000:2.0:1783444562.726623:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:2.0:1783444562.726633:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575451904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444562.726666:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:2.0:1783444562.726723:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575451904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444562.726730:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:1.0:1783444562.726871:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575451904:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783444562.975106:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444563.018775:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444563.018847:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444563.018917:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557874688 00000100:00100000:3.0:1783444563.018926:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557874688 00000100:00100000:3.0:1783444563.018991:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1196 00000100:00100000:3.0:1783444563.019011:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+34:2403:x1870073557874688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444563.019087:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+34:2403:x1870073557874688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 88us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444563.019094:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1196 00000100:00080000:2.0:1783444563.019201:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444563.019728:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557874560 00000100:00100000:1.0:1783444563.019733:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557874560 00000100:00100000:1.0:1783444563.019776:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 178 00000100:00100000:1.0:1783444563.019784:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ea4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557874560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444563.019836:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ea4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557874560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 53us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.019843:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 178 00000100:00100000:2.0:1783444563.025215:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444563.025273:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444563.025425:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557874816 00000100:00100000:3.0:1783444563.025434:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557874816 00000100:00100000:3.0:1783444563.025506:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1197 00000100:00100000:3.0:1783444563.025530:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557874816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444563.025613:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557874816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 98us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444563.025621:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1197 00000100:00080000:2.0:1783444563.025621:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444563.026672:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557875072 00000100:00100000:1.0:1783444563.026680:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557875072 00000100:00100000:1.0:1783444563.026978:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2569 00000100:00100000:1.0:1783444563.026988:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557875072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444563.027049:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557875072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 63us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.027056:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2569 00000100:00100000:0.0:1783444563.031659:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444563.032130:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557874944 00000100:00100000:3.0:1783444563.032141:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557874944 00000100:00080000:2.0:1783444563.034202:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783444563.034351:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2570 00000100:00100000:3.0:1783444563.034368:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557874944:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000080:3.0:1783444563.034397:0:26210:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367ccd90000 x1870073557874944/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:184/0 lens 224/224 e 0 to 0 dl 1783444574 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444563.034472:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2403:x1870073557874944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 103us (2814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444563.034480:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2570 00000100:00080000:2.0:1783444563.035443:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444563.229488:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575452160:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.229573:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444563.229614:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575452672:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.229640:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444563.229659:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575453184:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.229679:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444563.229702:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1783444563.229708:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575452032:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.229732:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444563.229756:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575452544:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.229775:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444563.229814:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575453056:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.229836:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444563.229854:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575453568:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.229872:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444563.229899:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575452672 00000100:00100000:2.0:1783444563.229906:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575452672 00000100:00100000:2.0:1783444563.229944:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575453184 00000100:00100000:2.0:1783444563.229948:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575453184 00000100:00100000:2.0:1783444563.229968:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:2.0:1783444563.229974:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575452672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230024:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575452672:12345-0@lo:400:kworker.0 Request processed in 49us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444563.230031:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00100000:2.0:1783444563.230047:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:2.0:1783444563.230053:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575453184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230091:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575453184:12345-0@lo:400:kworker.0 Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444563.230098:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:2.0:1783444563.230124:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575452160 00000100:00100000:2.0:1783444563.230127:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575452160 00000100:00100000:2.0:1783444563.230158:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575452544 00000100:00100000:2.0:1783444563.230161:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575452544 00000100:00100000:2.0:1783444563.230176:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575453056 00000100:00100000:2.0:1783444563.230178:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575453056 00000100:00100000:2.0:1783444563.230187:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575453568 00000100:00100000:2.0:1783444563.230190:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575453568 00000100:00100000:2.0:1783444563.230201:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1783444563.230207:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575452160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230237:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575452160:12345-0@lo:400:kworker.0 Request processed in 30us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444563.230243:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1783444563.230267:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1783444563.230273:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575452544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230297:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575452544:12345-0@lo:400:kworker.0 Request processed in 25us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444563.230303:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1783444563.230312:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1783444563.230316:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575453056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230339:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575453056:12345-0@lo:400:kworker.0 Request processed in 22us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444563.230345:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1783444563.230355:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1783444563.230367:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575453568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230393:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575453568:12345-0@lo:400:kworker.0 Request processed in 27us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444563.230398:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00080000:2.0:1783444563.230423:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444563.230427:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444563.230458:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575452544:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230469:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575453056:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230477:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575453568:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230485:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575452160:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230493:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd19ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575452672:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.230500:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575453184:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.230676:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575452288:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.230710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444563.230733:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575452800:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.230755:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444563.230770:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575453312:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.230810:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444563.230828:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783444563.230834:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575452416:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.230856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444563.230873:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575452928:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.230893:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444563.230911:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575453440:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.230932:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444563.230958:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575452032 00000100:00100000:1.0:1783444563.230962:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575452032 00000100:00100000:1.0:1783444563.230991:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783444563.230998:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575452032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.231032:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575452032:12345-0@lo:400:kworker.0 Request processed in 34us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.231046:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783444563.231075:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575452288 00000100:00100000:1.0:1783444563.231079:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575452288 00000100:00100000:1.0:1783444563.231105:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575452416 00000100:00100000:1.0:1783444563.231108:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575452416 00000100:00100000:1.0:1783444563.231123:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1783444563.231128:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575452288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.231162:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575452288:12345-0@lo:400:kworker.0 Request processed in 33us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.231169:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1783444563.231180:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1783444563.231185:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575452416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.231412:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575452416:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.231420:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1783444563.231440:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575452800 00000100:00100000:1.0:1783444563.231444:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575452800 00000100:00100000:1.0:1783444563.231476:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575453312 00000100:00100000:1.0:1783444563.231479:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575453312 00000100:00100000:1.0:1783444563.231504:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575452928 00000100:00100000:1.0:1783444563.231507:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575452928 00000100:00100000:1.0:1783444563.231527:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575453440 00000100:00100000:1.0:1783444563.231529:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575453440 00000100:00100000:1.0:1783444563.231546:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1783444563.231552:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575452800:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444563.231566:0:17653:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff665f80 x1870073575452800/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:184/0 lens 224/224 e 0 to 0 dl 1783444574 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444563.231606:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575452800:12345-0@lo:400:kworker.0 Request processed in 53us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.231612:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1783444563.231625:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1783444563.231631:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575453312:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444563.231642:0:17653:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f9bda050 x1870073575453312/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:184/0 lens 224/224 e 0 to 0 dl 1783444574 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444563.231667:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575453312:12345-0@lo:400:kworker.0 Request processed in 36us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.231673:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1783444563.231820:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1783444563.231826:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575452928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.231853:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575452928:12345-0@lo:400:kworker.0 Request processed in 27us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.231859:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1783444563.231870:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1783444563.231876:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575453440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.231900:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575453440:12345-0@lo:400:kworker.0 Request processed in 25us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444563.231906:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00080000:1.0:1783444563.231944:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444563.231947:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783444563.231949:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783444563.231951:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783444563.231973:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575452416:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.231994:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575452928:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.232003:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575453440:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.232013:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575452288:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.232021:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575452800:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.232030:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575453312:0@lo:400:kworker.0 00000100:00100000:1.0:1783444563.232066:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575453696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444563.232092:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444563.232117:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575452032:0@lo:400:kworker.0 00000100:00100000:2.0:1783444563.232691:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575453696 00000100:00100000:2.0:1783444563.232696:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575453696 00000100:00100000:2.0:1783444563.232733:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:2.0:1783444563.232740:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575453696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444563.232773:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00100000:2.0:1783444563.232842:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575453696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444563.232848:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:1.0:1783444563.237885:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575453696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444563.741132:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444563.741156:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575453824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444563.741237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444563.741294:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575453824 00000100:00100000:3.0:1783444563.741300:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575453824 00000100:00100000:3.0:1783444563.741347:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1783444563.741357:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575453824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444563.741378:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444563.741417:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575453824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444563.741423:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1783444563.741484:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575453824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783444563.743359:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783444563.743382:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575453952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783444563.743436:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444563.747017:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575453952 00000100:00100000:2.0:1783444563.747032:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575453952 00000100:00100000:2.0:1783444563.747104:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1783444563.747114:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575453952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783444563.747147:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:2.0:1783444563.747163:0:8423:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c5973100 x1870073575453952/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:184/0 lens 224/368 e 0 to 0 dl 1783444574 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444563.747263:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575453952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444563.747271:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1783444563.747331:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575453952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783444563.999322:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444565.047871:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444566.109568:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783444566.837462:0:94354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051650 is committed 00010000:00010000:0.0:1783444566.837500:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.837523:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.837531:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.837537:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444566.837542:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.837550:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.837577:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368ddc46e00) 00010000:00010000:0.0:1783444566.837581:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444566.837587:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.837593:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3833fc5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.838067:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.838075:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.838081:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.838086:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444566.838096:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.838103:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.838112:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44bb5452 (ffff9368ddc46e00) 00010000:00010000:0.0:1783444566.838114:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444566.838118:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444566.838124:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e3833ffd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44bb5452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444567.134676:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444567.840912:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575454080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783444567.840990:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444567.841047:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575454080 00000100:00100000:2.0:1783444567.841055:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575454080 00000100:00100000:2.0:1783444567.841113:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1783444567.841132:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575454080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783444567.841172:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:2.0:1783444567.841187:0:13537:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c71d0e00 x1870073575454080/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:188/0 lens 224/368 e 0 to 0 dl 1783444578 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444567.841230:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575454080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444567.841237:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1783444567.841289:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575454080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444567.841650:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575454208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444567.841695:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783444567.841725:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444567.841735:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575454208 00000100:00100000:1.0:1783444567.841739:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575454208 00000100:00100000:1.0:1783444567.841769:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:1.0:1783444567.841776:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575454208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444567.841813:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444567.841847:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575454208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444567.841853:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00080000:1.0:1783444567.841869:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444567.841905:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575454208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444567.842970:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575454336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783444567.843020:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444567.843112:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575454336 00000100:00100000:2.0:1783444567.843118:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575454336 00000100:00100000:2.0:1783444567.843179:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1783444567.843188:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575454336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444567.843214:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:2.0:1783444567.843269:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5972300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575454336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444567.843276:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1783444567.843315:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575454336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444568.140947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444568.141000:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444568.141029:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444568.141056:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444568.141093:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444568.141127:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557875328 00000100:00100000:1.0:1783444568.141135:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557875328 00000100:00100000:1.0:1783444568.141201:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557875456 00000100:00100000:1.0:1783444568.141204:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557875456 00000100:00100000:1.0:1783444568.141229:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1204 00000100:00100000:1.0:1783444568.141239:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+30:2404:x1870073557875328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444568.141316:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+30:2404:x1870073557875328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 78us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.141324:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1204 00000100:00100000:1.0:1783444568.141344:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1205 00000100:00100000:1.0:1783444568.141351:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557875456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444568.141376:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557875456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.141382:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1205 00000100:00100000:1.0:1783444568.141400:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557875712 00000100:00100000:1.0:1783444568.141404:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557875712 00000100:00100000:1.0:1783444568.142697:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557875584 00000100:00100000:1.0:1783444568.142707:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557875584 00000100:00100000:1.0:1783444568.142816:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2575 00000100:00100000:1.0:1783444568.142827:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557875712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444568.142893:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557875712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 69us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.142901:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2575 00000100:00100000:1.0:1783444568.142917:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2576 00000100:00100000:1.0:1783444568.142924:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557875584:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000080:1.0:1783444568.142937:0:26204:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c5506d80 x1870073557875584/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:189/0 lens 224/224 e 0 to 0 dl 1783444579 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444568.142971:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2404:x1870073557875584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 48us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.142978:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2576 00000100:00100000:2.0:1783444568.143052:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557875200 00000100:00100000:2.0:1783444568.143057:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557875200 00000100:00100000:2.0:1783444568.143092:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:2.0:1783444568.143099:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557875200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1783444568.143127:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557875200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444568.143134:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00080000:0.0:1783444568.150853:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783444568.150864:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444568.150868:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444568.150871:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783444568.156992:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444568.349341:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575454592:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.349411:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444568.349446:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575455104:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.349471:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444568.349487:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e729bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575455616:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.349504:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444568.349527:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783444568.349533:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575454720:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.349552:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444568.349568:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575455232:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.349608:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444568.349640:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e729a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575455744:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.349661:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444568.349695:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575454592 00000100:00100000:0.0:1783444568.349702:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575454592 00000100:00100000:0.0:1783444568.349751:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575454720 00000100:00100000:0.0:1783444568.349755:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575454720 00000100:00100000:0.0:1783444568.349777:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1783444568.349785:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575454592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.349854:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1870073575454592:12345-0@lo:400:kworker.0 Request processed in 68us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444568.349861:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1783444568.349876:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1783444568.349882:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575454720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.349908:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1870073575454720:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444568.349914:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1783444568.349935:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575455104 00000100:00100000:1.0:1783444568.350102:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575454464:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350138:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444568.350182:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575454976:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350204:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444568.350223:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575455488:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350241:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444568.350253:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575456000:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350270:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444568.350287:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783444568.350293:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575454848:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350312:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444568.350322:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575455360:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350340:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444568.350363:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e7299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575455872:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350382:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444568.350407:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575455232 00000100:00100000:1.0:1783444568.350410:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575455232 00000100:00100000:1.0:1783444568.350434:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575455744 00000100:00100000:1.0:1783444568.350437:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575455744 00000100:00100000:1.0:1783444568.350456:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575455360 00000100:00100000:1.0:1783444568.350458:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575455360 00000100:00100000:1.0:1783444568.350471:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575455872 00000100:00100000:1.0:1783444568.350473:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575455872 00000100:00100000:1.0:1783444568.350490:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:1.0:1783444568.350496:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575455232:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444568.350511:0:26206:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c4a64000 x1870073575455232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:189/0 lens 224/224 e 0 to 0 dl 1783444579 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444568.350540:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575455232:12345-0@lo:400:kworker.0 Request processed in 44us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.350547:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:1.0:1783444568.350558:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1783444568.350564:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575455744:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1783444568.350574:0:26206:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c4a65f80 x1870073575455744/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:189/0 lens 224/224 e 0 to 0 dl 1783444579 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444568.350596:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575455744:12345-0@lo:400:kworker.0 Request processed in 33us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.350602:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1783444568.350612:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1783444568.350617:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575455360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350644:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575455360:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.350656:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1783444568.350669:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1783444568.350674:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575455872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350703:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575455872:12345-0@lo:400:kworker.0 Request processed in 29us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.350709:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1783444568.350748:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575455360:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350758:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575455872:0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350817:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575454976 00000100:00100000:1.0:1783444568.350820:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575454976 00000100:00100000:1.0:1783444568.350839:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575455488 00000100:00100000:1.0:1783444568.350842:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575455488 00000100:00100000:1.0:1783444568.350851:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575456000 00000100:00100000:1.0:1783444568.350853:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575456000 00000100:00100000:1.0:1783444568.350861:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575454848 00000100:00100000:1.0:1783444568.350863:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575454848 00000100:00100000:1.0:1783444568.350875:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1783444568.350881:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575454976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444568.350915:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575454976:12345-0@lo:400:kworker.0 Request processed in 34us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.350921:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1783444568.350932:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:1.0:1783444568.350938:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575455488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444568.351059:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575454464 00000100:00100000:3.0:1783444568.351064:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575454464 00000100:00100000:3.0:1783444568.351091:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783444568.351097:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575454464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.351149:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575455104 00000100:00100000:0.0:1783444568.351192:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575455616 00000100:00100000:0.0:1783444568.351195:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575455616 00000100:00100000:0.0:1783444568.351216:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1783444568.351221:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575455104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444568.351339:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575454464:12345-0@lo:400:kworker.0 Request processed in 241us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444568.351346:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1783444568.351528:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1783444568.351537:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575455616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444568.351572:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575455616:12345-0@lo:400:kworker.0 Request processed in 37us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444568.351578:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1783444568.351600:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1783444568.351606:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575456000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444568.351634:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575456000:12345-0@lo:400:kworker.0 Request processed in 29us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444568.351639:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1783444568.351653:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1783444568.351659:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575454848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444568.351685:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575454848:12345-0@lo:400:kworker.0 Request processed in 27us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444568.351702:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1783444568.351719:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444568.351730:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575456128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444568.351761:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444568.351802:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575456128 00000100:00100000:2.0:1783444568.351807:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575456128 00000100:00100000:2.0:1783444568.351825:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1783444568.351831:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3636:x1870073575456128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444568.351855:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00100000:2.0:1783444568.351888:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3636:x1870073575456128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444568.351893:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1783444568.351923:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575456128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783444568.352362:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1870073575454720:0@lo:400:kworker.0 00000100:00100000:2.0:1783444568.352374:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368c59bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575455232:0@lo:400:kworker.0 00000100:00100000:2.0:1783444568.352387:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e729a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575455744:0@lo:400:kworker.0 00000100:00100000:2.0:1783444568.352399:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3635:1870073575454592:0@lo:400:kworker.0 00000100:00100000:2.0:1783444568.352408:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e729bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575455616:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.354261:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575455104:12345-0@lo:400:kworker.0 Request processed in 3032us (4781us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444568.354274:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1783444568.354384:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575455104:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.356475:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575454848:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.356510:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575454464:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.356523:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575454976:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.356534:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575456000:0@lo:400:kworker.0 00000100:00080000:2.0:1783444568.356619:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444568.356626:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783444568.356629:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444568.356633:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444568.356761:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575455488:12345-0@lo:400:kworker.0 Request processed in 5820us (6515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444568.356773:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1783444568.356887:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e7298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575455488:0@lo:400:kworker.0 00000100:00100000:0.0:1783444568.861426:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444568.861447:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c5971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575456256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444568.861504:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444568.862323:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575456256 00000100:00100000:3.0:1783444568.862332:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575456256 00000100:00100000:3.0:1783444568.862378:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1783444568.862388:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575456256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783444568.862411:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:3.0:1783444568.862425:0:8423:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c4a64a80 x1870073575456256/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:189/0 lens 224/368 e 0 to 0 dl 1783444579 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444568.862469:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575456256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444568.862476:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:0.0:1783444568.862777:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c5971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575456256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783444568.863498:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444568.863522:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c71d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575456384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444568.863568:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444568.863725:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575456384 00000100:00100000:0.0:1783444568.863731:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575456384 00000100:00100000:0.0:1783444568.863773:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1783444568.863782:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575456384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444568.863850:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783444568.863887:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575456384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444568.863893:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1783444568.863927:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c71d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575456384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783444569.186728:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783444569.681595:0:95893:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:2.0:1783444569.895711:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444569.897206:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557875840 00000100:00100000:0.0:1783444569.897221:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557875840 00000100:00100000:0.0:1783444569.897368:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1527 00000100:00100000:0.0:1783444569.897379:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+30:73702:x1870073557875840:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444569.897400:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444569.897421:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3834012 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fb9 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.897484:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e200/0x42cb6883e3834019 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.897498:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e200/0x42cb6883e3834019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.897509:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e200/0x42cb6883e3834019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444569.897550:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783444569.897553:0:71469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783444569.897587:0:71469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e200/0x42cb6883e3834019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.897609:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fe00/0x42cb6883e3834012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fb9 expref: 32 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.897629:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e200/0x42cb6883e3834019 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fb9 expref: 31 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.897638:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444569.897641:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444569.897645:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6e200, rc 0) 00000100:00100000:0.0:1783444569.897698:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+31:73702:x1870073557875840:12345-192.168.204.20@tcp:101:dd.0 Request processed in 322us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444569.897711:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1527 00000100:00100000:3.0:1783444569.898051:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444569.910470:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557875968 00000100:00100000:2.0:1783444569.910484:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557875968 00000100:00100000:2.0:1783444569.910546:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1528 00000100:00100000:2.0:1783444569.910556:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+31:73703:x1870073557875968:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444569.910577:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444569.910600:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756e00/0x42cb6883e3834020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fc0 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.910666:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756200/0x42cb6883e3834027 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.910681:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756200/0x42cb6883e3834027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.910694:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756200/0x42cb6883e3834027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444569.910704:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000004:00200000:2.0:1783444569.910742:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444569.910746:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444569.910766:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756200/0x42cb6883e3834027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.910863:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756e00/0x42cb6883e3834020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fc0 expref: 33 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.910882:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756200/0x42cb6883e3834027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fc0 expref: 32 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.910891:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:2.0:1783444569.910905:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444569.910909:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756200, rc 0) 00000100:00100000:2.0:1783444569.910962:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+32:73703:x1870073557875968:12345-192.168.204.20@tcp:101:dd.0 Request processed in 407us (12912us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444569.910969:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1528 00000100:00100000:2.0:1783444569.910984:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557876096 00000100:00100000:2.0:1783444569.910988:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557876096 00000100:00100000:2.0:1783444569.911005:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1529 00000100:00100000:2.0:1783444569.911011:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+32:73704:x1870073557876096:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444569.911019:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444569.911026:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756c00/0x42cb6883e383402e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fc7 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.911050:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834035 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.911058:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.911066:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444569.911082:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783444569.911085:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783444569.911093:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.911107:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756c00/0x42cb6883e383402e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fc7 expref: 34 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.911144:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fc7 expref: 33 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444569.911151:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:2.0:1783444569.911153:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783444569.911155:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757800, rc 0) 00000100:00100000:2.0:1783444569.911176:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+33:73704:x1870073557876096:12345-192.168.204.20@tcp:101:dd.0 Request processed in 165us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444569.911183:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1529 00000100:00100000:2.0:1783444569.912666:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444569.912770:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444569.923704:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557876224 00000100:00100000:0.0:1783444569.923722:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557876224 00000100:00100000:3.0:1783444569.923726:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557876352 00000100:00100000:3.0:1783444569.923751:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557876352 00000100:00100000:0.0:1783444569.923916:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1530 00000100:00100000:0.0:1783444569.923930:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73705:x1870073557876224:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444569.923951:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444569.923973:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383403c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fce expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.924054:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834043 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.924071:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.924083:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444569.924142:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783444569.924144:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1531 00000004:00200000:0.0:1783444569.924152:0:66226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1783444569.924164:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+35:73706:x1870073557876352:12345-192.168.204.20@tcp:101:dd.0 00000004:00010000:0.0:1783444569.924178:0:66226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834043 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444569.924185:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444569.924208:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383404a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fd5 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.924216:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383403c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fce expref: 36 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.924245:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834043 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fce expref: 36 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.924275:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:3.0:1783444569.924277:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834051 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.924280:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783444569.924288:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6e600, rc 0) 00010000:00010000:3.0:1783444569.924306:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444569.924320:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444569.924359:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783444569.924363:0:80475:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783444569.924396:0:80475:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444569.924419:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383404a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fd5 expref: 37 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444569.924436:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fd5 expref: 36 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444569.924445:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:3.0:1783444569.924448:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783444569.924451:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90200, rc 0) 00000100:00100000:0.0:1783444569.924609:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+36:73705:x1870073557876224:12345-192.168.204.20@tcp:101:dd.0 Request processed in 680us (11947us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444569.924618:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1530 00000100:00100000:3.0:1783444569.924961:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+35:73706:x1870073557876352:12345-192.168.204.20@tcp:101:dd.0 Request processed in 801us (12187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444569.924978:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1531 00000100:00100000:2.0:1783444569.935669:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444569.935707:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444569.935843:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557876480 00000100:00100000:0.0:1783444569.935850:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557876736 00000100:00100000:1.0:1783444569.935854:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557876480 00000100:00100000:0.0:1783444569.935867:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557876736 00000100:00100000:0.0:1783444569.935928:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1532 00000100:00100000:0.0:1783444569.935939:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+36:73702:x1870073557876736:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444569.935963:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444569.935986:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834058 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fe3 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936161:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936176:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936188:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936203:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936209:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936234:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936296:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f400/0x42cb6883e383406d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936304:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f400/0x42cb6883e383406d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936312:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f400/0x42cb6883e383406d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444569.936321:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 0 00010000:00010000:0.0:1783444569.936412:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936420:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936427:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936434:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936443:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6ee00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444569.936448:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936457:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936484:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444569.936487:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444569.936493:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936500:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e383405f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936516:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936522:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936528:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936533:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6e400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444569.936536:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936542:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936550:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff9368e7860700) 00010000:00010000:0.0:1783444569.936552:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444569.936555:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936560:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834066 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936620:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834058 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fe3 expref: 39 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936635:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f400/0x42cb6883e383406d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fe3 expref: 38 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.936642:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368d40f4900) 00010000:00010000:0.0:1783444569.936644:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444569.936646:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6f400, rc 0) 00000100:00100000:2.0:1783444569.936833:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444569.937672:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444569.939300:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1533 00000100:00100000:1.0:1783444569.939322:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+38:73707:x1870073557876480:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444569.939343:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444569.939369:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383407b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fdc expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.939441:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3834082 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.939455:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3834082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.939466:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3834082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444569.939531:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783444569.939535:0:66225:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783444569.939557:0:66225:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3834082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.939581:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383407b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fdc expref: 40 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.939601:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3834082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fdc expref: 39 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444569.939613:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+39:73702:x1870073557876736:12345-192.168.204.20@tcp:101:dd.0 Request processed in 3672us (3901us total) trans 124554051651 rc 0/0 00000100:00100000:0.0:1783444569.939622:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1532 00010000:00010000:1.0:1783444569.939623:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:1.0:1783444569.939628:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783444569.939649:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11a00, rc 0) 00000100:00100000:1.0:1783444569.939681:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+38:73707:x1870073557876480:12345-192.168.204.20@tcp:101:dd.0 Request processed in 370us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444569.939688:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1533 00000100:00100000:3.0:1783444569.940151:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557876864 00000100:00100000:3.0:1783444569.940160:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557876864 00000100:00100000:3.0:1783444569.940238:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557876992 00000100:00100000:3.0:1783444569.940242:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557876992 00000100:00100000:1.0:1783444569.940278:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 751 00000100:00100000:2.0:1783444569.940281:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444569.940289:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+39:2402:x1870073557876864:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444569.940300:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444569.940316:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756200/0x42cb6883e3834027 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fc0 expref: 39 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.940331:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:1.0:1783444569.940335:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444569.940356:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+38:2402:x1870073557876864:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 71us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444569.940364:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 751 00000100:00100000:1.0:1783444569.940381:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557877120 00000100:00100000:1.0:1783444569.940384:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557877120 00000100:00100000:1.0:1783444569.940414:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 752 00000100:00100000:2.0:1783444569.940418:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444569.940425:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+38:2404:x1870073557876992:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444569.940437:0:8436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444569.940450:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757800/0x42cb6883e3834035 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fc7 expref: 38 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.940463:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:1.0:1783444569.940466:0:8436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444569.940589:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+37:2404:x1870073557876992:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 165us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444569.940608:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 752 00000100:00100000:0.0:1783444569.940614:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557877248 00000100:00100000:0.0:1783444569.940619:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557877248 00000100:00100000:0.0:1783444569.944144:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 753 00000100:00100000:0.0:1783444569.944171:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+37:2401:x1870073557877120:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444569.944192:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444569.944220:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834043 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fce expref: 37 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.944241:0:19646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444569.944246:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444569.944318:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+36:2401:x1870073557877120:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 160us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444569.944325:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 753 00000100:00100000:0.0:1783444569.944363:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 754 00000100:00100000:0.0:1783444569.944372:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+35:2403:x1870073557877248:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783444569.944380:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444569.944392:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834051 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fd5 expref: 35 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.944403:0:19646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:0.0:1783444569.944406:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444569.944424:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+34:2403:x1870073557877248:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 53us (4010us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444569.944430:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 754 00000100:00100000:0.0:1783444569.949369:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444569.949603:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557877504 00000100:00100000:1.0:1783444569.949613:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557877504 00000100:00100000:1.0:1783444569.949675:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1534 00000100:00100000:1.0:1783444569.949687:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73702:x1870073557877504:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444569.949714:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444569.951273:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3834089 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fea expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.951316:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3834090 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.951330:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3834090 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.951341:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3834090 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.951462:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e3834089 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fea expref: 36 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.951482:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10a00/0x42cb6883e3834090 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fea expref: 35 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.951490:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368d40f4900) 00010000:00010000:1.0:1783444569.951569:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783444569.951574:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10a00, rc 0) 00000100:00100000:1.0:1783444569.951963:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+35:73702:x1870073557877504:12345-192.168.204.20@tcp:101:dd.0 Request processed in 2277us (2600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444569.951979:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1534 00000100:00100000:3.0:1783444569.958277:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444569.958390:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444569.958459:0:19646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557877376 00000100:00100000:1.0:1783444569.958469:0:19646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557877376 00000100:00100000:1.0:1783444569.958547:0:19646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 755 00000100:00100000:1.0:1783444569.958557:0:19646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+35:2401:x1870073557877376:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783444569.958572:0:19646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444569.958596:0:19646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e3834082 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fdc expref: 35 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.958615:0:19646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9368c3c3f800) 00010000:00010000:1.0:1783444569.958620:0:19646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444569.958674:0:19646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+34:2401:x1870073557877376:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 119us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444569.958682:0:19646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 755 00000100:00100000:0.0:1783444569.959279:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557877760 00000100:00100000:0.0:1783444569.959285:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557877760 00000100:00100000:0.0:1783444569.959329:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1535 00000100:00100000:0.0:1783444569.959336:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73708:x1870073557877760:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444569.959353:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444569.959369:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3834097 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ff1 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959488:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959513:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959525:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959561:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959569:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959576:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959641:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38340ac lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959650:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38340ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.959657:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38340ac lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444569.959666:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 0 00000100:00100000:3.0:1783444569.960200:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1783444569.960220:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960230:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960236:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960243:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960250:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6f600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444569.960265:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960273:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960285:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444569.960289:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444569.960293:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960299:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e383409e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960312:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960318:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960323:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960328:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6fc00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444569.960331:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960337:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960343:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff9368e7860300) 00010000:00010000:0.0:1783444569.960345:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444569.960355:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960361:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e38340a5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960405:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ec00/0x42cb6883e3834097 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ff1 expref: 37 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960419:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38340ac lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ff1 expref: 36 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960427:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:0.0:1783444569.960429:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444569.960431:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6ea00, rc 0) 00000100:00100000:0.0:1783444569.960499:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+36:73708:x1870073557877760:12345-192.168.204.20@tcp:101:dd.0 Request processed in 1154us (2224us total) trans 124554051652 rc 0/0 00000100:00100000:0.0:1783444569.960507:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1535 00000100:00100000:0.0:1783444569.960531:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557878016 00000100:00100000:0.0:1783444569.960536:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557878016 00000100:00100000:0.0:1783444569.960564:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1536 00000100:00100000:0.0:1783444569.960572:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+36:73702:x1870073557878016:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1783444569.960601:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444569.960616:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f400/0x42cb6883e383406d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fe3 expref: 36 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.960626:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368d40f4900) 00010000:00010000:0.0:1783444569.960629:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444569.963337:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.963361:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.963373:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444569.963441:0:66226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051653 00000004:00010000:0.0:1783444569.963480:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027339bf3 reply state 000000006fad1fe3 transno 124554051654 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.963623:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444569.963632:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368d40f4900) 00010000:00010000:0.0:1783444569.963635:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444569.963639:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444569.968407:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+38:73702:x1870073557878016:12345-192.168.204.20@tcp:36:dd.0 Request processed in 7825us (8199us total) trans 124554051654 rc 0/0 00000100:00100000:1.0:1783444569.968421:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1536 00000020:00080000:1.0:1783444569.968430:0:66226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783444569.974508:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444569.979544:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444569.987470:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557878400 00000100:00100000:0.0:1783444569.987488:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557878400 00000100:00100000:1.0:1783444569.989659:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557878144 00000100:00100000:1.0:1783444569.989674:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557878144 00000100:00100000:1.0:1783444569.989781:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1537 00000100:00100000:1.0:1783444569.989807:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+39:73708:x1870073557878144:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444569.989833:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444569.990188:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e38340c1 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939ff8 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.990250:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e38340c8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.990264:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e38340c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.990275:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e38340c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.990399:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e38340c1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ff8 expref: 41 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.990418:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11c00/0x42cb6883e38340c8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ff8 expref: 40 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.990426:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:1.0:1783444569.990429:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783444569.990432:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11c00, rc 0) 00000100:00100000:1.0:1783444569.991165:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+40:73708:x1870073557878144:12345-192.168.204.20@tcp:101:dd.0 Request processed in 1371us (11629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444569.991173:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1537 00000100:00100000:1.0:1783444569.991233:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1538 00000100:00100000:1.0:1783444569.991239:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+39:73717:x1870073557878400:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444569.991252:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444569.991267:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e38340cf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc9939fff expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991395:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991405:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991414:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991428:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991434:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991440:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991488:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e38340e4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991573:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e38340e4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991581:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e38340e4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444569.991591:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 0 00010000:00010000:1.0:1783444569.991664:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991672:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991683:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991690:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991696:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444569.991700:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991707:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.991718:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444569.991721:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444569.991725:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992612:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e38340d6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992630:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992636:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992643:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992648:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444569.992659:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992665:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992677:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff9368c3abdf00) 00010000:00010000:1.0:1783444569.992679:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444569.992683:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992688:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e38340dd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.992988:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e38340cf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fff expref: 42 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.993003:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e38340e4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fff expref: 41 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444569.993010:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9368c59a7e00) 00010000:00010000:1.0:1783444569.993013:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444569.993015:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11800, rc 0) 00000100:00100000:1.0:1783444569.995112:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+41:73717:x1870073557878400:12345-192.168.204.20@tcp:101:dd.0 Request processed in 3857us (20597us total) trans 124554051655 rc 0/0 00000100:00100000:1.0:1783444569.995135:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1538 00000100:00100000:1.0:1783444570.000227:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.000533:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557878528 00000100:00100000:2.0:1783444570.000544:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557878528 00000100:00100000:2.0:1783444570.000607:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5946 00000100:00100000:2.0:1783444570.000619:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+5:73702:x1870073557878528:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.000638:0:26207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.000659:0:26207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38340f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a006 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444570.000704:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x382:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:2.0:1783444570.000751:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:2.0:1783444570.000756:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444570.000765:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38340f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a006 expref: 6 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.000782:0:26207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38340f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a006 expref: 6 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.000821:0:26207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756e00, rc 0) 00010000:00000080:2.0:1783444570.000829:0:26207:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c5504e00 x1870073557878528/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.000892:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+6:73702:x1870073557878528:12345-192.168.204.20@tcp:101:dd.0 Request processed in 275us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444570.000899:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5946 00000100:00100000:3.0:1783444570.003503:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.003976:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557878784 00000100:00100000:1.0:1783444570.003987:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557878784 00000100:00100000:1.0:1783444570.004049:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1539 00000100:00100000:1.0:1783444570.004096:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+41:73708:x1870073557878784:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1783444570.004163:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444570.004195:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38340ac lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939ff1 expref: 41 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.004216:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:1.0:1783444570.004221:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444570.004420:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.004434:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.004443:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783444570.004487:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051656 00000004:00010000:1.0:1783444570.004519:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e36f7c94 reply state 00000000c0998564 transno 124554051657 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.004531:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.004537:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:1.0:1783444570.004541:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444570.004544:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444570.004625:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+43:73708:x1870073557878784:12345-192.168.204.20@tcp:36:dd.0 Request processed in 540us (1139us total) trans 124554051657 rc 0/0 00000100:00100000:1.0:1783444570.004633:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1539 00000020:00080000:1.0:1783444570.004638:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1783444570.005115:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444570.007966:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.008190:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.008272:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557879040 00000100:00100000:3.0:1783444570.008283:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557879040 00000100:00100000:3.0:1783444570.008346:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1540 00000100:00100000:3.0:1783444570.008357:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+43:73709:x1870073557879040:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.008384:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.008407:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834100 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a00d expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008559:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008573:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008584:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008599:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008620:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008627:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008691:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3834115 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008698:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3834115 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008705:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3834115 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444570.008715:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 0 00010000:00010000:3.0:1783444570.008828:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008835:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008841:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.008848:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009039:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.009043:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009136:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009151:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444570.009154:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.009159:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009165:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834107 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009178:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009184:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009189:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009194:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.009197:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009203:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009210:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff9367c98c8700) 00010000:00010000:3.0:1783444570.009213:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.009216:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009233:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383410e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009276:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834100 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a00d expref: 46 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009290:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3834115 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a00d expref: 45 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.009297:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4700) 00010000:00010000:3.0:1783444570.009299:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444570.009301:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90000, rc 0) 00000100:00100000:3.0:1783444570.009363:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+45:73709:x1870073557879040:12345-192.168.204.20@tcp:101:dd.0 Request processed in 1008us (1642us total) trans 124554051658 rc 0/0 00000100:00100000:3.0:1783444570.009371:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1540 00000100:00100000:3.0:1783444570.014174:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.014393:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557879296 00000100:00100000:0.0:1783444570.014403:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557879296 00000100:00100000:0.0:1783444570.014483:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5947 00000100:00100000:0.0:1783444570.014506:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+6:73708:x1870073557879296:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.014525:0:8421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.014546:0:8421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e467d6bb/0x42cb6883e3834123 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a014 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444570.014575:0:8421:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x388:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:0.0:1783444570.014600:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:0.0:1783444570.014619:0:8421:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444570.014628:0:8421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e467d6bb/0x42cb6883e3834123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a014 expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.014646:0:8421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e467d6bb/0x42cb6883e3834123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a014 expref: 7 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.014660:0:8421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6f400, rc 0) 00010000:00000080:0.0:1783444570.014668:0:8421:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd170000 x1870073557879296/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.014738:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+7:73708:x1870073557879296:12345-192.168.204.20@tcp:101:dd.0 Request processed in 225us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.014745:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5947 00000100:00080000:2.0:1783444570.014944:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783444570.019904:0:24872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557879168 00000100:00100000:1.0:1783444570.019922:0:24872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557879168 00002000:00010000:1.0:1783444570.019968:0:24872:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/898 (0->18446744073709551615) 00002000:00100000:1.0:1783444570.019973:0:24872:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5505500 with x1870073557879168 ext(0->18446744073709551615) 00002000:00010000:1.0:1783444570.019984:0:24872:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c5505500. 00000100:00100000:1.0:1783444570.020033:0:24872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1008 00000100:00100000:1.0:1783444570.020043:0:24872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2401:x1870073557879168:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:1.0:1783444570.020249:0:24872:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783444570.020253:0:24872:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00002000:00010000:1.0:1783444570.020256:0:24872:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:1.0:1783444570.020258:0:24872:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:1.0:1783444570.020260:0:24872:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783444570.020271:0:24872:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c5505500 x1870073557879168/t4294969476(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444570.020350:0:24872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2401:x1870073557879168:12345-192.168.204.20@tcp:10:dd.0 Request processed in 309us (12161us total) trans 4294969476 rc 0/0 00000100:00100000:1.0:1783444570.020358:0:24872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1008 00002000:00010000:1.0:1783444570.020361:0:24872:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/898 (0->18446744073709551615) 00002000:00100000:1.0:1783444570.020364:0:24872:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5505500 with x1870073557879168 ext(0->18446744073709551615) 00002000:00010000:1.0:1783444570.020369:0:24872:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c5505500. 00000100:00100000:3.0:1783444570.021439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.021511:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557879424 00000100:00100000:0.0:1783444570.021518:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557879424 00000100:00100000:0.0:1783444570.021567:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1541 00000100:00100000:0.0:1783444570.021575:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+45:73717:x1870073557879424:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.021597:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.021616:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e383412a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a01b expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.021654:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3834131 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.021668:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3834131 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.021680:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3834131 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.021842:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fc00/0x42cb6883e383412a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a01b expref: 47 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.022193:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f600/0x42cb6883e3834131 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a01b expref: 46 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.022203:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9368c59a7e00) 00010000:00010000:0.0:1783444570.022206:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783444570.022210:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6f600, rc 0) 00000100:00100000:0.0:1783444570.022267:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7c8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+46:73717:x1870073557879424:12345-192.168.204.20@tcp:101:dd.0 Request processed in 691us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.022274:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1541 00000100:00100000:3.0:1783444570.022624:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.022660:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.022735:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557879552 00000100:00100000:2.0:1783444570.022740:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557879552 00000100:00100000:2.0:1783444570.022771:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557879808 00000100:00100000:2.0:1783444570.022774:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557879808 00000100:00100000:2.0:1783444570.022824:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1542 00000100:00100000:2.0:1783444570.022833:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+47:73709:x1870073557879552:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.022849:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.022876:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3834138 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a022 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.022912:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e383413f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.022921:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e383413f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.022930:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e383413f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023006:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3834138 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a022 expref: 49 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023020:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756400/0x42cb6883e383413f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a022 expref: 48 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023027:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4700) 00010000:00010000:2.0:1783444570.023030:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783444570.023032:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756400, rc 0) 00000100:00100000:2.0:1783444570.023076:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+48:73709:x1870073557879552:12345-192.168.204.20@tcp:101:dd.0 Request processed in 244us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444570.023083:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1542 00000100:00100000:2.0:1783444570.023098:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1543 00000100:00100000:2.0:1783444570.023105:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+47:73703:x1870073557879808:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.023112:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.023130:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e3834146 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a029 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023238:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023248:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023255:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023268:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023274:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023281:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023324:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383415b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023332:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383415b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023339:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383415b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444570.023348:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783444570.023422:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023430:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023442:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023448:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023454:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444570.023458:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023463:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023473:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:2.0:1783444570.023475:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444570.023479:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023484:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383414d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023494:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023500:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023506:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023511:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444570.023518:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023524:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023531:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff9368c6b5e100) 00010000:00010000:2.0:1783444570.023533:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444570.023535:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023541:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834154 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023569:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e3834146 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a029 expref: 50 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023579:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383415b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a029 expref: 49 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.023586:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7300) 00010000:00010000:2.0:1783444570.023588:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783444570.023590:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757400, rc 0) 00000100:00100000:2.0:1783444570.023618:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+49:73703:x1870073557879808:12345-192.168.204.20@tcp:101:dd.0 Request processed in 513us (958us total) trans 124554051659 rc 0/0 00000100:00100000:2.0:1783444570.023624:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1543 00000100:00100000:3.0:1783444570.026467:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.027436:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557880064 00000100:00100000:2.0:1783444570.027450:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557880064 00000100:00100000:2.0:1783444570.027524:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 266 00000100:00100000:2.0:1783444570.027534:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+49:73702:x1870073557880064:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:2.0:1783444570.028635:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+50:73702:x1870073557880064:12345-192.168.204.20@tcp:35:dd.0 Request processed in 1096us (2170us total) trans 124554051660 rc 0/0 00000100:00100000:2.0:1783444570.028647:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 266 00000100:00100000:3.0:1783444570.033980:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.034022:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.034053:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.037025:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557880576 00000100:00100000:0.0:1783444570.037040:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557880576 00000100:00100000:3.0:1783444570.038583:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.038635:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557880320 00000100:00100000:0.0:1783444570.038644:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557880320 00000100:00100000:0.0:1783444570.038696:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557880832 00000100:00100000:0.0:1783444570.038700:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557880832 00000100:00100000:2.0:1783444570.046491:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1544 00000100:00100000:2.0:1783444570.046515:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+52:73703:x1870073557880320:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.046538:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.046560:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e3834169 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a030 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.046608:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834170 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444570.046942:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1545 00000100:00100000:0.0:1783444570.046954:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+53:73717:x1870073557880832:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1783444570.046998:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444570.047021:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11800/0x42cb6883e38340e4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939fff expref: 53 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.047040:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9368c59a7e00) 00010000:00010000:0.0:1783444570.047045:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444570.047260:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.047274:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.047284:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444570.047329:0:66226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051661 00000004:00010000:0.0:1783444570.047351:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006334abe0 reply state 00000000f7af0287 transno 124554051662 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.047363:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.047370:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9368c59a7e00) 00010000:00010000:0.0:1783444570.047373:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444570.047375:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444570.047469:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+55:73717:x1870073557880832:12345-192.168.204.20@tcp:36:dd.0 Request processed in 517us (13414us total) trans 124554051662 rc 0/0 00000100:00100000:0.0:1783444570.047477:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1545 00000020:00080000:0.0:1783444570.047483:0:66226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783444570.047917:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834170 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.047927:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834170 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.048006:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e3834169 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a030 expref: 55 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.048021:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757600/0x42cb6883e3834170 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a030 expref: 54 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.048029:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7300) 00010000:00010000:2.0:1783444570.048032:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783444570.048035:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757600, rc 0) 00000100:00100000:2.0:1783444570.048069:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+54:73703:x1870073557880320:12345-192.168.204.20@tcp:101:dd.0 Request processed in 1565us (14048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444570.048095:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1544 00000100:00100000:3.0:1783444570.052062:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1546 00000100:00100000:3.0:1783444570.052081:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+53:73704:x1870073557880576:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.052130:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.052153:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e383417e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a037 expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052299:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052313:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052324:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052338:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052345:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052351:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052411:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834193 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052420:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834193 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052427:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834193 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444570.052436:0:66225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 0 00010000:00010000:3.0:1783444570.052533:0:66225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052542:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052549:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052556:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052562:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.052566:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052573:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052586:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444570.052589:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.052594:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052600:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834185 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052614:0:66225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052621:0:66225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052627:0:66225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052638:0:66225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.052641:0:66225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052647:0:66225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052655:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff9367c98c8700) 00010000:00010000:3.0:1783444570.052658:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.052661:0:66225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052666:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e383418c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052704:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e383417e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a037 expref: 56 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052736:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834193 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a037 expref: 55 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.052744:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9368f57c6a00) 00010000:00010000:3.0:1783444570.052746:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444570.052749:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf91600, rc 0) 00000100:00100000:3.0:1783444570.052827:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+55:73704:x1870073557880576:12345-192.168.204.20@tcp:101:dd.0 Request processed in 750us (18854us total) trans 124554051663 rc 0/0 00000100:00100000:3.0:1783444570.052834:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1546 00000100:00100000:3.0:1783444570.052912:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.053094:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557881088 00000100:00100000:3.0:1783444570.053102:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557881088 00000100:00100000:3.0:1783444570.053142:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1547 00000100:00100000:3.0:1783444570.053149:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+55:73709:x1870073557881088:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:3.0:1783444570.053176:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444570.053190:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90000/0x42cb6883e3834115 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a00d expref: 55 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.053201:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4700) 00010000:00010000:3.0:1783444570.053205:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444570.054010:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.054025:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.054034:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444570.054160:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051664 00000004:00010000:3.0:1783444570.054183:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5720300 reply state 0000000051acb2c3 transno 124554051665 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.054195:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.054201:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4700) 00010000:00010000:3.0:1783444570.054204:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444570.054207:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444570.054280:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+57:73709:x1870073557881088:12345-192.168.204.20@tcp:36:dd.0 Request processed in 1128us (1365us total) trans 124554051665 rc 0/0 00000100:00100000:3.0:1783444570.054300:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1547 00000020:00080000:3.0:1783444570.054305:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783444570.057886:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557880192 00000100:00100000:0.0:1783444570.057901:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557880192 00002000:00010000:0.0:1783444570.057958:0:8426:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/904 (0->18446744073709551615) 00002000:00100000:0.0:1783444570.057964:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff7ad500 with x1870073557880192 ext(0->18446744073709551615) 00002000:00010000:0.0:1783444570.057977:0:8426:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff7ad500. 00000100:00100000:0.0:1783444570.058017:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1009 00000100:00100000:0.0:1783444570.058027:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2403:x1870073557880192:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:0.0:1783444570.058221:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783444570.058249:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00002000:00010000:0.0:1783444570.058251:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:0.0:1783444570.058254:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:0.0:1783444570.058256:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783444570.058266:0:8426:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7ad500 x1870073557880192/t4294969477(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.058332:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2403:x1870073557880192:12345-192.168.204.20@tcp:10:dd.0 Request processed in 306us (19757us total) trans 4294969477 rc 0/0 00000100:00100000:0.0:1783444570.058340:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1009 00002000:00010000:0.0:1783444570.058344:0:8426:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/904 (0->18446744073709551615) 00002000:00100000:0.0:1783444570.058347:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff7ad500 with x1870073557880192 ext(0->18446744073709551615) 00002000:00010000:0.0:1783444570.058352:0:8426:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff7ad500. 00000100:00100000:3.0:1783444570.059689:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.059837:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.059860:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.059880:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.059904:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557881216 00000100:00100000:3.0:1783444570.059912:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557881216 00000100:00100000:3.0:1783444570.059957:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5948 00000100:00100000:3.0:1783444570.059967:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+9:73717:x1870073557881216:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.059982:0:8422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.060003:0:8422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0cf449d/0x42cb6883e38341a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a03e expref: -99 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.060028:0:8422:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x391:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:3.0:1783444570.060048:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=3561s v=(0 0) 00000100:00100000:0.0:1783444570.060318:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557881344 00000100:00100000:0.0:1783444570.060323:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557881344 00000100:00100000:0.0:1783444570.060347:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557881600 00000100:00100000:0.0:1783444570.060350:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557881600 00000100:00100000:0.0:1783444570.060359:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557881984 00000100:00100000:0.0:1783444570.060361:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557881984 00000100:00100000:0.0:1783444570.060374:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1548 00000100:00100000:0.0:1783444570.060380:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+59:73704:x1870073557881344:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.060396:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.060411:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e38341af lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a045 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060440:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e38341b6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060453:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e38341b6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060479:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e38341b6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060600:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e38341af lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a045 expref: 61 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060620:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ee00/0x42cb6883e38341b6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a045 expref: 60 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060629:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9368f57c6a00) 00010000:00010000:0.0:1783444570.060632:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783444570.060636:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6ee00, rc 0) 00000100:00100000:0.0:1783444570.060688:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+60:73704:x1870073557881344:12345-192.168.204.20@tcp:101:dd.0 Request processed in 307us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.060694:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1548 00000100:00100000:0.0:1783444570.060710:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1549 00000100:00100000:0.0:1783444570.060716:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+59:73710:x1870073557881600:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.060736:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.060747:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e38341bd lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a04c expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060869:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060879:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060896:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060910:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060917:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060924:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060975:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e38341d2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060983:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e38341d2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.060989:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e38341d2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444570.060998:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783444570.061280:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061289:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061295:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061301:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061312:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6f000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.061317:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061325:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061336:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444570.061339:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.061342:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061348:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f000/0x42cb6883e38341c4 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061361:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061367:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061372:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061376:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6f800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.061379:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061385:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061403:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff9368e7860400) 00010000:00010000:0.0:1783444570.061406:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.061408:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061414:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e38341cb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061449:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e38341bd lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a04c expref: 62 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061461:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e38341d2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a04c expref: 61 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061468:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8400) 00010000:00010000:0.0:1783444570.061470:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444570.061472:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6e600, rc 0) 00000100:00100000:0.0:1783444570.061574:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+61:73710:x1870073557881600:12345-192.168.204.20@tcp:101:dd.0 Request processed in 856us (1712us total) trans 124554051666 rc 0/0 00000100:00100000:0.0:1783444570.061582:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1549 00000100:00100000:0.0:1783444570.061603:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1550 00000100:00100000:0.0:1783444570.061610:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+60:73703:x1870073557881984:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1783444570.061654:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444570.061669:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383415b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a029 expref: 60 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.061680:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7300) 00010000:00010000:0.0:1783444570.061690:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444570.062041:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.062053:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.062140:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444570.062182:0:66226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051667 00000004:00010000:0.0:1783444570.062201:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b72e67f9 reply state 000000008e70d532 transno 124554051668 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.062212:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.062218:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7300) 00010000:00010000:0.0:1783444570.062220:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444570.062222:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444570.062272:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+62:73703:x1870073557881984:12345-192.168.204.20@tcp:36:dd.0 Request processed in 662us (2390us total) trans 124554051668 rc 0/0 00000100:00100000:0.0:1783444570.062279:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1550 00000020:00080000:0.0:1783444570.062283:0:66226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783444570.063397:0:8422:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444570.063415:0:8422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0cf449d/0x42cb6883e38341a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a03e expref: 10 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.063435:0:8422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0cf449d/0x42cb6883e38341a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a03e expref: 10 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.063448:0:8422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d70200, rc 0) 00010000:00000080:3.0:1783444570.063456:0:8422:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7ae300 x1870073557881216/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.063528:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+10:73717:x1870073557881216:12345-192.168.204.20@tcp:101:dd.0 Request processed in 3563us (3846us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.063537:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5948 00000100:00100000:2.0:1783444570.071325:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.071391:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.071453:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.071510:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557881728 00000100:00100000:0.0:1783444570.071519:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557881728 00000100:00100000:0.0:1783444570.071567:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5949 00000100:00100000:0.0:1783444570.071577:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+10:73709:x1870073557881728:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.071597:0:26203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.071620:0:26203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054f4509f/0x42cb6883e38341e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a053 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444570.071662:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x389:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:0.0:1783444570.071686:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:0.0:1783444570.071690:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444570.071699:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054f4509f/0x42cb6883e38341e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a053 expref: 11 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.071715:0:26203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054f4509f/0x42cb6883e38341e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a053 expref: 11 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.071733:0:26203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6ec00, rc 0) 00010000:00000080:0.0:1783444570.071742:0:26203:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368eaaf5880 x1870073557881728/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444570.077995:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557882240 00000100:00100000:1.0:1783444570.078010:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557882240 00000100:00100000:1.0:1783444570.078197:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 267 00000100:00100000:1.0:1783444570.078208:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+62:73708:x1870073557882240:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:0.0:1783444570.078622:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+11:73709:x1870073557881728:12345-192.168.204.20@tcp:101:dd.0 Request processed in 7043us (7303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.078631:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5949 00000100:00100000:3.0:1783444570.078941:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.079053:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557882496 00000100:00100000:3.0:1783444570.079067:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557882496 00000100:00100000:3.0:1783444570.079105:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1551 00000100:00100000:3.0:1783444570.079113:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+64:73704:x1870073557882496:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:3.0:1783444570.079154:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444570.079180:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834193 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a037 expref: 64 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.079197:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9368f57c6a00) 00010000:00010000:3.0:1783444570.079203:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444570.079303:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.079316:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.079325:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444570.079364:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051670 00000004:00010000:3.0:1783444570.079385:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5a231cc reply state 000000000ab584ee transno 124554051671 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.079396:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.079412:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9368f57c6a00) 00010000:00010000:3.0:1783444570.079415:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444570.079417:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444570.079469:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+66:73704:x1870073557882496:12345-192.168.204.20@tcp:36:dd.0 Request processed in 356us (8076us total) trans 124554051671 rc 0/0 00000100:00100000:3.0:1783444570.079475:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1551 00000020:00080000:3.0:1783444570.079479:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783444570.080374:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557882624 00000100:00100000:0.0:1783444570.080383:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557882624 00000100:00100000:0.0:1783444570.080426:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5950 00000100:00100000:0.0:1783444570.080433:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+11:73703:x1870073557882624:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.080446:0:8420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.080462:0:8420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bfce64d/0x42cb6883e38341f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a05a expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444570.080483:0:8420:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x383:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:0.0:1783444570.080511:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:0.0:1783444570.080515:0:8420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444570.080523:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bfce64d/0x42cb6883e38341f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a05a expref: 12 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.080537:0:8420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bfce64d/0x42cb6883e38341f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a05a expref: 12 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.080549:0:8420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6fc00, rc 0) 00010000:00000080:0.0:1783444570.080556:0:8420:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7ace00 x1870073557882624/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.080599:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+12:73703:x1870073557882624:12345-192.168.204.20@tcp:101:dd.0 Request processed in 167us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.080606:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5950 00000100:00100000:0.0:1783444570.086627:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.086671:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.086702:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.086725:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.086737:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557882752 00000100:00100000:3.0:1783444570.086747:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557882752 00000100:00100000:0.0:1783444570.086767:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00002000:00010000:3.0:1783444570.086783:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/913 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.086811:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e7868000 with x1870073557882752 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.086823:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e7868000. 00000100:00100000:0.0:1783444570.086833:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.087286:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557883392 00000100:00100000:3.0:1783444570.087291:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557883392 00002000:00010000:3.0:1783444570.087307:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/899 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.087310:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e786b480 with x1870073557883392 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.087316:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e786b480. 00000100:00100000:3.0:1783444570.087397:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557883520 00000100:00100000:3.0:1783444570.087401:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557883520 00002000:00010000:3.0:1783444570.087412:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/905 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.087415:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e7868380 with x1870073557883520 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.087420:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e7868380. 00000100:00100000:3.0:1783444570.087437:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1010 00000100:00100000:3.0:1783444570.087446:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+14:2403:x1870073557882752:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:3.0:1783444570.087597:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783444570.087600:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.087603:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:3.0:1783444570.087680:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.087683:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783444570.087694:0:8425:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7868000 x1870073557882752/t4294969478(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.087761:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+15:2403:x1870073557882752:12345-192.168.204.20@tcp:10:dd.0 Request processed in 316us (1145us total) trans 4294969478 rc 0/0 00000100:00100000:3.0:1783444570.087769:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1010 00002000:00010000:3.0:1783444570.087774:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/913 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.087776:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e7868000 with x1870073557882752 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.087780:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e7868000. 00000100:00100000:3.0:1783444570.087814:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1011 00000100:00100000:3.0:1783444570.087821:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+14:2404:x1870073557883392:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:3.0:1783444570.087872:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783444570.087875:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00002000:00010000:3.0:1783444570.087877:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:3.0:1783444570.087880:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:3.0:1783444570.087882:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783444570.087888:0:8425:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e786b480 x1870073557883392/t4294969479(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.087910:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+15:2404:x1870073557883392:12345-192.168.204.20@tcp:10:dd.0 Request processed in 90us (1143us total) trans 4294969479 rc 0/0 00000100:00100000:3.0:1783444570.087916:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1011 00002000:00010000:3.0:1783444570.087919:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/899 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.087921:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e786b480 with x1870073557883392 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.087925:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e786b480. 00000100:00100000:3.0:1783444570.087942:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1012 00000100:00100000:3.0:1783444570.087948:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+14:2403:x1870073557883520:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:3.0:1783444570.088178:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783444570.088182:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00002000:00010000:3.0:1783444570.088185:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:3.0:1783444570.088187:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:3.0:1783444570.088189:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783444570.088196:0:8425:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7868380 x1870073557883520/t4294969480(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.088219:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7868380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+15:2403:x1870073557883520:12345-192.168.204.20@tcp:10:dd.0 Request processed in 271us (1387us total) trans 4294969480 rc 0/0 00000100:00100000:3.0:1783444570.088225:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1012 00002000:00010000:3.0:1783444570.088228:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/905 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.088230:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e7868380 with x1870073557883520 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.088235:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e7868380. 00000100:00100000:0.0:1783444570.088897:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557883264 00000100:00100000:0.0:1783444570.088906:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557883264 00000100:00100000:0.0:1783444570.088947:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5951 00000100:00100000:1.0:1783444570.088950:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+65:73708:x1870073557882240:12345-192.168.204.20@tcp:35:dd.0 Request processed in 10743us (17495us total) trans 124554051669 rc 0/0 00000100:00100000:0.0:1783444570.088954:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+15:73704:x1870073557883264:12345-192.168.204.20@tcp:101:dd.0 00000100:00100000:1.0:1783444570.088961:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 267 00010000:00010000:0.0:1783444570.088966:0:26201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.088985:0:26201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de2ebbf0/0x42cb6883e38341fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a06f expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444570.089013:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x384:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:0.0:1783444570.089047:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:0.0:1783444570.089051:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444570.089060:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de2ebbf0/0x42cb6883e38341fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a06f expref: 16 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.089076:0:26201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de2ebbf0/0x42cb6883e38341fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a06f expref: 16 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.089089:0:26201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6fe00, rc 0) 00010000:00000080:0.0:1783444570.089094:0:26201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e786b100 x1870073557883264/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.089135:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+16:73704:x1870073557883264:12345-192.168.204.20@tcp:101:dd.0 Request processed in 182us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.089141:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5951 00000100:00100000:3.0:1783444570.095019:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557882880 00000100:00100000:3.0:1783444570.095035:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557882880 00000100:00100000:3.0:1783444570.095109:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557883136 00000100:00100000:3.0:1783444570.095112:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557883136 00000100:00100000:3.0:1783444570.095158:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1552 00000100:00100000:1.0:1783444570.095169:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1553 00000100:00100000:3.0:1783444570.095170:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+66:73710:x1870073557882880:12345-192.168.204.20@tcp:101:dd.0 00000100:00100000:1.0:1783444570.095188:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e786b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+66:73711:x1870073557883136:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.095198:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444570.095200:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.095222:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3834203 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a061 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095222:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383420a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a068 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.095272:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834211 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.095312:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834211 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.095323:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834211 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095367:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095378:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095386:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095399:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095406:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095413:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.095418:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e3834203 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a061 expref: 69 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.095436:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90200/0x42cb6883e3834211 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a061 expref: 68 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.095446:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8400) 00010000:00010000:3.0:1783444570.095449:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783444570.095453:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367caf90200, rc 0) 00010000:00010000:1.0:1783444570.095464:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3834226 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095485:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3834226 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095493:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3834226 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444570.095504:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 0 00000100:00100000:3.0:1783444570.095511:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+68:73710:x1870073557882880:12345-192.168.204.20@tcp:101:dd.0 Request processed in 343us (8837us total) trans 0 rc 0/0 00010000:00010000:1.0:1783444570.095585:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095594:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095600:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095606:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095611:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444570.095615:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095622:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095631:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444570.095634:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444570.095637:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095643:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834218 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095660:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095667:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095672:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095676:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444570.095679:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095685:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095692:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff9368c3abdf00) 00010000:00010000:1.0:1783444570.095694:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444570.095697:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095702:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11200/0x42cb6883e383421f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095748:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383420a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a068 expref: 70 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095761:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3834226 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a068 expref: 69 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.095779:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9368f57c6300) 00010000:00010000:1.0:1783444570.095781:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444570.095783:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10200, rc 0) 00000100:00100000:1.0:1783444570.095832:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e786b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+69:73711:x1870073557883136:12345-192.168.204.20@tcp:101:dd.0 Request processed in 650us (9129us total) trans 124554051672 rc 0/0 00000100:00100000:2.0:1783444570.102324:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.102366:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557883776 00000100:00100000:2.0:1783444570.102377:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557883776 00000100:00100000:2.0:1783444570.102435:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 268 00000100:00100000:2.0:1783444570.102446:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd128c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+70:73703:x1870073557883776:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:2.0:1783444570.104558:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd128c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+71:73703:x1870073557883776:12345-192.168.204.20@tcp:35:dd.0 Request processed in 2103us (2236us total) trans 124554051673 rc 0/0 00000100:00100000:2.0:1783444570.104573:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 268 00000100:00100000:2.0:1783444570.104834:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.104879:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.104896:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557884032 00000100:00100000:2.0:1783444570.104903:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557884032 00000100:00100000:2.0:1783444570.104935:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557884288 00000100:00100000:2.0:1783444570.104938:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557884288 00000100:00100000:2.0:1783444570.104951:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 269 00000100:00100000:2.0:1783444570.104958:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+72:73709:x1870073557884032:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:2.0:1783444570.106276:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+73:73709:x1870073557884032:12345-192.168.204.20@tcp:35:dd.0 Request processed in 1309us (1434us total) trans 124554051674 rc 0/0 00000100:00100000:2.0:1783444570.106287:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 269 00000100:00100000:2.0:1783444570.106315:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 270 00000100:00100000:2.0:1783444570.106324:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+72:73717:x1870073557884288:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:2.0:1783444570.106470:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+73:73717:x1870073557884288:12345-192.168.204.20@tcp:35:dd.0 Request processed in 148us (1590us total) trans 124554051675 rc 0/0 00000100:00100000:2.0:1783444570.106477:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 270 00000100:00100000:0.0:1783444570.109476:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.117423:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1552 00000100:00100000:0.0:1783444570.118066:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.118146:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.119828:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557884416 00000100:00100000:3.0:1783444570.119841:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557884672 00000100:00100000:2.0:1783444570.119843:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557884416 00000100:00100000:3.0:1783444570.119848:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557884672 00002000:00010000:2.0:1783444570.119889:0:25160:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/900 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.119895:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e7869500 with x1870073557884416 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.119908:0:25160:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e7869500. 00000100:00100000:3.0:1783444570.119926:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557884800 00000100:00100000:3.0:1783444570.119930:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557884800 00000100:00100000:2.0:1783444570.119940:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1013 00000100:00100000:2.0:1783444570.119952:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+16:2404:x1870073557884416:12345-192.168.204.20@tcp:10:dd.0 00000100:00100000:3.0:1783444570.119957:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1554 00000100:00100000:3.0:1783444570.119968:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+73:73710:x1870073557884672:12345-192.168.204.20@tcp:36:dd.0 00000100:00100000:0.0:1783444570.120013:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1555 00000100:00100000:0.0:1783444570.120023:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+73:73711:x1870073557884800:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.120028:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444570.120049:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.120056:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e38341d2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a04c expref: 73 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.120067:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e3834234 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a076 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.120112:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e383423b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444570.120132:0:25160:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783444570.120135:0:25160:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00010000:00010000:0.0:1783444570.120135:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e383423b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444570.120137:0:25160:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:2.0:1783444570.120140:0:25160:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:2.0:1783444570.120142:0:25160:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1783444570.120145:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e383423b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1783444570.120150:0:25160:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7869500 x1870073557884416/t4294969481(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.120213:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+17:2404:x1870073557884416:12345-192.168.204.20@tcp:10:dd.0 Request processed in 265us (10746us total) trans 4294969481 rc 0/0 00000100:00100000:2.0:1783444570.120221:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1013 00010000:00010000:0.0:1783444570.120222:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e3834234 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a076 expref: 75 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444570.120224:0:25160:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/900 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.120227:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e7869500 with x1870073557884416 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.120231:0:25160:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e7869500. 00010000:00010000:0.0:1783444570.120240:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f800/0x42cb6883e383423b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a076 expref: 74 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.120269:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9368f57c6300) 00010000:00010000:0.0:1783444570.120274:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783444570.120277:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6f800, rc 0) 00010000:00010000:3.0:1783444570.120278:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8400) 00010000:00010000:3.0:1783444570.120284:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444570.120306:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+73:73711:x1870073557884800:12345-192.168.204.20@tcp:101:dd.0 Request processed in 284us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.120313:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1555 00010000:00010000:3.0:1783444570.120397:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.120408:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.120415:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444570.120448:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051676 00000004:00010000:3.0:1783444570.120466:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021ac5fc0 reply state 00000000c821e9e9 transno 124554051677 ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.120476:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.120484:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8400) 00010000:00010000:3.0:1783444570.120486:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444570.120488:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444570.120542:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+75:73710:x1870073557884672:12345-192.168.204.20@tcp:36:dd.0 Request processed in 576us (2478us total) trans 124554051677 rc 0/0 00000100:00100000:3.0:1783444570.120549:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1554 00000020:00080000:3.0:1783444570.120553:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783444570.128909:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1553 00000100:00100000:0.0:1783444570.132187:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.132270:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557885056 00000100:00100000:3.0:1783444570.132280:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557885056 00000100:00100000:3.0:1783444570.132338:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1556 00000100:00100000:3.0:1783444570.132348:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+74:73705:x1870073557885056:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.132389:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.132409:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3834249 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a07d expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132562:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132577:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132588:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132602:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132610:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132616:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132679:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383425e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132687:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383425e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132694:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383425e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444570.132704:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 0 00010000:00010000:3.0:1783444570.132813:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132822:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132828:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132835:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132841:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.132845:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132860:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132874:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444570.132877:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.132881:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132887:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90e00/0x42cb6883e3834250 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132900:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132906:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132912:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132923:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.132926:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132933:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132940:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff9367c98c8700) 00010000:00010000:3.0:1783444570.132942:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.132945:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.132950:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf90a00/0x42cb6883e3834257 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.133103:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91200/0x42cb6883e3834249 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a07d expref: 77 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.133143:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383425e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a07d expref: 76 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.133151:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:2.0:1783444570.133153:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783444570.133156:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71600, rc 0) 00000100:00100000:2.0:1783444570.133220:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+76:73705:x1870073557885056:12345-192.168.204.20@tcp:101:dd.0 Request processed in 872us (1041us total) trans 124554051678 rc 0/0 00000100:00100000:2.0:1783444570.133228:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1556 00000100:00100000:0.0:1783444570.164942:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.164979:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557885312 00000100:00100000:0.0:1783444570.164979:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.164989:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557885312 00000100:00100000:1.0:1783444570.165048:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557885568 00000100:00100000:3.0:1783444570.165053:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 271 00000100:00100000:1.0:1783444570.165061:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557885568 00000100:00100000:3.0:1783444570.165064:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+76:73704:x1870073557885312:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:1.0:1783444570.165097:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1557 00000100:00100000:1.0:1783444570.165104:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+77:73711:x1870073557885568:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1783444570.165141:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444570.165167:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e3834226 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a068 expref: 77 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.165185:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9368f57c6300) 00010000:00010000:1.0:1783444570.165189:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444570.165281:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.165294:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.165303:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783444570.165341:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051680 00000100:00100000:3.0:1783444570.165350:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+79:73704:x1870073557885312:12345-192.168.204.20@tcp:35:dd.0 Request processed in 288us (416us total) trans 124554051679 rc 0/0 00000100:00100000:3.0:1783444570.165358:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 271 00000004:00010000:1.0:1783444570.165362:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000812af7af reply state 000000006362e3f9 transno 124554051681 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.165388:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.165395:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9368f57c6300) 00010000:00010000:1.0:1783444570.165397:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444570.165400:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444570.165445:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+79:73711:x1870073557885568:12345-192.168.204.20@tcp:36:dd.0 Request processed in 341us (464us total) trans 124554051681 rc 0/0 00000100:00100000:1.0:1783444570.165451:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1557 00000020:00080000:1.0:1783444570.165455:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783444570.169736:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.173394:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557885696 00000100:00100000:1.0:1783444570.173409:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557885696 00000100:00100000:1.0:1783444570.173478:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5952 00000100:00100000:1.0:1783444570.173488:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+17:73710:x1870073557885696:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444570.173508:0:17653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444570.173531:0:17653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3834273 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a084 expref: -99 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444570.173556:0:17653:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38a:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:1.0:1783444570.173578:0:17653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:1.0:1783444570.173583:0:17653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444570.173591:0:17653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3834273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a084 expref: 18 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.173608:0:17653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3834273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a084 expref: 18 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.173642:0:17653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11200, rc 0) 00010000:00000080:1.0:1783444570.173650:0:17653:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e3efaa00 x1870073557885696/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444570.173712:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+18:73710:x1870073557885696:12345-192.168.204.20@tcp:101:dd.0 Request processed in 225us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444570.173719:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5952 00000100:00100000:0.0:1783444570.182008:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.182289:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.192580:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.192621:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.198114:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557885824 00000100:00100000:3.0:1783444570.198139:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557885824 00000100:00100000:3.0:1783444570.198218:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557886208 00000100:00100000:3.0:1783444570.198222:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557886208 00000100:00100000:3.0:1783444570.198289:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5953 00000100:00100000:3.0:1783444570.198300:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+18:73711:x1870073557886208:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.198330:0:26211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.198351:0:26211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e383427a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a099 expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.198378:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38b:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:3.0:1783444570.198398:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:3.0:1783444570.198403:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444570.198411:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e383427a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a099 expref: 19 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.198428:0:26211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e383427a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a099 expref: 19 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.198442:0:26211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645800, rc 0) 00010000:00000080:3.0:1783444570.198450:0:26211:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e3ef8e00 x1870073557886208/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.198515:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+19:73711:x1870073557886208:12345-192.168.204.20@tcp:101:dd.0 Request processed in 217us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.198523:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5953 00000100:00100000:1.0:1783444570.198821:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557886080 00000100:00100000:1.0:1783444570.198828:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557886080 00000100:00100000:1.0:1783444570.198846:0:24872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557886336 00000100:00100000:1.0:1783444570.198849:0:24872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557886336 00002000:00010000:1.0:1783444570.198873:0:24872:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/906 (0->18446744073709551615) 00002000:00100000:1.0:1783444570.198878:0:24872:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e3ef8700 with x1870073557886336 ext(0->18446744073709551615) 00002000:00010000:1.0:1783444570.198888:0:24872:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e3ef8700. 00000100:00100000:1.0:1783444570.198918:0:24872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1014 00000100:00100000:1.0:1783444570.198927:0:24872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+19:2403:x1870073557886336:12345-192.168.204.20@tcp:10:dd.0 00000100:00100000:3.0:1783444570.198971:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1558 00000100:00100000:3.0:1783444570.198993:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+80:73705:x1870073557885824:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.199009:0:66225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.199023:0:66225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3834281 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a08b expref: -99 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.199068:0:66225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3834288 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.199090:0:66225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3834288 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.199101:0:66225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3834288 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66225 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444570.199140:0:24872:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783444570.199144:0:24872:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00002000:00010000:1.0:1783444570.199147:0:24872:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:1.0:1783444570.199150:0:24872:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:1.0:1783444570.199152:0:24872:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783444570.199159:0:24872:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e3ef8700 x1870073557886336/t4294969482(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444570.199192:0:24872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+20:2403:x1870073557886336:12345-192.168.204.20@tcp:10:dd.0 Request processed in 266us (6569us total) trans 4294969482 rc 0/0 00010000:00010000:3.0:1783444570.199201:0:66225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e3834281 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a08b expref: 82 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783444570.199220:0:24872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1014 00002000:00010000:1.0:1783444570.199225:0:24872:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/906 (0->18446744073709551615) 00010000:00010000:3.0:1783444570.199227:0:66225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645400/0x42cb6883e3834288 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a08b expref: 81 pid: 66225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1783444570.199229:0:24872:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e3ef8700 with x1870073557886336 ext(0->18446744073709551615) 00002000:00010000:1.0:1783444570.199238:0:24872:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e3ef8700. 00010000:00010000:3.0:1783444570.199241:0:66225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:3.0:1783444570.199245:0:66225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783444570.199249:0:66225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645400, rc 0) 00000100:00100000:3.0:1783444570.199275:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+81:73705:x1870073557885824:12345-192.168.204.20@tcp:101:dd.0 Request processed in 297us (17276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.199282:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1558 00000100:00100000:1.0:1783444570.199423:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1559 00000100:00100000:1.0:1783444570.199430:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+80:73706:x1870073557886080:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444570.199439:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444570.199449:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e383428f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a092 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199542:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199553:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199561:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199572:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199578:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199584:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199623:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38342a4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199637:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38342a4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199643:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38342a4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444570.199652:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 0 00010000:00010000:1.0:1783444570.199709:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199717:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.199723:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200155:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200161:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444570.200165:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200172:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200183:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444570.200186:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444570.200190:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200196:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834296 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200218:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200224:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200229:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.200235:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444570.200237:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.201407:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.201425:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff9368c3abd800) 00010000:00010000:1.0:1783444570.201428:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444570.201432:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.201438:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e383429d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.201498:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10200/0x42cb6883e383428f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a092 expref: 83 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.201513:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38342a4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a092 expref: 82 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.201537:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9368f57c6c00) 00010000:00010000:1.0:1783444570.201540:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444570.201543:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10400, rc 0) 00000100:00100000:1.0:1783444570.201597:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+82:73706:x1870073557886080:12345-192.168.204.20@tcp:101:dd.0 Request processed in 2165us (19307us total) trans 124554051682 rc 0/0 00000100:00100000:1.0:1783444570.201606:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1559 00000100:00100000:0.0:1783444570.204378:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.204531:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.205051:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557886720 00000100:00100000:2.0:1783444570.205063:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557886720 00000100:00100000:2.0:1783444570.205136:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 272 00010000:00010000:0.0:1783444570.205148:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444570.205149:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+82:73710:x1870073557886720:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:0.0:1783444570.205181:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.205257:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557886976 00000100:00100000:3.0:1783444570.205261:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557886976 00000100:00100000:3.0:1783444570.205295:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1560 00000100:00100000:3.0:1783444570.205303:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+83:73705:x1870073557886976:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:3.0:1783444570.205350:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444570.205373:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383425e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a07d expref: 84 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.205395:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:3.0:1783444570.205400:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444570.205424:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+83:73710:x1870073557886720:12345-192.168.204.20@tcp:35:dd.0 Request processed in 278us (892us total) trans 124554051683 rc 0/0 00000100:00100000:2.0:1783444570.205431:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 272 00010000:00010000:3.0:1783444570.205481:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.205494:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.205505:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444570.205541:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051684 00000004:00010000:3.0:1783444570.205561:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000046b32da9 reply state 000000003e7b0b6e transno 124554051685 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.205572:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.205578:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:3.0:1783444570.205581:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444570.205583:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444570.205626:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+85:73705:x1870073557886976:12345-192.168.204.20@tcp:36:dd.0 Request processed in 323us (443us total) trans 124554051685 rc 0/0 00000100:00100000:3.0:1783444570.205632:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1560 00000020:00080000:3.0:1783444570.205635:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783444570.208521:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557886464 00000100:00100000:1.0:1783444570.208536:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557886464 00002000:00010000:1.0:1783444570.208585:0:8426:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/907 (0->18446744073709551615) 00002000:00100000:1.0:1783444570.208590:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e3ef9500 with x1870073557886464 ext(0->18446744073709551615) 00002000:00010000:1.0:1783444570.208602:0:8426:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e3ef9500. 00000100:00100000:1.0:1783444570.208639:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1015 00000100:00100000:1.0:1783444570.208649:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+20:2403:x1870073557886464:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:1.0:1783444570.215002:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783444570.215011:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:1.0:1783444570.215014:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:1.0:1783444570.215017:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:1.0:1783444570.215019:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1783444570.215034:0:8426:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e3ef9500 x1870073557886464/t4294969483(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.215492:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.215589:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557887104 00000100:00100000:2.0:1783444570.215598:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557887104 00000100:00100000:2.0:1783444570.215652:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1561 00000100:00100000:2.0:1783444570.215662:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+85:73706:x1870073557887104:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.215684:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.215701:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e38342b9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0a0 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.215741:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e38342c0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.215770:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e38342c0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.215781:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e38342c0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.215910:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756a00/0x42cb6883e38342b9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0a0 expref: 87 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.215928:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756000/0x42cb6883e38342c0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0a0 expref: 86 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.215936:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9368f57c6c00) 00010000:00010000:2.0:1783444570.215940:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783444570.215943:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756000, rc 0) 00000100:00100000:2.0:1783444570.216001:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+86:73706:x1870073557887104:12345-192.168.204.20@tcp:101:dd.0 Request processed in 340us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444570.216009:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1561 00000100:00100000:0.0:1783444570.216986:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.217186:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+21:2403:x1870073557886464:12345-192.168.204.20@tcp:10:dd.0 Request processed in 8537us (12814us total) trans 4294969483 rc 0/0 00000100:00100000:2.0:1783444570.217198:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1015 00002000:00010000:2.0:1783444570.217203:0:8426:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/907 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.217207:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e3ef9500 with x1870073557886464 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.217217:0:8426:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e3ef9500. 00000100:00100000:3.0:1783444570.219024:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557887360 00000100:00100000:3.0:1783444570.219037:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557887360 00000100:00100000:3.0:1783444570.219883:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1562 00000100:00100000:3.0:1783444570.219896:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+86:73712:x1870073557887360:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.219932:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.219953:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e38342c7 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0a7 expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220187:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220200:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220212:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220228:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220234:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220240:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220300:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e38342dc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220309:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e38342dc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220316:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e38342dc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444570.220325:0:66226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 0 00010000:00010000:3.0:1783444570.220409:0:66226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220417:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220423:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220429:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220434:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.220437:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220444:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220455:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444570.220458:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.220462:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220468:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38342ce lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220481:0:66226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220486:0:66226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220492:0:66226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220503:0:66226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7645e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.220506:0:66226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220511:0:66226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220519:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff9367c98c8200) 00010000:00010000:3.0:1783444570.220522:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.220524:0:66226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220530:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38342d5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220572:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e38342c7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0a7 expref: 89 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220586:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e38342dc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0a7 expref: 88 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.220593:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:3.0:1783444570.220595:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444570.220598:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513bc00, rc 0) 00000100:00100000:3.0:1783444570.220655:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+88:73712:x1870073557887360:12345-192.168.204.20@tcp:101:dd.0 Request processed in 762us (3671us total) trans 124554051686 rc 0/0 00000100:00100000:3.0:1783444570.220663:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1562 00000100:00100000:0.0:1783444570.223081:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.225025:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557887488 00000100:00100000:3.0:1783444570.225057:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557887488 00000100:00100000:3.0:1783444570.225351:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5954 00000100:00100000:3.0:1783444570.225365:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+21:73705:x1870073557887488:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.225386:0:26208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.225409:0:26208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025b862d4/0x42cb6883e38342ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0ae expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.225436:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x385:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:3.0:1783444570.225457:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:3.0:1783444570.225462:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444570.225470:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b862d4/0x42cb6883e38342ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ae expref: 22 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.225487:0:26208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025b862d4/0x42cb6883e38342ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ae expref: 22 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.225503:0:26208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513ac00, rc 0) 00010000:00000080:3.0:1783444570.225510:0:26208:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e3ef9180 x1870073557887488/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.225648:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+22:73705:x1870073557887488:12345-192.168.204.20@tcp:101:dd.0 Request processed in 287us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.225655:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5954 00000100:00100000:0.0:1783444570.230067:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.230109:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.230190:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557887744 00000100:00100000:1.0:1783444570.230210:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557887744 00000100:00100000:0.0:1783444570.230211:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.230275:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557887872 00000100:00100000:1.0:1783444570.230278:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557887872 00000100:00100000:2.0:1783444570.230282:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557888128 00000100:00100000:2.0:1783444570.230290:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557888128 00000100:00100000:1.0:1783444570.230302:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1563 00000100:00100000:1.0:1783444570.230325:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+90:73706:x1870073557887744:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1783444570.230379:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444570.230895:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38342a4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a092 expref: 90 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.230915:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9368f57c6c00) 00010000:00010000:1.0:1783444570.230920:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444570.231086:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.231100:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.231109:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783444570.231160:0:71469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051687 00000004:00010000:1.0:1783444570.231177:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a1b6b01 reply state 00000000fafac0a8 transno 124554051688 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.231189:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.231205:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9368f57c6c00) 00010000:00010000:1.0:1783444570.231207:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444570.231210:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444570.231295:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+92:73706:x1870073557887744:12345-192.168.204.20@tcp:36:dd.0 Request processed in 971us (1247us total) trans 124554051688 rc 0/0 00000100:00100000:2.0:1783444570.237333:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1564 00000100:00100000:2.0:1783444570.237379:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+92:73712:x1870073557887872:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.237409:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.237431:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e38342f8 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0b5 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.237467:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38342ff lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.237481:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38342ff lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.237494:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38342ff lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.237610:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757a00/0x42cb6883e38342f8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0b5 expref: 94 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.237628:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757000/0x42cb6883e38342ff lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0b5 expref: 93 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.237636:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:2.0:1783444570.237638:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783444570.237642:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757000, rc 0) 00000100:00100000:2.0:1783444570.237715:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+93:73712:x1870073557887872:12345-192.168.204.20@tcp:101:dd.0 Request processed in 348us (7605us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444570.237722:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1564 00000100:00100000:2.0:1783444570.237938:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1565 00000100:00100000:2.0:1783444570.237947:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+92:73707:x1870073557888128:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.237965:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.237975:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3834306 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0bc expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238078:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238088:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238095:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238108:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238114:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238132:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238174:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383431b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238181:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383431b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238187:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383431b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783444570.238196:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783444570.238275:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238282:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238288:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238294:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238299:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444570.238303:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238309:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238318:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:2.0:1783444570.238321:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444570.238324:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238330:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383430d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238341:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238346:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238352:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238363:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:2.0:1783444570.238366:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238371:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238379:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff9368c6b5e100) 00010000:00010000:2.0:1783444570.238382:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783444570.238384:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238389:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e3834314 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238423:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3834306 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0bc expref: 95 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238434:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383431b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0bc expref: 94 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.238441:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4d00) 00010000:00010000:2.0:1783444570.238443:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783444570.238445:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757200, rc 0) 00000100:00100000:2.0:1783444570.238483:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+94:73707:x1870073557888128:12345-192.168.204.20@tcp:101:dd.0 Request processed in 537us (8271us total) trans 124554051689 rc 0/0 00000100:00100000:2.0:1783444570.238490:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1565 00000100:00100000:2.0:1783444570.242920:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.242992:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.243038:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557888256 00000100:00100000:0.0:1783444570.243304:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557888512 00000100:00100000:0.0:1783444570.243310:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557888512 00000100:00100000:0.0:1783444570.243362:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 273 00000100:00100000:0.0:1783444570.243372:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+94:73711:x1870073557888512:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:0.0:1783444570.243658:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+95:73711:x1870073557888512:12345-192.168.204.20@tcp:35:dd.0 Request processed in 287us (668us total) trans 124554051690 rc 0/0 00000100:00100000:0.0:1783444570.243668:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 273 00000100:00100000:1.0:1783444570.244269:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1563 00000020:00080000:1.0:1783444570.244277:0:71469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783444570.244895:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557888256 00002000:00010000:2.0:1783444570.244929:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/901 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.244935:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368eaaf5500 with x1870073557888256 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.244948:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368eaaf5500. 00000100:00100000:2.0:1783444570.244980:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1016 00000100:00100000:2.0:1783444570.244988:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+22:2403:x1870073557888256:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:2.0:1783444570.245972:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783444570.245978:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00002000:00010000:2.0:1783444570.245981:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:2.0:1783444570.245983:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:2.0:1783444570.245985:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783444570.245996:0:8425:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368eaaf5500 x1870073557888256/t4294969484(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.247227:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+23:2403:x1870073557888256:12345-192.168.204.20@tcp:10:dd.0 Request processed in 2232us (4311us total) trans 4294969484 rc 0/0 00000100:00100000:2.0:1783444570.247240:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1016 00002000:00010000:2.0:1783444570.247246:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/901 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.247250:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368eaaf5500 with x1870073557888256 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.247260:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368eaaf5500. 00000100:00100000:0.0:1783444570.267587:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.268475:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557888768 00000100:00100000:3.0:1783444570.268488:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557888768 00000100:00100000:3.0:1783444570.268554:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1566 00000100:00100000:3.0:1783444570.268564:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+94:73713:x1870073557888768:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.268602:0:66223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.268624:0:66223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834329 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0c3 expref: -99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.268757:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.268785:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.268818:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.268834:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.268842:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.268849:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444570.268874:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.268898:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557888896 00000100:00100000:0.0:1783444570.268903:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557888896 00010000:00010000:3.0:1783444570.268916:0:66223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383433e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.268926:0:66223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383433e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.268934:0:66223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383433e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444570.268937:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1567 00000004:00200000:3.0:1783444570.268948:0:66223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 0 00000100:00100000:0.0:1783444570.268949:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+96:73707:x1870073557888896:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.268959:0:66226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.268972:0:66226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834345 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0ca expref: -99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269007:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834353 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269017:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834353 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269025:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834353 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269039:0:66223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269048:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269054:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269060:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269066:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ba00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.269071:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269079:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269091:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444570.269095:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.269100:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269106:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834330 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269131:0:66223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269138:0:66223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269143:0:66223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269155:0:66223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513b400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.269158:0:66223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269165:0:66223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269176:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff9367c98c8a00) 00010000:00010000:3.0:1783444570.269180:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.269181:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e3834345 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ca expref: 99 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.269184:0:66223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269203:0:66226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e600/0x42cb6883e3834353 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ca expref: 98 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269211:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4d00) 00010000:00010000:0.0:1783444570.269215:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783444570.269217:0:66226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6e600, rc 0) 00000100:00100000:0.0:1783444570.269271:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+98:73707:x1870073557888896:12345-192.168.204.20@tcp:101:dd.0 Request processed in 324us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.269278:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1567 00000100:00100000:0.0:1783444570.269325:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.269345:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557889152 00000100:00100000:1.0:1783444570.269351:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557889152 00000100:00100000:1.0:1783444570.269385:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1568 00000100:00100000:1.0:1783444570.269394:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+98:73712:x1870073557889152:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1783444570.269424:0:71469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783444570.269439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1783444570.269442:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e38342dc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0a7 expref: 98 pid: 66226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.269457:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:1.0:1783444570.269460:0:71469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444570.269463:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557889280 00000100:00100000:0.0:1783444570.269468:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557889280 00000100:00100000:0.0:1783444570.269503:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5955 00000100:00100000:0.0:1783444570.269511:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:08efc25c-17e5-4d29-97d2-f1505f195a06+23:73706:x1870073557889280:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.269528:0:26205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.269553:0:26205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5bed62b/0x42cb6883e383435a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0d1 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444570.269574:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x386:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:1.0:1783444570.269590:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269591:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:0.0:1783444570.269599:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444570.269604:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269610:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bed62b/0x42cb6883e383435a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0d1 expref: 24 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.269616:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269631:0:26205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5bed62b/0x42cb6883e383435a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0d1 expref: 24 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.269642:0:26205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c54e4000, rc 0) 00010000:00000080:0.0:1783444570.269649:0:26205:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68e4700 x1870073557889280/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000001:00080000:1.0:1783444570.269666:0:71469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051692 00000100:00100000:0.0:1783444570.269679:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:08efc25c-17e5-4d29-97d2-f1505f195a06+24:73706:x1870073557889280:12345-192.168.204.20@tcp:101:dd.0 Request processed in 169us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.269685:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5955 00000004:00010000:1.0:1783444570.269687:0:71469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001843b954 reply state 000000007d2e179f transno 124554051693 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.269701:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.269707:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:1.0:1783444570.269709:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444570.269711:0:71469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444570.269755:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+100:73712:x1870073557889152:12345-192.168.204.20@tcp:36:dd.0 Request processed in 362us (430us total) trans 124554051693 rc 0/0 00000100:00100000:1.0:1783444570.269770:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1568 00000020:00080000:1.0:1783444570.269774:0:71469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783444570.273621:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834337 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.273875:0:66223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834329 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0c3 expref: 100 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.273895:0:66223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383433e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0c3 expref: 99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.273925:0:66223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:2.0:1783444570.273929:0:66223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783444570.273933:0:66223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71600, rc 0) 00000100:00100000:2.0:1783444570.274010:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+99:73713:x1870073557888768:12345-192.168.204.20@tcp:101:dd.0 Request processed in 5446us (6433us total) trans 124554051691 rc 0/0 00000100:00100000:2.0:1783444570.274019:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1566 00000100:00100000:0.0:1783444570.275897:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.275935:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.276004:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.276085:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557889792 00000100:00100000:1.0:1783444570.276094:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557889792 00000100:00100000:1.0:1783444570.276154:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5956 00000100:00100000:1.0:1783444570.276164:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+24:73712:x1870073557889792:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444570.276181:0:8824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444570.276204:0:8824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3834368 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0d8 expref: -99 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783444570.276230:0:8824:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38c:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:1.0:1783444570.276250:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:1.0:1783444570.276255:0:8824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783444570.276262:0:8824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3834368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0d8 expref: 25 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.276278:0:8824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3834368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0d8 expref: 25 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.276290:0:8824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c10200, rc 0) 00010000:00000080:1.0:1783444570.276297:0:8824:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68e4380 x1870073557889792/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444570.276344:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+25:73712:x1870073557889792:12345-192.168.204.20@tcp:101:dd.0 Request processed in 182us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444570.276352:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5956 00000100:00100000:2.0:1783444570.276640:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557889664 00000100:00100000:2.0:1783444570.276646:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557889664 00002000:00010000:2.0:1783444570.276667:0:24881:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/902 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.276672:0:24881:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68e7480 with x1870073557889664 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.276680:0:24881:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68e7480. 00000100:00100000:2.0:1783444570.276707:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1017 00000100:00100000:2.0:1783444570.276715:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2404:x1870073557889664:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:2.0:1783444570.277004:0:24881:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783444570.277007:0:24881:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00002000:00010000:2.0:1783444570.277009:0:24881:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:2.0:1783444570.277011:0:24881:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:2.0:1783444570.277014:0:24881:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783444570.277021:0:24881:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68e7480 x1870073557889664/t4294969485(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.277065:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+26:2404:x1870073557889664:12345-192.168.204.20@tcp:10:dd.0 Request processed in 351us (1128us total) trans 4294969485 rc 0/0 00000100:00100000:2.0:1783444570.277071:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1017 00002000:00010000:2.0:1783444570.277074:0:24881:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/902 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.277083:0:24881:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68e7480 with x1870073557889664 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.277088:0:24881:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68e7480. 00000100:00100000:3.0:1783444570.277520:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557889536 00000100:00100000:3.0:1783444570.277526:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557889536 00000100:00100000:3.0:1783444570.277573:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1569 00000100:00100000:3.0:1783444570.277581:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+99:73707:x1870073557889536:12345-192.168.204.20@tcp:36:dd.0 00000100:00100000:0.0:1783444570.277608:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1783444570.277631:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783444570.277649:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1783444570.277657:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757200/0x42cb6883e383431b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0bc expref: 99 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444570.277674:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557889920 00010000:00010000:3.0:1783444570.277676:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4d00) 00000100:00100000:0.0:1783444570.277679:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557889920 00010000:00010000:3.0:1783444570.277682:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444570.277711:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557890176 00000100:00100000:0.0:1783444570.277715:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557890176 00000100:00100000:0.0:1783444570.277745:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1570 00000100:00100000:0.0:1783444570.277753:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+100:73713:x1870073557889920:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.277765:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.277780:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5c00/0x42cb6883e383436f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0df expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.277842:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4a00/0x42cb6883e3834376 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.277849:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.277856:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4a00/0x42cb6883e3834376 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.277861:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.277869:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4a00/0x42cb6883e3834376 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.277882:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444570.277928:0:66226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051694 00000004:00010000:3.0:1783444570.277950:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c49cc417 reply state 0000000030558564 transno 124554051695 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.277960:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5c00/0x42cb6883e383436f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0df expref: 104 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.277964:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.277977:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4d00) 00010000:00010000:3.0:1783444570.277980:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.277983:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4a00/0x42cb6883e3834376 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0df expref: 103 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444570.277984:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783444570.277994:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:0.0:1783444570.277997:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783444570.278000:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c54e4a00, rc 0) 00000100:00100000:0.0:1783444570.278037:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+103:73713:x1870073557889920:12345-192.168.204.20@tcp:101:dd.0 Request processed in 286us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.278045:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1570 00000100:00100000:0.0:1783444570.278083:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1571 00000100:00100000:0.0:1783444570.278091:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+103:73714:x1870073557890176:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.278099:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783444570.278106:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+103:73707:x1870073557889536:12345-192.168.204.20@tcp:36:dd.0 Request processed in 524us (2213us total) trans 124554051695 rc 0/0 00010000:00010000:0.0:1783444570.278110:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e3834384 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0e6 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783444570.278133:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1569 00000020:00080000:3.0:1783444570.278138:0:66226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783444570.278216:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278226:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278233:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278246:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278254:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278261:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278300:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e3834399 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278308:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e3834399 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278315:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e3834399 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444570.278346:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 0 00010000:00010000:0.0:1783444570.278398:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278406:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278412:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278418:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278424:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.278428:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278435:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278443:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444570.278445:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.278448:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278453:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e383438b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278462:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278478:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278483:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278488:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.278492:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278498:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278506:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff9368e7860800) 00010000:00010000:0.0:1783444570.278508:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.278511:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278516:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834392 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278547:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e3834384 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0e6 expref: 105 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278559:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e3834399 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0e6 expref: 104 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.278566:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:0.0:1783444570.278569:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444570.278577:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c54e5800, rc 0) 00000100:00100000:0.0:1783444570.278600:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+104:73714:x1870073557890176:12345-192.168.204.20@tcp:101:dd.0 Request processed in 511us (951us total) trans 124554051696 rc 0/0 00000100:00100000:0.0:1783444570.278606:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1571 00000100:00100000:0.0:1783444570.288536:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.288639:0:66228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557890432 00000100:00100000:2.0:1783444570.288652:0:66228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557890432 00000100:00100000:2.0:1783444570.288720:0:66228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 274 00000100:00100000:2.0:1783444570.288739:0:66228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd12bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+104:73705:x1870073557890432:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:2.0:1783444570.289083:0:66228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd12bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+105:73705:x1870073557890432:12345-192.168.204.20@tcp:35:dd.0 Request processed in 344us (557us total) trans 124554051697 rc 0/0 00000100:00100000:2.0:1783444570.289091:0:66228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 274 00000100:00100000:1.0:1783444570.298585:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.298641:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.298737:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.298930:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557890944 00000100:00100000:0.0:1783444570.298942:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557890944 00000100:00100000:0.0:1783444570.299007:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1572 00000100:00100000:0.0:1783444570.299019:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+105:73713:x1870073557890944:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1783444570.299096:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444570.299138:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e383433e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0c3 expref: 105 pid: 66223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.299158:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:0.0:1783444570.299163:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444570.299352:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.299364:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.299373:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444570.299413:0:66226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051698 00000004:00010000:0.0:1783444570.299434:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b00f6db8 reply state 00000000a76f8894 transno 124554051699 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.299445:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.299465:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:0.0:1783444570.299467:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444570.299470:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444570.299561:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+107:73713:x1870073557890944:12345-192.168.204.20@tcp:36:dd.0 Request processed in 544us (822us total) trans 124554051699 rc 0/0 00000100:00100000:0.0:1783444570.299569:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1572 00000020:00080000:0.0:1783444570.299575:0:66226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783444570.299579:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557890688 00000100:00100000:3.0:1783444570.299586:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557890688 00000100:00100000:3.0:1783444570.299635:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5957 00000100:00100000:3.0:1783444570.299644:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+26:73707:x1870073557890688:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.299656:0:26202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.299672:0:26202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bb4783e/0x42cb6883e38343ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0ed expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.299695:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x387:0x0] initial LVB size: 0, mtime: 0x6a4d344d, atime: 0x6a4d344d, ctime: 0x6a4d344d, blocks: 0x0 00010000:00010000:3.0:1783444570.299711:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:3.0:1783444570.299716:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444570.299729:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bb4783e/0x42cb6883e38343ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ed expref: 27 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.299745:0:26202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002bb4783e/0x42cb6883e38343ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ed expref: 27 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.299756:0:26202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f9b6f000, rc 0) 00010000:00000080:3.0:1783444570.299764:0:26202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e7298a80 x1870073557890688/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.299833:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+27:73707:x1870073557890688:12345-192.168.204.20@tcp:101:dd.0 Request processed in 190us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.299839:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5957 00000100:00100000:2.0:1783444570.300305:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557890560 00000100:00100000:2.0:1783444570.300312:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557890560 00002000:00010000:2.0:1783444570.300336:0:8427:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/908 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.300340:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5504700 with x1870073557890560 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.300349:0:8427:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c5504700. 00000100:00100000:2.0:1783444570.300379:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1018 00000100:00100000:2.0:1783444570.300387:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2404:x1870073557890560:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:2.0:1783444570.300489:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783444570.300493:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:2.0:1783444570.300496:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:2.0:1783444570.300499:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:2.0:1783444570.300501:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783444570.300508:0:8427:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c5504700 x1870073557890560/t4294969486(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.300548:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+28:2404:x1870073557890560:12345-192.168.204.20@tcp:10:dd.0 Request processed in 162us (1975us total) trans 4294969486 rc 0/0 00000100:00100000:2.0:1783444570.300567:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1018 00002000:00010000:2.0:1783444570.300570:0:8427:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/908 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.300572:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c5504700 with x1870073557890560 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.300577:0:8427:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c5504700. 00000100:00100000:0.0:1783444570.308556:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.308600:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.308635:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.308718:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557891072 00000100:00100000:3.0:1783444570.308738:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557891072 00000100:00100000:3.0:1783444570.308832:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557891584 00000100:00100000:3.0:1783444570.308836:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557891584 00000100:00100000:3.0:1783444570.308861:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1573 00000100:00100000:3.0:1783444570.308870:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+108:73714:x1870073557891072:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.308898:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.308919:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e38343b5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0f4 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.308955:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e38343bc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.308969:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e38343bc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.308998:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e38343bc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309134:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e400/0x42cb6883e38343b5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0f4 expref: 110 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309152:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645c00/0x42cb6883e38343bc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0f4 expref: 109 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309161:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:3.0:1783444570.309164:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783444570.309168:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c7645c00, rc 0) 00000100:00100000:3.0:1783444570.309226:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+109:73714:x1870073557891072:12345-192.168.204.20@tcp:101:dd.0 Request processed in 356us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.309234:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1573 00000100:00100000:3.0:1783444570.309253:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1574 00000100:00100000:3.0:1783444570.309260:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+108:73715:x1870073557891584:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.309269:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.309278:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38343c3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a0fb expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309382:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309391:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309409:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309425:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309432:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309438:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309483:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38343d8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309490:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38343d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309497:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38343d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444570.309505:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 0 00010000:00010000:3.0:1783444570.309573:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309581:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309586:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309592:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309604:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.309608:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309615:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309626:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444570.309629:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.309632:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309637:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644a00/0x42cb6883e38343ca lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309648:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309654:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309660:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309665:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751400 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.309667:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309672:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309690:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff9367c98c8800) 00010000:00010000:3.0:1783444570.309692:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.309695:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309700:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751400/0x42cb6883e38343d1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309736:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7645e00/0x42cb6883e38343c3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0fb expref: 111 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309748:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38343d8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0fb expref: 110 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.309754:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9368c59a7500) 00010000:00010000:3.0:1783444570.309757:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444570.309759:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751200, rc 0) 00000100:00100000:3.0:1783444570.309785:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+110:73715:x1870073557891584:12345-192.168.204.20@tcp:101:dd.0 Request processed in 525us (1149us total) trans 124554051700 rc 0/0 00000100:00100000:3.0:1783444570.309829:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1574 00000100:00100000:2.0:1783444570.311412:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557891328 00000100:00100000:2.0:1783444570.311424:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557891328 00000100:00100000:2.0:1783444570.311466:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 275 00000100:00100000:2.0:1783444570.311474:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+110:73706:x1870073557891328:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:2.0:1783444570.311717:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+111:73706:x1870073557891328:12345-192.168.204.20@tcp:35:dd.0 Request processed in 242us (3115us total) trans 124554051701 rc 0/0 00000100:00100000:2.0:1783444570.311733:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 275 00000100:00100000:0.0:1783444570.311963:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.312079:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.312106:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.312133:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557892096 00000100:00100000:0.0:1783444570.312137:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557892096 00000100:00100000:0.0:1783444570.312163:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 276 00000100:00100000:0.0:1783444570.312170:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+111:73712:x1870073557892096:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:0.0:1783444570.312301:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+112:73712:x1870073557892096:12345-192.168.204.20@tcp:35:dd.0 Request processed in 131us (193us total) trans 124554051702 rc 0/0 00000100:00100000:0.0:1783444570.312307:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 276 00000100:00100000:2.0:1783444570.313432:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557891712 00000100:00100000:2.0:1783444570.313442:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557891712 00002000:00010000:2.0:1783444570.313472:0:25160:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/903 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.313477:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68e5180 with x1870073557891712 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.313490:0:25160:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68e5180. 00000100:00100000:2.0:1783444570.313522:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1019 00000100:00100000:2.0:1783444570.313530:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+28:2403:x1870073557891712:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:2.0:1783444570.313652:0:25160:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783444570.313655:0:25160:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb mtime from disk: 1783444557 -> 1783444571 00002000:00010000:2.0:1783444570.313657:0:25160:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb atime from disk: 1783444557 -> 1783444557 00002000:00010000:2.0:1783444570.313660:0:25160:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb ctime from disk: 1783444557 -> 1783444571 00002000:00010000:2.0:1783444570.313662:0:25160:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783444570.313669:0:25160:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68e5180 x1870073557891712/t4294969487(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.313737:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2403:x1870073557891712:12345-192.168.204.20@tcp:10:dd.0 Request processed in 207us (1774us total) trans 4294969487 rc 0/0 00000100:00100000:2.0:1783444570.313745:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1019 00002000:00010000:2.0:1783444570.313749:0:25160:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/903 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.313752:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68e5180 with x1870073557891712 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.313757:0:25160:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68e5180. 00000100:00100000:3.0:1783444570.316929:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557891840 00000100:00100000:3.0:1783444570.316945:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557891840 00000100:00100000:3.0:1783444570.317151:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5958 00000100:00100000:3.0:1783444570.317163:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+29:73713:x1870073557891840:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.317183:0:26212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.317209:0:26212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e38343e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a102 expref: -99 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.317256:0:26212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38d:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:3.0:1783444570.317282:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:3.0:1783444570.317287:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444570.317297:0:26212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e38343e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a102 expref: 30 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.317314:0:26212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e38343e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a102 expref: 30 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.317327:0:26212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750400, rc 0) 00010000:00000080:3.0:1783444570.317335:0:26212:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68e5500 x1870073557891840/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.317414:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+30:73713:x1870073557891840:12345-192.168.204.20@tcp:101:dd.0 Request processed in 254us (5338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.317421:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5958 00000100:00100000:1.0:1783444570.317617:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.317744:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.317769:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.317817:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557892480 00000100:00100000:1.0:1783444570.317822:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557892480 00000100:00100000:1.0:1783444570.317849:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557892352 00000100:00100000:1.0:1783444570.317852:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557892352 00000100:00100000:1.0:1783444570.317873:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557892736 00000100:00100000:1.0:1783444570.317876:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557892736 00000100:00100000:1.0:1783444570.317893:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1575 00000100:00100000:1.0:1783444570.317900:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e729bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+114:73715:x1870073557892480:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444570.317911:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444570.317924:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38343ed lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a109 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.317953:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e38343f4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.317965:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e38343f4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.317974:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e38343f4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318080:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10400/0x42cb6883e38343ed lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a109 expref: 116 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318111:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11e00/0x42cb6883e38343f4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a109 expref: 115 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318130:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9368c59a7500) 00010000:00010000:1.0:1783444570.318133:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783444570.318136:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4c11e00, rc 0) 00000100:00100000:1.0:1783444570.318163:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e729bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+115:73715:x1870073557892480:12345-192.168.204.20@tcp:101:dd.0 Request processed in 263us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444570.318169:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1575 00000100:00100000:1.0:1783444570.318188:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1576 00000100:00100000:1.0:1783444570.318194:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e729a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+114:73714:x1870073557892352:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1783444570.318236:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444570.318251:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e3834399 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0e6 expref: 114 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318262:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:1.0:1783444570.318266:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783444570.318398:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318407:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318414:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783444570.318454:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051703 00000004:00010000:1.0:1783444570.318487:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000971770e0 reply state 00000000102924bf transno 124554051704 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318499:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318504:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:1.0:1783444570.318506:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444570.318509:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783444570.318558:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e729a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+116:73714:x1870073557892352:12345-192.168.204.20@tcp:36:dd.0 Request processed in 363us (813us total) trans 124554051704 rc 0/0 00000100:00100000:1.0:1783444570.318565:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1576 00000020:00080000:1.0:1783444570.318569:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783444570.318582:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1577 00000100:00100000:1.0:1783444570.318588:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e7299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+115:73716:x1870073557892736:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444570.318595:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444570.318605:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834402 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a110 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318690:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318700:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318708:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318721:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318739:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318746:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318785:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3834417 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318815:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3834417 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318823:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3834417 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783444570.318832:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 0 00010000:00010000:1.0:1783444570.318878:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318885:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318892:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318899:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318904:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ba00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444570.318908:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318926:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318935:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:1.0:1783444570.318938:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444570.318941:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318947:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513ba00/0x42cb6883e3834409 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318957:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318962:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318967:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318971:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513a600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:1.0:1783444570.318974:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318979:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.318985:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff9368c3abd100) 00010000:00010000:1.0:1783444570.318987:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783444570.318989:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.319005:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513a600/0x42cb6883e3834410 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.319037:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513b400/0x42cb6883e3834402 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a110 expref: 118 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.319048:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3834417 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a110 expref: 117 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.319055:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368f57c6500) 00010000:00010000:1.0:1783444570.319057:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783444570.319060:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368c513bc00, rc 0) 00000100:00100000:1.0:1783444570.319082:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e7299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+117:73716:x1870073557892736:12345-192.168.204.20@tcp:101:dd.0 Request processed in 493us (1311us total) trans 124554051705 rc 0/0 00000100:00100000:1.0:1783444570.319088:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1577 00000100:00100000:1.0:1783444570.323996:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.330910:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557892992 00000100:00100000:0.0:1783444570.330926:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557892992 00000100:00100000:1.0:1783444570.331212:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 277 00000100:00100000:1.0:1783444570.331224:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+117:73707:x1870073557892992:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:1.0:1783444570.331551:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+118:73707:x1870073557892992:12345-192.168.204.20@tcp:35:dd.0 Request processed in 326us (7561us total) trans 124554051706 rc 0/0 00000100:00100000:1.0:1783444570.331559:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 277 00000100:00100000:3.0:1783444570.331871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.332004:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.332025:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.332047:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.332082:0:25148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557893760 00000100:00100000:3.0:1783444570.332086:0:25148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557893760 00002000:00010000:3.0:1783444570.332108:0:25148:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/909 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.332113:0:25148:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff7ad180 with x1870073557893760 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.332136:0:25148:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff7ad180. 00000100:00100000:3.0:1783444570.332175:0:25148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1020 00000100:00100000:3.0:1783444570.332182:0:25148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+30:2404:x1870073557893760:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:3.0:1783444570.332334:0:25148:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783444570.332338:0:25148:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.332340:0:25148:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:3.0:1783444570.332343:0:25148:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.332345:0:25148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783444570.332352:0:25148:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7ad180 x1870073557893760/t4294969488(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.332385:0:25148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2404:x1870073557893760:12345-192.168.204.20@tcp:10:dd.0 Request processed in 204us (337us total) trans 4294969488 rc 0/0 00000100:00100000:3.0:1783444570.332392:0:25148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1020 00002000:00010000:3.0:1783444570.332395:0:25148:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/909 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.332398:0:25148:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff7ad180 with x1870073557893760 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.332402:0:25148:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff7ad180. 00000100:00100000:3.0:1783444570.332435:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.334740:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557893888 00000100:00100000:0.0:1783444570.334753:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557893888 00000100:00100000:0.0:1783444570.334832:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5959 00000100:00100000:0.0:1783444570.334841:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+31:73714:x1870073557893888:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.334873:0:26200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.334896:0:26200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bdfad08/0x42cb6883e3834425 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a125 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444570.334919:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38e:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:0.0:1783444570.334940:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:0.0:1783444570.334945:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444570.334953:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bdfad08/0x42cb6883e3834425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a125 expref: 32 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.334968:0:26200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004bdfad08/0x42cb6883e3834425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a125 expref: 32 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.334982:0:26200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c54e4e00, rc 0) 00010000:00000080:0.0:1783444570.334989:0:26200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff7ac380 x1870073557893888/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.335041:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+32:73714:x1870073557893888:12345-192.168.204.20@tcp:101:dd.0 Request processed in 201us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.335514:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5959 00000100:00100000:0.0:1783444570.337879:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557893376 00000100:00100000:0.0:1783444570.337893:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557893376 00000100:00100000:0.0:1783444570.337955:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557893120 00000100:00100000:0.0:1783444570.337959:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557893120 00000100:00100000:0.0:1783444570.337977:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557893632 00000100:00100000:0.0:1783444570.337979:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557893632 00000100:00100000:0.0:1783444570.338001:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1578 00000100:00100000:0.0:1783444570.338010:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+120:73715:x1870073557893376:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1783444570.338083:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444570.338108:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751200/0x42cb6883e38343d8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0fb expref: 120 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338137:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9368c59a7500) 00010000:00010000:0.0:1783444570.338142:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783444570.338303:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338316:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338326:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444570.338365:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051707 00000004:00010000:0.0:1783444570.338389:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007776e99d reply state 00000000f4d56679 transno 124554051708 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338400:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338407:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9368c59a7500) 00010000:00010000:0.0:1783444570.338409:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444570.338411:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444570.338495:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+122:73715:x1870073557893376:12345-192.168.204.20@tcp:36:dd.0 Request processed in 486us (6625us total) trans 124554051708 rc 0/0 00000100:00100000:0.0:1783444570.338502:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1578 00000020:00080000:0.0:1783444570.338507:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783444570.338523:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1579 00000100:00100000:0.0:1783444570.338536:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+121:73716:x1870073557893120:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.338547:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.338557:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4200/0x42cb6883e3834433 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a117 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338581:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4800/0x42cb6883e383443a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338590:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4800/0x42cb6883e383443a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338597:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4800/0x42cb6883e383443a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338665:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4200/0x42cb6883e3834433 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a117 expref: 123 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338680:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4800/0x42cb6883e383443a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a117 expref: 122 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.338688:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368f57c6500) 00010000:00010000:0.0:1783444570.338690:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783444570.338692:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c54e4800, rc 0) 00000100:00100000:0.0:1783444570.338940:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+122:73716:x1870073557893120:12345-192.168.204.20@tcp:101:dd.0 Request processed in 185us (6717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.338950:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1579 00000100:00100000:0.0:1783444570.338966:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1580 00000100:00100000:0.0:1783444570.338974:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+121:73718:x1870073557893632:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.338994:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.339004:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5c00/0x42cb6883e3834441 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a11e expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339266:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339276:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339283:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339296:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339302:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339308:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339344:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4400/0x42cb6883e3834456 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339351:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4400/0x42cb6883e3834456 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339358:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4400/0x42cb6883e3834456 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444570.339365:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1783444570.339424:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339431:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339436:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339442:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339446:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.339450:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339456:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339465:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444570.339467:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.339470:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339476:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834448 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339486:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339491:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339497:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339508:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.339512:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339517:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339525:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff9368f57c6000) 00010000:00010000:0.0:1783444570.339527:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.339530:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339536:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e383444f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339570:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5c00/0x42cb6883e3834441 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a11e expref: 124 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339582:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4400/0x42cb6883e3834456 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a11e expref: 123 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.339589:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:0.0:1783444570.339591:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444570.339594:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c54e4400, rc 0) 00000100:00100000:0.0:1783444570.339623:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+123:73718:x1870073557893632:12345-192.168.204.20@tcp:101:dd.0 Request processed in 651us (7597us total) trans 124554051709 rc 0/0 00000100:00100000:0.0:1783444570.339628:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1580 00000100:00100000:0.0:1783444570.341583:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.343352:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.344100:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557894144 00000100:00100000:1.0:1783444570.344113:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557894144 00000100:00100000:2.0:1783444570.345852:0:25139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557894272 00000100:00100000:2.0:1783444570.345862:0:25139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557894272 00002000:00010000:2.0:1783444570.345905:0:25139:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/910 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.345910:0:25139:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68e4a80 with x1870073557894272 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.345922:0:25139:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68e4a80. 00000100:00100000:2.0:1783444570.345954:0:25139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1021 00000100:00100000:2.0:1783444570.345963:0:25139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+32:2404:x1870073557894272:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:2.0:1783444570.346353:0:25139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783444570.346356:0:25139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:2.0:1783444570.346359:0:25139:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:2.0:1783444570.346361:0:25139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:2.0:1783444570.346363:0:25139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783444570.346372:0:25139:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68e4a80 x1870073557894272/t4294969489(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.346442:0:25139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2404:x1870073557894272:12345-192.168.204.20@tcp:10:dd.0 Request processed in 480us (3096us total) trans 4294969489 rc 0/0 00000100:00100000:2.0:1783444570.346449:0:25139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1021 00002000:00010000:2.0:1783444570.346452:0:25139:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/910 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.346468:0:25139:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68e4a80 with x1870073557894272 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.346473:0:25139:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68e4a80. 00000100:00100000:0.0:1783444570.348545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.348583:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.348651:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.348947:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557894400 00000100:00100000:2.0:1783444570.348958:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557894400 00000100:00100000:2.0:1783444570.349012:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557894656 00000100:00100000:2.0:1783444570.349016:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557894656 00000100:00100000:2.0:1783444570.349035:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557894912 00000100:00100000:2.0:1783444570.349038:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557894912 00000100:00100000:2.0:1783444570.349071:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1581 00000100:00100000:2.0:1783444570.349175:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+126:73718:x1870073557894400:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.349201:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.349224:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3834464 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a12c expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.349262:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383446b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.349276:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383446b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.349287:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383446b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.349402:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5756600/0x42cb6883e3834464 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a12c expref: 128 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.349418:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757400/0x42cb6883e383446b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a12c expref: 127 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.349426:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:2.0:1783444570.349436:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783444570.349440:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757400, rc 0) 00000100:00100000:2.0:1783444570.349491:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+127:73718:x1870073557894400:12345-192.168.204.20@tcp:101:dd.0 Request processed in 319us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444570.349591:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 278 00000100:00100000:1.0:1783444570.349601:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+127:73713:x1870073557894144:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:1.0:1783444570.349861:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+128:73713:x1870073557894144:12345-192.168.204.20@tcp:35:dd.0 Request processed in 260us (8284us total) trans 124554051710 rc 0/0 00000100:00100000:1.0:1783444570.349868:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 278 00000100:00100000:0.0:1783444570.352751:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1582 00000100:00100000:0.0:1783444570.352809:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+127:73719:x1870073557894656:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.352834:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.352856:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5c00/0x42cb6883e3834472 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a133 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.352991:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353006:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353016:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353031:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353038:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353046:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353293:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4200/0x42cb6883e3834487 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353323:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4200/0x42cb6883e3834487 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353331:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4200/0x42cb6883e3834487 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444570.353343:0:80475:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 0 00010000:00010000:0.0:1783444570.353443:0:80475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353452:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353458:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353465:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353471:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.353476:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353483:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353497:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444570.353500:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.353505:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353511:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5000/0x42cb6883e3834479 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353531:0:80475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353537:0:80475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353542:0:80475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353548:0:80475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.353550:0:80475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353556:0:80475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353563:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff9368f57c6000) 00010000:00010000:0.0:1783444570.353565:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.353568:0:80475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353573:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5600/0x42cb6883e3834480 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353613:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5c00/0x42cb6883e3834472 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a133 expref: 130 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353626:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4200/0x42cb6883e3834487 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a133 expref: 129 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353645:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8300) 00010000:00010000:0.0:1783444570.353647:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444570.353650:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c54e4200, rc 0) 00000100:00100000:0.0:1783444570.353703:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+129:73719:x1870073557894656:12345-192.168.204.20@tcp:101:dd.0 Request processed in 939us (5119us total) trans 124554051711 rc 0/0 00000100:00100000:0.0:1783444570.353711:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1582 00000100:00100000:0.0:1783444570.353904:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1583 00000100:00100000:0.0:1783444570.353914:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+128:73716:x1870073557894912:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1783444570.353943:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444570.353958:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368c513bc00/0x42cb6883e3834417 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a110 expref: 128 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.353969:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368f57c6500) 00010000:00010000:0.0:1783444570.353972:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783444570.354848:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1581 00010000:00010000:0.0:1783444570.355033:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.355047:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.355134:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444570.355192:0:80475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051712 00000004:00010000:0.0:1783444570.355223:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e109346 reply state 00000000db79d666 transno 124554051713 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.355256:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.355263:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368f57c6500) 00010000:00010000:0.0:1783444570.355265:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783444570.355268:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444570.355337:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+129:73716:x1870073557894912:12345-192.168.204.20@tcp:36:dd.0 Request processed in 1425us (6685us total) trans 124554051713 rc 0/0 00000100:00100000:0.0:1783444570.355344:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1583 00000020:00080000:0.0:1783444570.355348:0:80475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783444570.357529:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.357587:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.357675:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557895296 00000100:00100000:2.0:1783444570.357685:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557895296 00000100:00100000:2.0:1783444570.357751:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1584 00000100:00100000:2.0:1783444570.357761:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+129:73718:x1870073557895296:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:2.0:1783444570.357849:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783444570.357874:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4400/0x42cb6883e3834456 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a11e expref: 129 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.357894:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:2.0:1783444570.357900:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783444570.358066:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.358080:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.358099:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783444570.358150:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051714 00000004:00010000:2.0:1783444570.358169:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014ef76c6 reply state 0000000055262a3c transno 124554051715 ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.358181:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.358201:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:2.0:1783444570.358203:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783444570.358206:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783444570.358278:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+131:73718:x1870073557895296:12345-192.168.204.20@tcp:36:dd.0 Request processed in 518us (689us total) trans 124554051715 rc 0/0 00000100:00100000:2.0:1783444570.358285:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1584 00000020:00080000:2.0:1783444570.358290:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783444570.361443:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557895040 00000100:00100000:3.0:1783444570.361458:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557895040 00000100:00100000:3.0:1783444570.361531:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5960 00000100:00100000:3.0:1783444570.361541:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+33:73715:x1870073557895040:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.361558:0:26204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.361578:0:26204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e38344a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a13a expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.361606:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38f:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:3.0:1783444570.361750:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:3.0:1783444570.361754:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444570.361763:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e38344a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a13a expref: 34 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.361780:0:26204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e38344a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a13a expref: 34 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.362041:0:26204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750000, rc 0) 00010000:00000080:3.0:1783444570.362167:0:26204:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368c59ba680 x1870073557895040/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.362222:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73715:x1870073557895040:12345-192.168.204.20@tcp:101:dd.0 Request processed in 684us (4702us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.362229:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5960 00000100:00100000:0.0:1783444570.368409:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.374225:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.374262:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.374330:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557895552 00000100:00100000:3.0:1783444570.374343:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557895552 00000100:00100000:3.0:1783444570.374397:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 279 00000100:00100000:3.0:1783444570.374407:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+131:73714:x1870073557895552:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:3.0:1783444570.374701:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+132:73714:x1870073557895552:12345-192.168.204.20@tcp:35:dd.0 Request processed in 295us (6302us total) trans 124554051716 rc 0/0 00000100:00100000:3.0:1783444570.374709:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 279 00000100:00100000:0.0:1783444570.376018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.376050:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896064 00000100:00100000:0.0:1783444570.376057:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896064 00000100:00100000:0.0:1783444570.376105:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5961 00000100:00100000:0.0:1783444570.376123:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+34:73716:x1870073557896064:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.376139:0:26201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.376160:0:26201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a1491bd/0x42cb6883e38344aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a14f expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444570.376185:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x390:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:0.0:1783444570.376203:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:0.0:1783444570.376208:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444570.376217:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1491bd/0x42cb6883e38344aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a14f expref: 35 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.376255:0:26201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a1491bd/0x42cb6883e38344aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a14f expref: 35 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.376268:0:26201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c54e5600, rc 0) 00010000:00000080:0.0:1783444570.376275:0:26201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c2c8b100 x1870073557896064/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.376320:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+35:73716:x1870073557896064:12345-192.168.204.20@tcp:101:dd.0 Request processed in 207us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.376327:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5961 00000100:00100000:0.0:1783444570.376366:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.376732:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896192 00000100:00100000:3.0:1783444570.376736:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896192 00000100:00100000:3.0:1783444570.377923:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5962 00000100:00100000:3.0:1783444570.377937:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:08efc25c-17e5-4d29-97d2-f1505f195a06+35:73718:x1870073557896192:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.377966:0:26209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.377985:0:26209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e38344b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a156 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.378006:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x392:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:3.0:1783444570.378021:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:3.0:1783444570.378025:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444570.378032:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e38344b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a156 expref: 36 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.378210:0:26209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e38344b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a156 expref: 36 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.378226:0:26209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751400, rc 0) 00010000:00000080:3.0:1783444570.378233:0:26209:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c2c8b480 x1870073557896192/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.378287:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:08efc25c-17e5-4d29-97d2-f1505f195a06+36:73718:x1870073557896192:12345-192.168.204.20@tcp:101:dd.0 Request processed in 353us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.378293:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5962 00000100:00100000:1.0:1783444570.379304:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557895680 00000100:00100000:1.0:1783444570.379316:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557895680 00000100:00100000:1.0:1783444570.379380:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557895936 00000100:00100000:1.0:1783444570.379384:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557895936 00000100:00100000:1.0:1783444570.379413:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1585 00000100:00100000:1.0:1783444570.379421:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+133:73719:x1870073557895680:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1783444570.379442:0:80475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783444570.379459:0:80475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e38344b8 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a141 expref: -99 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.379489:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38344bf lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.379502:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38344bf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.379512:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38344bf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444570.379710:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1586 00000100:00100000:0.0:1783444570.379731:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+134:73721:x1870073557895936:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.379741:0:71469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.379752:0:71469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4c00/0x42cb6883e38344c6 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a148 expref: -99 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.379995:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380005:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380012:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380025:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380040:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380173:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380231:0:71469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38344db lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380240:0:71469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38344db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380248:0:71469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38344db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783444570.380258:0:71469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 0 00010000:00010000:0.0:1783444570.380335:0:71469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380343:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380349:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380355:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380362:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.380366:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380384:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380396:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:0.0:1783444570.380399:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.380403:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380410:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5a00/0x42cb6883e38344cd lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380424:0:71469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380429:0:71469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380435:0:71469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380440:0:71469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:0.0:1783444570.380442:0:71469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380448:0:71469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380455:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff9368f57c6d00) 00010000:00010000:0.0:1783444570.380457:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783444570.380460:0:71469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380476:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5800/0x42cb6883e38344d4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380516:0:71469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4c00/0x42cb6883e38344c6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a148 expref: 137 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380530:0:71469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38344db lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a148 expref: 136 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.380536:0:71469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:0.0:1783444570.380539:0:71469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783444570.380541:0:71469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c6d71600, rc 0) 00000100:00100000:0.0:1783444570.380597:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+136:73721:x1870073557895936:12345-192.168.204.20@tcp:101:dd.0 Request processed in 878us (6332us total) trans 124554051717 rc 0/0 00000100:00100000:0.0:1783444570.380604:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1586 00010000:00010000:1.0:1783444570.380893:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583e800/0x42cb6883e38344b8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a141 expref: 137 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.380909:0:80475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c583fa00/0x42cb6883e38344bf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a141 expref: 136 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444570.380922:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8300) 00010000:00010000:1.0:1783444570.380924:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783444570.380927:0:80475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583fa00, rc 0) 00000100:00100000:1.0:1783444570.380956:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+136:73719:x1870073557895680:12345-192.168.204.20@tcp:101:dd.0 Request processed in 1535us (6739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444570.380962:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1585 00000100:00100000:2.0:1783444570.390042:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.390995:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896320 00000100:00100000:3.0:1783444570.391008:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896320 00002000:00010000:3.0:1783444570.391682:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/911 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.391691:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd19a300 with x1870073557896320 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.391705:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd19a300. 00000100:00100000:3.0:1783444570.391976:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1022 00000100:00100000:3.0:1783444570.391992:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+36:2404:x1870073557896320:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:3.0:1783444570.393172:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783444570.393179:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.393182:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:3.0:1783444570.393184:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.393187:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783444570.393201:0:8425:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd19a300 x1870073557896320/t4294969490(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.393274:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+37:2404:x1870073557896320:12345-192.168.204.20@tcp:10:dd.0 Request processed in 1288us (3242us total) trans 4294969490 rc 0/0 00000100:00100000:3.0:1783444570.393284:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1022 00002000:00010000:3.0:1783444570.393289:0:8425:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/911 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.393293:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd19a300 with x1870073557896320 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.393299:0:8425:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd19a300. 00000100:00100000:0.0:1783444570.401341:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.401421:0:24882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896448 00000100:00100000:3.0:1783444570.401431:0:24882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896448 00002000:00010000:3.0:1783444570.401471:0:24882:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/912 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.401477:0:24882:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c2c88e00 with x1870073557896448 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.401488:0:24882:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c2c88e00. 00000100:00100000:3.0:1783444570.402314:0:24882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1023 00000100:00100000:3.0:1783444570.402329:0:24882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+37:2402:x1870073557896448:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:3.0:1783444570.402482:0:24882:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783444570.402486:0:24882:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.402489:0:24882:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:3.0:1783444570.402491:0:24882:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.402493:0:24882:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783444570.402519:0:24882:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c2c88e00 x1870073557896448/t4294969491(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.402580:0:24882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+38:2402:x1870073557896448:12345-192.168.204.20@tcp:10:dd.0 Request processed in 255us (1247us total) trans 4294969491 rc 0/0 00000100:00100000:3.0:1783444570.402588:0:24882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1023 00002000:00010000:3.0:1783444570.402593:0:24882:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/912 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.402596:0:24882:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c2c88e00 with x1870073557896448 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.402602:0:24882:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c2c88e00. 00000100:00100000:0.0:1783444570.422236:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.422277:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.422316:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.422333:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.422355:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.422376:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.422411:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557897472 00000100:00100000:0.0:1783444570.422420:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557897472 00000100:00100000:0.0:1783444570.422460:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557897728 00000100:00100000:0.0:1783444570.422462:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557897728 00000100:00100000:0.0:1783444570.422475:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 280 00000100:00100000:0.0:1783444570.422499:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd128050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+136:73715:x1870073557897472:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:3.0:1783444570.422839:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896704 00000100:00100000:3.0:1783444570.422844:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896704 00000100:00100000:3.0:1783444570.422871:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896960 00000100:00100000:3.0:1783444570.422874:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896960 00000100:00100000:3.0:1783444570.422951:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557897216 00000100:00100000:3.0:1783444570.422955:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557897216 00000100:00100000:3.0:1783444570.422972:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1587 00000100:00100000:3.0:1783444570.422979:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+140:73721:x1870073557896704:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.422989:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.423007:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e38344e9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a15d expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423041:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38344f0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423052:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38344f0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423063:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38344f0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423168:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e38344e9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a15d expref: 142 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423184:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750600/0x42cb6883e38344f0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a15d expref: 141 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423192:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:3.0:1783444570.423195:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783444570.423198:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750600, rc 0) 00000100:00100000:3.0:1783444570.423254:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+141:73721:x1870073557896704:12345-192.168.204.20@tcp:101:dd.0 Request processed in 274us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.423261:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1587 00000100:00100000:3.0:1783444570.423279:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1588 00000100:00100000:3.0:1783444570.423285:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+140:73719:x1870073557896960:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:3.0:1783444570.423310:0:67017:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444570.423325:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4200/0x42cb6883e3834487 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a133 expref: 140 pid: 80475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423337:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8300) 00010000:00010000:3.0:1783444570.423340:0:67017:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444570.423417:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423426:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423433:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444570.423478:0:67017:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051719 00000004:00010000:3.0:1783444570.423499:0:67017:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092a213a2 reply state 000000005ce26a0f transno 124554051720 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423511:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423517:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8300) 00010000:00010000:3.0:1783444570.423519:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444570.423522:0:67017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444570.423571:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+142:73719:x1870073557896960:12345-192.168.204.20@tcp:36:dd.0 Request processed in 286us (1253us total) trans 124554051720 rc 0/0 00000100:00100000:3.0:1783444570.423577:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1588 00000020:00080000:3.0:1783444570.423580:0:67017:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783444570.423592:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1589 00000100:00100000:3.0:1783444570.423598:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+141:73720:x1870073557897216:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.423606:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.423614:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e38344fe lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a164 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423699:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423707:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423715:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423754:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423762:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423769:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423847:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3834513 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423855:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3834513 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423863:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3834513 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783444570.423871:0:67017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 0 00010000:00010000:3.0:1783444570.423914:0:67017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423922:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423927:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423933:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423939:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.423949:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423957:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423966:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff9368d40f4000) 00010000:00010000:3.0:1783444570.423968:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.423971:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423977:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751000/0x42cb6883e3834505 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423986:0:67017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423992:0:67017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.423997:0:67017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.424002:0:67017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751800 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444570.424004:0:67017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.424009:0:67017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.424017:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff9368c138dd00) 00010000:00010000:3.0:1783444570.424019:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444570.424028:0:67017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.424034:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751800/0x42cb6883e383450c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.424069:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750200/0x42cb6883e38344fe lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a164 expref: 144 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.424081:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3834513 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a164 expref: 143 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.424088:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:3.0:1783444570.424090:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783444570.424092:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751c00, rc 0) 00000100:00100000:3.0:1783444570.424129:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+143:73720:x1870073557897216:12345-192.168.204.20@tcp:101:dd.0 Request processed in 531us (1794us total) trans 124554051721 rc 0/0 00000100:00100000:3.0:1783444570.424135:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1589 00000100:00100000:2.0:1783444570.424454:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896576 00000100:00100000:2.0:1783444570.424462:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896576 00002000:00010000:2.0:1783444570.424488:0:8427:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/914 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.424493:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c2c89180 with x1870073557896576 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.424502:0:8427:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c2c89180. 00000100:00100000:2.0:1783444570.424534:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1024 00000100:00100000:2.0:1783444570.424541:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c2c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+38:2403:x1870073557896576:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:2.0:1783444570.424656:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783444570.424659:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:2.0:1783444570.424662:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:2.0:1783444570.424664:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:2.0:1783444570.424666:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1783444570.424674:0:8427:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c2c89180 x1870073557896576/t4294969492(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.424706:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c2c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+39:2403:x1870073557896576:12345-192.168.204.20@tcp:10:dd.0 Request processed in 165us (2480us total) trans 4294969492 rc 0/0 00000100:00100000:2.0:1783444570.424712:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1024 00002000:00010000:2.0:1783444570.424744:0:8427:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/914 (0->18446744073709551615) 00002000:00100000:2.0:1783444570.424747:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c2c89180 with x1870073557896576 ext(0->18446744073709551615) 00002000:00010000:2.0:1783444570.424752:0:8427:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c2c89180. 00000100:00100000:1.0:1783444570.424957:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 281 00000100:00100000:1.0:1783444570.424969:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+142:73716:x1870073557897728:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:1.0:1783444570.425152:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+143:73716:x1870073557897728:12345-192.168.204.20@tcp:35:dd.0 Request processed in 186us (2775us total) trans 124554051722 rc 0/0 00000100:00100000:1.0:1783444570.425159:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 281 00000100:00100000:0.0:1783444570.426188:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd128050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+142:73715:x1870073557897472:12345-192.168.204.20@tcp:35:dd.0 Request processed in 3687us (3827us total) trans 124554051718 rc 0/0 00000100:00100000:0.0:1783444570.426197:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 280 00000100:00100000:1.0:1783444570.430167:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.430223:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.430298:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557897984 00000100:00100000:3.0:1783444570.430308:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557897984 00000100:00100000:3.0:1783444570.430379:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1590 00000100:00100000:3.0:1783444570.430389:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+142:73720:x1870073557897984:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.430411:0:67017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.430432:0:67017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3834521 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a172 expref: -99 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.430466:0:67017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3834528 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.430494:0:67017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3834528 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.430506:0:67017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3834528 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.430606:0:67017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751e00/0x42cb6883e3834521 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a172 expref: 144 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.430623:0:67017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750800/0x42cb6883e3834528 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a172 expref: 143 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.430632:0:67017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:3.0:1783444570.430635:0:67017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783444570.430639:0:67017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4750800, rc 0) 00000100:00100000:3.0:1783444570.430703:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+143:73720:x1870073557897984:12345-192.168.204.20@tcp:101:dd.0 Request processed in 315us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444570.430709:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1590 00000100:00100000:0.0:1783444570.432908:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557897856 00000100:00100000:0.0:1783444570.432924:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557897856 00000100:00100000:0.0:1783444570.433004:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5963 00000100:00100000:0.0:1783444570.433016:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+39:73719:x1870073557897856:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1783444570.433033:0:26210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783444570.433063:0:26210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dcb511c/0x42cb6883e383452f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a16b expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783444570.433091:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x393:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:0.0:1783444570.433120:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:0.0:1783444570.433125:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783444570.433134:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dcb511c/0x42cb6883e383452f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a16b expref: 40 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.433149:0:26210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001dcb511c/0x42cb6883e383452f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a16b expref: 40 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.433162:0:26210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367ccfb9200, rc 0) 00010000:00000080:0.0:1783444570.433169:0:26210:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68f7800 x1870073557897856/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.433229:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+40:73719:x1870073557897856:12345-192.168.204.20@tcp:101:dd.0 Request processed in 215us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444570.433250:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5963 00000100:00100000:1.0:1783444570.437750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.437870:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557898240 00000100:00100000:3.0:1783444570.437880:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557898240 00000100:00100000:3.0:1783444570.437933:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1591 00000100:00100000:3.0:1783444570.437944:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+143:73721:x1870073557898240:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:3.0:1783444570.438003:0:66226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783444570.438031:0:66226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d71600/0x42cb6883e38344db lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a148 expref: 143 pid: 71469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.438051:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:3.0:1783444570.438070:0:66226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783444570.438267:0:66226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.438281:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.438291:0:66226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783444570.438337:0:66226:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051723 00000004:00010000:3.0:1783444570.438359:0:66226:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1bfea04 reply state 00000000160a1d0e transno 124554051724 ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.438371:0:66226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.438377:0:66226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:3.0:1783444570.438379:0:66226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783444570.438382:0:66226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783444570.438468:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+145:73721:x1870073557898240:12345-192.168.204.20@tcp:36:dd.0 Request processed in 525us (727us total) trans 124554051724 rc 0/0 00000100:00100000:3.0:1783444570.438475:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1591 00000020:00080000:3.0:1783444570.438480:0:66226:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783444570.443337:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.443418:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.443654:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557898624 00000100:00100000:0.0:1783444570.443665:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557898624 00000100:00100000:3.0:1783444570.443669:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557898368 00000100:00100000:3.0:1783444570.443676:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557898368 00002000:00010000:3.0:1783444570.443713:0:25160:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/915 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.443718:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd158380 with x1870073557898368 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.443730:0:25160:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd158380. 00000100:00100000:0.0:1783444570.443744:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1592 00000100:00100000:3.0:1783444570.443753:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1025 00000100:00100000:0.0:1783444570.443759:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+145:73720:x1870073557898624:12345-192.168.204.20@tcp:36:dd.0 00000100:00100000:3.0:1783444570.443772:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+40:2404:x1870073557898368:12345-192.168.204.20@tcp:10:dd.0 00010000:00010000:0.0:1783444570.443851:0:80475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444570.443879:0:80475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751c00/0x42cb6883e3834513 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a164 expref: 145 pid: 67017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.443896:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:0.0:1783444570.443902:0:80475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1783444570.443945:0:25160:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783444570.443949:0:25160:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.443951:0:25160:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:3.0:1783444570.443954:0:25160:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.443956:0:25160:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783444570.443964:0:25160:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd158380 x1870073557898368/t4294969493(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.444021:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+41:2404:x1870073557898368:12345-192.168.204.20@tcp:10:dd.0 Request processed in 258us (707us total) trans 4294969493 rc 0/0 00000100:00100000:3.0:1783444570.444029:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1025 00002000:00010000:3.0:1783444570.444033:0:25160:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/915 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.444036:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd158380 with x1870073557898368 ext(0->18446744073709551615) 00010000:00010000:0.0:1783444570.444040:0:80475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.444041:0:25160:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd158380. 00010000:00010000:0.0:1783444570.444069:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.444090:0:80475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783444570.444139:0:80475:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051725 00000004:00010000:0.0:1783444570.444163:0:80475:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006720cea0 reply state 00000000b5bb8458 transno 124554051726 ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.444176:0:80475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444570.444183:0:80475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:0.0:1783444570.444189:0:80475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783444570.444190:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.444198:0:80475:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783444570.444258:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+147:73720:x1870073557898624:12345-192.168.204.20@tcp:36:dd.0 Request processed in 504us (838us total) trans 124554051726 rc 0/0 00000100:00100000:0.0:1783444570.444265:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1592 00000020:00080000:0.0:1783444570.444269:0:80475:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783444570.444394:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557898880 00000100:00100000:3.0:1783444570.444399:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557898880 00000100:00100000:3.0:1783444570.444429:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 282 00000100:00100000:3.0:1783444570.444532:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+147:73718:x1870073557898880:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:3.0:1783444570.444670:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd15b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+148:73718:x1870073557898880:12345-192.168.204.20@tcp:35:dd.0 Request processed in 140us (482us total) trans 124554051727 rc 0/0 00000100:00100000:3.0:1783444570.449289:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 282 00000100:00100000:1.0:1783444570.458448:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.458605:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557899008 00000100:00100000:3.0:1783444570.458615:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557899008 00000100:00100000:3.0:1783444570.458674:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5964 00000100:00100000:3.0:1783444570.458684:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+41:73721:x1870073557899008:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:3.0:1783444570.458705:0:26208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783444570.458742:0:26208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3834544 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a179 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783444570.458770:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x395:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:3.0:1783444570.458832:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:3.0:1783444570.458837:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783444570.458846:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3834544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a179 expref: 42 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.458866:0:26208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3834544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a179 expref: 42 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444570.458880:0:26208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751e00, rc 0) 00010000:00000080:3.0:1783444570.458889:0:26208:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c308c000 x1870073557899008/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.459019:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+42:73721:x1870073557899008:12345-192.168.204.20@tcp:101:dd.0 Request processed in 335us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444570.459027:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5964 00000100:00100000:2.0:1783444570.463230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.463376:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557899264 00000100:00100000:0.0:1783444570.463385:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557899264 00000100:00100000:0.0:1783444570.463432:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 283 00000100:00100000:0.0:1783444570.463443:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+148:73719:x1870073557899264:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:0.0:1783444570.463750:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+149:73719:x1870073557899264:12345-192.168.204.20@tcp:35:dd.0 Request processed in 309us (529us total) trans 124554051728 rc 0/0 00000100:00100000:0.0:1783444570.463758:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 283 00000100:00100000:0.0:1783444570.464413:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.464736:0:25148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557899392 00000100:00100000:3.0:1783444570.464742:0:25148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557899392 00002000:00010000:3.0:1783444570.464778:0:25148:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/917 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.464783:0:25148:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368c59bb100 with x1870073557899392 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.464832:0:25148:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368c59bb100. 00000100:00100000:3.0:1783444570.464852:0:25148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1026 00000100:00100000:3.0:1783444570.464860:0:25148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+42:2404:x1870073557899392:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:3.0:1783444570.464978:0:25148:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783444570.464982:0:25148:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.464984:0:25148:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:3.0:1783444570.464986:0:25148:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:3.0:1783444570.465003:0:25148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1783444570.465013:0:25148:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368c59bb100 x1870073557899392/t4294969494(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444570.465361:0:25148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c59bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+43:2404:x1870073557899392:12345-192.168.204.20@tcp:10:dd.0 Request processed in 500us (947us total) trans 4294969494 rc 0/0 00000100:00100000:3.0:1783444570.465369:0:25148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1026 00002000:00010000:3.0:1783444570.465372:0:25148:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/917 (0->18446744073709551615) 00002000:00100000:3.0:1783444570.465375:0:25148:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368c59bb100 with x1870073557899392 ext(0->18446744073709551615) 00002000:00010000:3.0:1783444570.465381:0:25148:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368c59bb100. 00000100:00100000:1.0:1783444570.470429:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444570.470664:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557899520 00000100:00100000:2.0:1783444570.470676:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557899520 00000100:00100000:2.0:1783444570.470752:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5965 00000100:00100000:2.0:1783444570.470763:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+43:73720:x1870073557899520:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:2.0:1783444570.470782:0:26207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783444570.470829:0:26207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e383454b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a180 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783444570.470857:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x394:0x0] initial LVB size: 0, mtime: 0x6a4d344e, atime: 0x6a4d344e, ctime: 0x6a4d344e, blocks: 0x0 00010000:00010000:2.0:1783444570.470880:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=3561s v=(0 0) 00010000:00010000:2.0:1783444570.470886:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783444570.470895:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e383454b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a180 expref: 44 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.470911:0:26207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e383454b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a180 expref: 44 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444570.470925:0:26207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756c00, rc 0) 00010000:00000080:2.0:1783444570.470932:0:26207:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c308dc00 x1870073557899520/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 328/400 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444570.471767:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+44:73720:x1870073557899520:12345-192.168.204.20@tcp:101:dd.0 Request processed in 1002us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444570.471776:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5965 00000100:00100000:0.0:1783444570.480350:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444570.481590:0:76566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557899776 00000100:00100000:1.0:1783444570.481602:0:76566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557899776 00000100:00100000:1.0:1783444570.481668:0:76566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:1.0:1783444570.481679:0:76566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+149:73721:x1870073557899776:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:1.0:1783444570.482003:0:76566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+150:73721:x1870073557899776:12345-192.168.204.20@tcp:35:dd.0 Request processed in 325us (1671us total) trans 124554051729 rc 0/0 00000100:00100000:1.0:1783444570.482025:0:76566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:1.0:1783444570.494057:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444570.494148:0:25139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557899904 00000100:00100000:0.0:1783444570.494158:0:25139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557899904 00002000:00010000:0.0:1783444570.494197:0:25139:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/916 (0->18446744073709551615) 00002000:00100000:0.0:1783444570.494202:0:25139:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c308f100 with x1870073557899904 ext(0->18446744073709551615) 00002000:00010000:0.0:1783444570.494214:0:25139:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c308f100. 00000100:00100000:0.0:1783444570.494247:0:25139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1027 00000100:00100000:0.0:1783444570.494257:0:25139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+44:2404:x1870073557899904:12345-192.168.204.20@tcp:10:dd.0 00002000:00010000:0.0:1783444570.494413:0:25139:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783444570.494417:0:25139:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb mtime from disk: 1783444558 -> 1783444571 00002000:00010000:0.0:1783444570.494419:0:25139:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb atime from disk: 1783444558 -> 1783444558 00002000:00010000:0.0:1783444570.494421:0:25139:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb ctime from disk: 1783444558 -> 1783444571 00002000:00010000:0.0:1783444570.494423:0:25139:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1783444570.494432:0:25139:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c308f100 x1870073557899904/t4294969495(0) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:191/0 lens 440/432 e 0 to 0 dl 1783444581 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444570.494508:0:25139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+45:2404:x1870073557899904:12345-192.168.204.20@tcp:10:dd.0 Request processed in 252us (471us total) trans 4294969495 rc 0/0 00000100:00100000:0.0:1783444570.494516:0:25139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1027 00002000:00010000:0.0:1783444570.494519:0:25139:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/916 (0->18446744073709551615) 00002000:00100000:0.0:1783444570.494521:0:25139:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9367c308f100 with x1870073557899904 ext(0->18446744073709551615) 00002000:00010000:0.0:1783444570.494526:0:25139:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9367c308f100. 00000100:00100000:0.0:1783444570.505219:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444570.505345:0:66229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900160 00000100:00100000:3.0:1783444570.505355:0:66229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900160 00000100:00100000:3.0:1783444570.505406:0:66229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 285 00000100:00100000:3.0:1783444570.505415:0:66229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+150:73720:x1870073557900160:12345-192.168.204.20@tcp:35:dd.0 00000100:00100000:3.0:1783444570.505685:0:66229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+151:73720:x1870073557900160:12345-192.168.204.20@tcp:35:dd.0 Request processed in 270us (474us total) trans 124554051730 rc 0/0 00000100:00100000:3.0:1783444570.505693:0:66229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 285 00010000:00010000:0.0:1783444571.228970:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444571.727186:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444571.727227:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.727345:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900288 00000100:00100000:3.0:1783444571.727357:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900288 00002000:00100000:3.0:1783444571.727405:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x382:0x0] (0->1023) req@ffff9368dd199c00 x1870073557900288/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.727417:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd199c00 with x1870073557900288 ext(0->1023) 00002000:00010000:3.0:1783444571.727423:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd199c00 00000100:00100000:0.0:1783444571.732085:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900416 00000100:00100000:0.0:1783444571.732110:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900416 00000100:00100000:0.0:1783444571.732170:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5966 00000100:00100000:0.0:1783444571.732180:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+46:2401:x1870073557900416:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:0.0:1783444571.732453:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969495 is committed 00010000:00000080:0.0:1783444571.732522:0:8421:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd19ad80 x1870073557900416/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.732604:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+26:2401:x1870073557900416:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 426us (5376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.732612:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5966 00000100:00100000:3.0:1783444571.732870:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1028 00000100:00100000:3.0:1783444571.732881:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2401:x1870073557900288:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:3.0:1783444571.733225:0:24883:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd199c00 x1870073557900288/t4294969496(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.733263:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2401:x1870073557900288:12345-192.168.204.20@tcp:4:dd.0 Request processed in 385us (6087us total) trans 4294969496 rc 0/0 00000100:00100000:3.0:1783444571.733270:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1028 00002000:00100000:3.0:1783444571.733278:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x382:0x0] (0->1023) req@ffff9368dd199c00 x1870073557900288/t4294969496(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.733287:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd199c00 with x1870073557900288 ext(0->1023) 00002000:00010000:3.0:1783444571.733293:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd199c00 00000100:00100000:3.0:1783444571.756450:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.756487:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900672 00000100:00100000:3.0:1783444571.756497:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900672 00000100:00100000:3.0:1783444571.756547:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5967 00000100:00100000:3.0:1783444571.756557:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2402:x1870073557900672:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:3.0:1783444571.756622:0:8422:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f9ecdc00 x1870073557900672/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.756784:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2402:x1870073557900672:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 145us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.761908:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.761979:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900544 00000100:00100000:0.0:1783444571.761989:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900544 00002000:00100000:0.0:1783444571.762039:0:24881:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x383:0x0] (0->1023) req@ffff9368e68e6300 x1870073557900544/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.762517:0:24881:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68e6300 with x1870073557900544 ext(0->1023) 00002000:00010000:0.0:1783444571.762523:0:24881:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68e6300 00000100:00100000:0.0:1783444571.762568:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1029 00000100:00100000:0.0:1783444571.762580:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+28:2403:x1870073557900544:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:0.0:1783444571.763298:0:24881:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368e68e6300 x1870073557900544/t4294969497(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.763361:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e68e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+30:2403:x1870073557900544:12345-192.168.204.20@tcp:4:dd.0 Request processed in 784us (6629us total) trans 4294969497 rc 0/0 00000100:00100000:0.0:1783444571.763370:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1029 00002000:00100000:0.0:1783444571.763376:0:24881:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x383:0x0] (0->1023) req@ffff9368e68e6300 x1870073557900544/t4294969497(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.763385:0:24881:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368e68e6300 with x1870073557900544 ext(0->1023) 00002000:00010000:0.0:1783444571.763389:0:24881:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368e68e6300 00000100:00100000:3.0:1783444571.767366:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5967 00000100:00100000:1.0:1783444571.772943:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444571.772992:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444571.773025:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900800 00000100:00100000:1.0:1783444571.773035:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900800 00002000:00100000:1.0:1783444571.773086:0:8427:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x384:0x0] (0->1023) req@ffff9368dd10b100 x1870073557900800/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.773108:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd10b100 with x1870073557900800 ext(0->1023) 00002000:00010000:1.0:1783444571.773114:0:8427:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd10b100 00000100:00100000:1.0:1783444571.773148:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1030 00000100:00100000:1.0:1783444571.773157:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2404:x1870073557900800:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:1.0:1783444571.773539:0:8427:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd10b100 x1870073557900800/t4294969498(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444571.773597:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2404:x1870073557900800:12345-192.168.204.20@tcp:4:dd.0 Request processed in 440us (603us total) trans 4294969498 rc 0/0 00000100:00100000:1.0:1783444571.773605:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1030 00002000:00100000:1.0:1783444571.773611:0:8427:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x384:0x0] (0->1023) req@ffff9368dd10b100 x1870073557900800/t4294969498(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.773619:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd10b100 with x1870073557900800 ext(0->1023) 00002000:00010000:1.0:1783444571.773623:0:8427:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd10b100 00000100:00100000:0.0:1783444571.774826:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900928 00000100:00100000:0.0:1783444571.774838:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900928 00000100:00100000:0.0:1783444571.774887:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5968 00000100:00100000:0.0:1783444571.774896:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c308fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2404:x1870073557900928:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:0.0:1783444571.775147:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969498 is committed 00010000:00000080:0.0:1783444571.775187:0:26203:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9367c308fb80 x1870073557900928/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.775231:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c308fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2404:x1870073557900928:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 336us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.775312:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5968 00000100:00100000:3.0:1783444571.781164:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.781201:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.781229:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901056 00000100:00100000:3.0:1783444571.781251:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901056 00002000:00100000:3.0:1783444571.781302:0:25160:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x385:0x0] (0->1023) req@ffff9368f9ecd180 x1870073557901056/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.781314:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368f9ecd180 with x1870073557901056 ext(0->1023) 00002000:00010000:3.0:1783444571.781330:0:25160:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368f9ecd180 00000100:00100000:3.0:1783444571.781360:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1031 00000100:00100000:3.0:1783444571.781369:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2403:x1870073557901056:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:3.0:1783444571.781908:0:25160:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f9ecd180 x1870073557901056/t4294969499(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.781975:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2403:x1870073557901056:12345-192.168.204.20@tcp:4:dd.0 Request processed in 607us (820us total) trans 4294969499 rc 0/0 00000100:00100000:3.0:1783444571.781983:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1031 00002000:00100000:3.0:1783444571.781990:0:25160:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x385:0x0] (0->1023) req@ffff9368f9ecd180 x1870073557901056/t4294969499(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.781999:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368f9ecd180 with x1870073557901056 ext(0->1023) 00002000:00010000:3.0:1783444571.782004:0:25160:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368f9ecd180 00000100:00100000:0.0:1783444571.783886:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901184 00000100:00100000:0.0:1783444571.783901:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901184 00000100:00100000:0.0:1783444571.783966:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5969 00000100:00100000:0.0:1783444571.783977:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2403:x1870073557901184:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:0.0:1783444571.784405:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969499 is committed 00010000:00000080:0.0:1783444571.784446:0:26200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f9ecf100 x1870073557901184/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.784507:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2403:x1870073557901184:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 533us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.784516:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5969 00000100:00100000:3.0:1783444571.787101:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.787137:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.787166:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901440 00000100:00100000:3.0:1783444571.787174:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901440 00000100:00100000:3.0:1783444571.787218:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5970 00000100:00100000:3.0:1783444571.787226:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2402:x1870073557901440:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:3.0:1783444571.787282:0:26204:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fce00 x1870073557901440/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.787336:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2402:x1870073557901440:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 110us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444571.787343:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5970 00000100:00100000:0.0:1783444571.787346:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901312 00000100:00100000:0.0:1783444571.787350:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901312 00002000:00100000:0.0:1783444571.787374:0:8426:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x386:0x0] (0->1023) req@ffff9368ff5fd180 x1870073557901312/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.787383:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fd180 with x1870073557901312 ext(0->1023) 00002000:00010000:0.0:1783444571.787390:0:8426:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fd180 00000100:00100000:0.0:1783444571.787413:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1032 00000100:00100000:0.0:1783444571.787420:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2402:x1870073557901312:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:0.0:1783444571.787905:0:8426:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fd180 x1870073557901312/t4294969500(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.787940:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2402:x1870073557901312:12345-192.168.204.20@tcp:4:dd.0 Request processed in 520us (855us total) trans 4294969500 rc 0/0 00000100:00100000:0.0:1783444571.787947:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1032 00002000:00100000:0.0:1783444571.787953:0:8426:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x386:0x0] (0->1023) req@ffff9368ff5fd180 x1870073557901312/t4294969500(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.787960:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fd180 with x1870073557901312 ext(0->1023) 00002000:00010000:0.0:1783444571.787964:0:8426:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fd180 00000100:00100000:3.0:1783444571.792120:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.793168:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.793220:0:25139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901568 00000100:00100000:0.0:1783444571.793232:0:25139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901568 00002000:00100000:0.0:1783444571.793293:0:25139:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x387:0x0] (0->1023) req@ffff9368ff5fe680 x1870073557901568/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.793305:0:25139:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fe680 with x1870073557901568 ext(0->1023) 00002000:00010000:0.0:1783444571.793310:0:25139:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fe680 00000100:00100000:0.0:1783444571.793341:0:25139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1033 00000100:00100000:0.0:1783444571.793350:0:25139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2403:x1870073557901568:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:0.0:1783444571.793691:0:25139:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fe680 x1870073557901568/t4294969501(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.793764:0:25139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2403:x1870073557901568:12345-192.168.204.20@tcp:4:dd.0 Request processed in 414us (1654us total) trans 4294969501 rc 0/0 00000100:00100000:0.0:1783444571.793772:0:25139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1033 00002000:00100000:0.0:1783444571.793779:0:25139:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x387:0x0] (0->1023) req@ffff9368ff5fe680 x1870073557901568/t4294969501(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.793802:0:25139:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fe680 with x1870073557901568 ext(0->1023) 00002000:00010000:0.0:1783444571.793807:0:25139:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fe680 00000100:00100000:1.0:1783444571.795832:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901696 00000100:00100000:1.0:1783444571.795846:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901696 00000100:00100000:1.0:1783444571.795910:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5971 00000100:00100000:1.0:1783444571.795927:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2403:x1870073557901696:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:1.0:1783444571.796188:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969501 is committed 00010000:00000080:3.0:1783444571.796373:0:17653:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f57c1880 x1870073557901696/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.796540:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f57c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2403:x1870073557901696:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 513us (3273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444571.796550:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5971 00000100:00100000:3.0:1783444571.801135:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.801183:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444571.801346:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901952 00000100:00100000:1.0:1783444571.801358:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901952 00000100:00100000:3.0:1783444571.801669:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901824 00000100:00100000:3.0:1783444571.801675:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901824 00002000:00100000:3.0:1783444571.801715:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x388:0x0] (0->1023) req@ffff9368f9bc6680 x1870073557901824/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.801726:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368f9bc6680 with x1870073557901824 ext(0->1023) 00002000:00010000:3.0:1783444571.801732:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368f9bc6680 00000100:00100000:3.0:1783444571.801758:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1034 00000100:00100000:3.0:1783444571.801779:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+26:2401:x1870073557901824:12345-192.168.204.20@tcp:4:dd.0 00000100:00100000:1.0:1783444571.802019:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5972 00000100:00100000:1.0:1783444571.802026:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+26:2401:x1870073557901952:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:1.0:1783444571.802057:0:26211:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fca80 x1870073557901952/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444571.802127:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+26:2401:x1870073557901952:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 101us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444571.802134:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5972 00010000:00000080:3.0:1783444571.802219:0:24883:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f9bc6680 x1870073557901824/t4294969502(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.802249:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2401:x1870073557901824:12345-192.168.204.20@tcp:4:dd.0 Request processed in 472us (1067us total) trans 4294969502 rc 0/0 00000100:00100000:3.0:1783444571.802257:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1034 00002000:00100000:3.0:1783444571.802262:0:24883:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x388:0x0] (0->1023) req@ffff9368f9bc6680 x1870073557901824/t4294969502(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.802269:0:24883:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368f9bc6680 with x1870073557901824 ext(0->1023) 00002000:00010000:3.0:1783444571.802273:0:24883:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368f9bc6680 00000100:00100000:1.0:1783444571.810881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.810923:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902208 00000100:00100000:1.0:1783444571.810930:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.810939:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902208 00000100:00100000:1.0:1783444571.810954:0:24882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902080 00000100:00100000:1.0:1783444571.810958:0:24882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902080 00000100:00100000:3.0:1783444571.810987:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5973 00002000:00100000:1.0:1783444571.810989:0:24882:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x389:0x0] (0->1023) req@ffff9368fa112050 x1870073557902080/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.810995:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+28:2401:x1870073557902208:12345-192.168.204.20@tcp:16:kworker.0 00002000:00100000:1.0:1783444571.811000:0:24882:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368fa112050 with x1870073557902080 ext(0->1023) 00002000:00010000:1.0:1783444571.811005:0:24882:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368fa112050 00000100:00100000:1.0:1783444571.811021:0:24882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1035 00000100:00100000:1.0:1783444571.811026:0:24882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368fa112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+28:2401:x1870073557902080:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:3.0:1783444571.811036:0:26199:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd109c00 x1870073557902208/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.811119:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+28:2401:x1870073557902208:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444571.811126:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5973 00010000:00000080:1.0:1783444571.811662:0:24882:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368fa112050 x1870073557902080/t4294969503(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444571.811692:0:24882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368fa112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2401:x1870073557902080:12345-192.168.204.20@tcp:4:dd.0 Request processed in 665us (761us total) trans 4294969503 rc 0/0 00000100:00100000:1.0:1783444571.812842:0:24882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1035 00002000:00100000:1.0:1783444571.812857:0:24882:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x389:0x0] (0->1023) req@ffff9368fa112050 x1870073557902080/t4294969503(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.812867:0:24882:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368fa112050 with x1870073557902080 ext(0->1023) 00002000:00010000:1.0:1783444571.812872:0:24882:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368fa112050 00000100:00100000:3.0:1783444571.822247:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.822281:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444571.822479:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902464 00000100:00100000:2.0:1783444571.822489:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902464 00000100:00100000:2.0:1783444571.822551:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5974 00000100:00100000:2.0:1783444571.822562:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2402:x1870073557902464:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:2.0:1783444571.822623:0:26208:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5ffb80 x1870073557902464/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444571.822707:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2402:x1870073557902464:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 138us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444571.822715:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5974 00000100:00100000:1.0:1783444571.825979:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902336 00000100:00100000:1.0:1783444571.825994:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902336 00002000:00100000:1.0:1783444571.826042:0:8427:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x38a:0x0] (0->1023) req@ffff9368ff5fc000 x1870073557902336/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.826054:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fc000 with x1870073557902336 ext(0->1023) 00002000:00010000:1.0:1783444571.826060:0:8427:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fc000 00000100:00100000:1.0:1783444571.826101:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1036 00000100:00100000:1.0:1783444571.826111:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2402:x1870073557902336:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:1.0:1783444571.826456:0:8427:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fc000 x1870073557902336/t4294969504(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444571.826517:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2402:x1870073557902336:12345-192.168.204.20@tcp:4:dd.0 Request processed in 407us (4281us total) trans 4294969504 rc 0/0 00000100:00100000:1.0:1783444571.826525:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1036 00002000:00100000:1.0:1783444571.826531:0:8427:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x38a:0x0] (0->1023) req@ffff9368ff5fc000 x1870073557902336/t4294969504(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.826539:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fc000 with x1870073557902336 ext(0->1023) 00002000:00010000:1.0:1783444571.826542:0:8427:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fc000 00000100:00100000:3.0:1783444571.829153:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.829185:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902592 00000100:00100000:3.0:1783444571.829192:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902592 00002000:00100000:3.0:1783444571.829234:0:25160:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x38b:0x0] (0->1023) req@ffff9368ff5fd880 x1870073557902592/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.829245:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fd880 with x1870073557902592 ext(0->1023) 00002000:00010000:3.0:1783444571.829250:0:25160:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fd880 00000100:00100000:3.0:1783444571.829273:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1037 00000100:00100000:3.0:1783444571.829282:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2402:x1870073557902592:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:3.0:1783444571.829595:0:25160:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fd880 x1870073557902592/t4294969505(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.829649:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2402:x1870073557902592:12345-192.168.204.20@tcp:4:dd.0 Request processed in 367us (502us total) trans 4294969505 rc 0/0 00000100:00100000:3.0:1783444571.829656:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1037 00002000:00100000:3.0:1783444571.829662:0:25160:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x38b:0x0] (0->1023) req@ffff9368ff5fd880 x1870073557902592/t4294969505(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.829676:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fd880 with x1870073557902592 ext(0->1023) 00002000:00010000:3.0:1783444571.829679:0:25160:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fd880 00000100:00100000:3.0:1783444571.829724:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.829822:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902720 00000100:00100000:3.0:1783444571.829826:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902720 00000100:00100000:3.0:1783444571.829851:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5975 00000100:00100000:3.0:1783444571.829857:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2402:x1870073557902720:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:3.0:1783444571.830043:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969505 is committed 00010000:00000080:3.0:1783444571.830078:0:26207:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5ff100 x1870073557902720/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.830120:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2402:x1870073557902720:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 262us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444571.830126:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5975 00000100:00100000:2.0:1783444571.840181:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.843533:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902976 00000100:00100000:3.0:1783444571.843547:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902976 00000100:00100000:3.0:1783444571.843623:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5976 00000100:00100000:3.0:1783444571.843634:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2401:x1870073557902976:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:3.0:1783444571.843692:0:8421:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd198380 x1870073557902976/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.843769:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2401:x1870073557902976:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 136us (3596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444571.843777:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5976 00000100:00100000:3.0:1783444571.849414:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444571.849588:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902848 00000100:00100000:2.0:1783444571.849598:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902848 00002000:00100000:2.0:1783444571.849662:0:8426:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x38c:0x0] (0->1023) req@ffff9368ff5ff480 x1870073557902848/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783444571.849674:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5ff480 with x1870073557902848 ext(0->1023) 00002000:00010000:2.0:1783444571.849679:0:8426:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5ff480 00000100:00100000:2.0:1783444571.849963:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1038 00000100:00100000:2.0:1783444571.849974:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2402:x1870073557902848:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:2.0:1783444571.850442:0:8426:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5ff480 x1870073557902848/t4294969506(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444571.850514:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2402:x1870073557902848:12345-192.168.204.20@tcp:4:dd.0 Request processed in 541us (1109us total) trans 4294969506 rc 0/0 00000100:00100000:2.0:1783444571.850521:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1038 00002000:00100000:2.0:1783444571.850529:0:8426:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x38c:0x0] (0->1023) req@ffff9368ff5ff480 x1870073557902848/t4294969506(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783444571.850538:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5ff480 with x1870073557902848 ext(0->1023) 00002000:00010000:2.0:1783444571.850542:0:8426:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5ff480 00000100:00100000:3.0:1783444571.854483:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.854569:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903232 00000100:00100000:0.0:1783444571.854590:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903232 00000100:00100000:0.0:1783444571.854654:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5977 00000100:00100000:0.0:1783444571.854664:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2403:x1870073557903232:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:0.0:1783444571.854730:0:26212:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fe300 x1870073557903232/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.854936:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2403:x1870073557903232:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 272us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.854943:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5977 00000100:00100000:3.0:1783444571.857862:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.857955:0:24872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903104 00000100:00100000:0.0:1783444571.857965:0:24872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903104 00002000:00100000:0.0:1783444571.858019:0:24872:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x38d:0x0] (0->1023) req@ffff9368ff5ff800 x1870073557903104/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.858030:0:24872:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5ff800 with x1870073557903104 ext(0->1023) 00002000:00010000:0.0:1783444571.858035:0:24872:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5ff800 00000100:00100000:0.0:1783444571.858074:0:24872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1039 00000100:00100000:0.0:1783444571.858083:0:24872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2404:x1870073557903104:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:0.0:1783444571.858453:0:24872:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5ff800 x1870073557903104/t4294969507(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.858509:0:24872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2404:x1870073557903104:12345-192.168.204.20@tcp:4:dd.0 Request processed in 427us (655us total) trans 4294969507 rc 0/0 00000100:00100000:0.0:1783444571.858517:0:24872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1039 00002000:00100000:0.0:1783444571.858522:0:24872:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x38d:0x0] (0->1023) req@ffff9368ff5ff800 x1870073557903104/t4294969507(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.858529:0:24872:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5ff800 with x1870073557903104 ext(0->1023) 00002000:00010000:0.0:1783444571.858533:0:24872:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5ff800 00000100:00100000:3.0:1783444571.863192:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.863232:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.863262:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903488 00000100:00100000:3.0:1783444571.863272:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903488 00000100:00100000:3.0:1783444571.863318:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5978 00000100:00100000:3.0:1783444571.863328:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2404:x1870073557903488:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:3.0:1783444571.863384:0:8420:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fc380 x1870073557903488/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.863448:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2404:x1870073557903488:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444571.863456:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5978 00000100:00100000:0.0:1783444571.863597:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903360 00000100:00100000:0.0:1783444571.863603:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903360 00002000:00100000:0.0:1783444571.863627:0:8425:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x38e:0x0] (0->1023) req@ffff9368ff5fc700 x1870073557903360/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.863650:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fc700 with x1870073557903360 ext(0->1023) 00002000:00010000:0.0:1783444571.863655:0:8425:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fc700 00000100:00100000:0.0:1783444571.863679:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1040 00000100:00100000:0.0:1783444571.863686:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2403:x1870073557903360:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:0.0:1783444571.864045:0:8425:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fc700 x1870073557903360/t4294969508(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.864075:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2403:x1870073557903360:12345-192.168.204.20@tcp:4:dd.0 Request processed in 389us (842us total) trans 4294969508 rc 0/0 00000100:00100000:0.0:1783444571.864081:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1040 00002000:00100000:0.0:1783444571.864099:0:8425:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x38e:0x0] (0->1023) req@ffff9368ff5fc700 x1870073557903360/t4294969508(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.864106:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fc700 with x1870073557903360 ext(0->1023) 00002000:00010000:0.0:1783444571.864110:0:8425:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fc700 00000100:00100000:3.0:1783444571.878134:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.878225:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.878365:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903744 00000100:00100000:0.0:1783444571.878374:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903744 00000100:00100000:0.0:1783444571.878432:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5979 00000100:00100000:0.0:1783444571.878518:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2403:x1870073557903744:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:0.0:1783444571.878576:0:26200:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fdc00 x1870073557903744/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.878652:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2403:x1870073557903744:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 140us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.878660:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5979 00000100:00100000:2.0:1783444571.879198:0:24882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903616 00000100:00100000:2.0:1783444571.879204:0:24882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903616 00002000:00100000:3.0:1783444571.879684:0:24882:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x38f:0x0] (0->1023) req@ffff9368ff5fdf80 x1870073557903616/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.879770:0:24882:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fdf80 with x1870073557903616 ext(0->1023) 00002000:00010000:3.0:1783444571.879778:0:24882:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fdf80 00000100:00100000:3.0:1783444571.879896:0:24882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1041 00000100:00100000:3.0:1783444571.879905:0:24882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2403:x1870073557903616:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:3.0:1783444571.880408:0:24882:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fdf80 x1870073557903616/t4294969509(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.880462:0:24882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2403:x1870073557903616:12345-192.168.204.20@tcp:4:dd.0 Request processed in 558us (2336us total) trans 4294969509 rc 0/0 00000100:00100000:3.0:1783444571.880468:0:24882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1041 00002000:00100000:3.0:1783444571.880495:0:24882:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x38f:0x0] (0->1023) req@ffff9368ff5fdf80 x1870073557903616/t4294969509(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.880503:0:24882:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fdf80 with x1870073557903616 ext(0->1023) 00002000:00010000:3.0:1783444571.880507:0:24882:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fdf80 00000100:00100000:0.0:1783444571.904364:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.904417:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.904645:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904000 00000100:00100000:0.0:1783444571.904656:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904000 00000100:00100000:0.0:1783444571.904708:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5980 00000100:00100000:0.0:1783444571.904718:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2404:x1870073557904000:12345-192.168.204.20@tcp:16:kworker.0 00010000:00000080:0.0:1783444571.904773:0:26201:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f9bc7480 x1870073557904000/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.904841:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2404:x1870073557904000:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 124us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.904849:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5980 00000100:00100000:1.0:1783444571.905636:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903872 00000100:00100000:1.0:1783444571.905649:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903872 00002000:00100000:1.0:1783444571.905680:0:8427:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x390:0x0] (0->1023) req@ffff9368f9bc5180 x1870073557903872/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.905690:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368f9bc5180 with x1870073557903872 ext(0->1023) 00002000:00010000:1.0:1783444571.905708:0:8427:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368f9bc5180 00000100:00100000:1.0:1783444571.905742:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1042 00000100:00100000:1.0:1783444571.905750:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2404:x1870073557903872:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:1.0:1783444571.906120:0:8427:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f9bc5180 x1870073557903872/t4294969510(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444571.906163:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+35:2404:x1870073557903872:12345-192.168.204.20@tcp:4:dd.0 Request processed in 415us (1746us total) trans 4294969510 rc 0/0 00000100:00100000:1.0:1783444571.906171:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1042 00002000:00100000:1.0:1783444571.906177:0:8427:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x390:0x0] (0->1023) req@ffff9368f9bc5180 x1870073557903872/t4294969510(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.906186:0:8427:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368f9bc5180 with x1870073557903872 ext(0->1023) 00002000:00010000:1.0:1783444571.906189:0:8427:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368f9bc5180 00000100:00100000:3.0:1783444571.916719:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444571.917157:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904128 00000100:00100000:2.0:1783444571.917167:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904128 00002000:00100000:2.0:1783444571.917219:0:25160:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x391:0x0] (0->1023) req@ffff9368ff5fea00 x1870073557904128/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783444571.917230:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fea00 with x1870073557904128 ext(0->1023) 00002000:00010000:2.0:1783444571.917249:0:25160:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fea00 00000100:00100000:2.0:1783444571.917314:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1043 00000100:00100000:2.0:1783444571.917324:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+35:2403:x1870073557904128:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:2.0:1783444571.917681:0:25160:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fea00 x1870073557904128/t4294969511(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444571.918504:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+37:2403:x1870073557904128:12345-192.168.204.20@tcp:4:dd.0 Request processed in 1177us (1786us total) trans 4294969511 rc 0/0 00000100:00100000:2.0:1783444571.918514:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1043 00002000:00100000:2.0:1783444571.918525:0:25160:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x391:0x0] (0->1023) req@ffff9368ff5fea00 x1870073557904128/t4294969511(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783444571.918547:0:25160:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fea00 with x1870073557904128 ext(0->1023) 00002000:00010000:2.0:1783444571.918552:0:25160:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fea00 00000100:00100000:0.0:1783444571.919719:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444571.923713:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904256 00000100:00100000:1.0:1783444571.923730:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904256 00000100:00100000:1.0:1783444571.923784:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5981 00000100:00100000:1.0:1783444571.923807:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+37:2403:x1870073557904256:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:1.0:1783444571.924531:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969511 is committed 00010000:00000080:0.0:1783444571.926881:0:17653:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368f9bd9850 x1870073557904256/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.926957:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2403:x1870073557904256:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 3151us (7243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.926968:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5981 00000100:00100000:3.0:1783444571.936006:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.936058:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.936109:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904384 00000100:00100000:3.0:1783444571.936119:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904384 00002000:00100000:3.0:1783444571.936167:0:8426:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x392:0x0] (0->1023) req@ffff9368ff5fed80 x1870073557904384/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.936178:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fed80 with x1870073557904384 ext(0->1023) 00002000:00010000:3.0:1783444571.936185:0:8426:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fed80 00000100:00100000:3.0:1783444571.936214:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1044 00000100:00100000:3.0:1783444571.936223:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2404:x1870073557904384:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:3.0:1783444571.936713:0:8426:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fed80 x1870073557904384/t4294969512(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.936773:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2404:x1870073557904384:12345-192.168.204.20@tcp:4:dd.0 Request processed in 551us (777us total) trans 4294969512 rc 0/0 00000100:00100000:3.0:1783444571.936782:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1044 00002000:00100000:3.0:1783444571.936808:0:8426:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x392:0x0] (0->1023) req@ffff9368ff5fed80 x1870073557904384/t4294969512(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.936817:0:8426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fed80 with x1870073557904384 ext(0->1023) 00002000:00010000:3.0:1783444571.936821:0:8426:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fed80 00000100:00100000:1.0:1783444571.938878:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904512 00000100:00100000:1.0:1783444571.938892:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904512 00000100:00100000:1.0:1783444571.938944:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5982 00000100:00100000:1.0:1783444571.938953:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2404:x1870073557904512:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:1.0:1783444571.939229:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969512 is committed 00010000:00000080:1.0:1783444571.939269:0:26210:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fd500 x1870073557904512/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444571.939328:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2404:x1870073557904512:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 375us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444571.939336:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5982 00000100:00100000:1.0:1783444571.944330:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444571.944362:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444571.944389:0:24872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904640 00000100:00100000:1.0:1783444571.944397:0:24872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904640 00002000:00100000:1.0:1783444571.944457:0:24872:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x393:0x0] (0->1023) req@ffff9368dd109880 x1870073557904640/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.944468:0:24872:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd109880 with x1870073557904640 ext(0->1023) 00002000:00010000:1.0:1783444571.944473:0:24872:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd109880 00000100:00100000:1.0:1783444571.944501:0:24872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1045 00000100:00100000:1.0:1783444571.944511:0:24872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2401:x1870073557904640:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:1.0:1783444571.944934:0:24872:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd109880 x1870073557904640/t4294969513(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444571.944986:0:24872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2401:x1870073557904640:12345-192.168.204.20@tcp:4:dd.0 Request processed in 476us (665us total) trans 4294969513 rc 0/0 00000100:00100000:1.0:1783444571.944994:0:24872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1045 00002000:00100000:1.0:1783444571.945001:0:24872:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x393:0x0] (0->1023) req@ffff9368dd109880 x1870073557904640/t4294969513(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783444571.945009:0:24872:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368dd109880 with x1870073557904640 ext(0->1023) 00002000:00010000:1.0:1783444571.945019:0:24872:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368dd109880 00000100:00100000:3.0:1783444571.946837:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904768 00000100:00100000:3.0:1783444571.946850:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904768 00000100:00100000:3.0:1783444571.946901:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5983 00000100:00100000:3.0:1783444571.946910:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2401:x1870073557904768:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:1.0:1783444571.947413:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969513 is committed 00010000:00000080:3.0:1783444571.947567:0:26205:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368dd10a300 x1870073557904768/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.947695:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2401:x1870073557904768:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 785us (3331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444571.947703:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5983 00000100:00100000:3.0:1783444571.957246:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444571.957690:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904896 00000100:00100000:0.0:1783444571.957701:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904896 00002000:00100000:0.0:1783444571.957750:0:8425:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x394:0x0] (0->1023) req@ffff9368ff5fd180 x1870073557904896/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.957762:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fd180 with x1870073557904896 ext(0->1023) 00002000:00010000:0.0:1783444571.957768:0:8425:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fd180 00000100:00100000:0.0:1783444571.957822:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1046 00000100:00100000:0.0:1783444571.957831:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2402:x1870073557904896:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:0.0:1783444571.958245:0:8425:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fd180 x1870073557904896/t4294969514(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.958313:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2402:x1870073557904896:12345-192.168.204.20@tcp:4:dd.0 Request processed in 482us (1077us total) trans 4294969514 rc 0/0 00000100:00100000:0.0:1783444571.958321:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1046 00002000:00100000:0.0:1783444571.958328:0:8425:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x394:0x0] (0->1023) req@ffff9368ff5fd180 x1870073557904896/t4294969514(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783444571.958336:0:8425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fd180 with x1870073557904896 ext(0->1023) 00002000:00010000:0.0:1783444571.958340:0:8425:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fd180 00000100:00100000:3.0:1783444571.962081:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444571.962332:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905024 00000100:00100000:2.0:1783444571.962342:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905024 00000100:00100000:2.0:1783444571.962441:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5984 00000100:00100000:2.0:1783444571.962454:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2402:x1870073557905024:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:3.0:1783444571.966703:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969514 is committed 00010000:00000080:3.0:1783444571.966771:0:26208:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fe680 x1870073557905024/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.966858:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2402:x1870073557905024:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 4406us (4786us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444571.966869:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5984 00000100:00100000:3.0:1783444571.978698:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.978735:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444571.978761:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905152 00000100:00100000:3.0:1783444571.978770:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905152 00002000:00100000:3.0:1783444571.978830:0:24881:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x395:0x0] (0->1023) req@ffff9368ff5fce00 x1870073557905152/t0(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/0 e 0 to 0 dl 1783444582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.978843:0:24881:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fce00 with x1870073557905152 ext(0->1023) 00002000:00010000:3.0:1783444571.978848:0:24881:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fce00 00000100:00100000:3.0:1783444571.978871:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1047 00000100:00100000:3.0:1783444571.978892:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2404:x1870073557905152:12345-192.168.204.20@tcp:4:dd.0 00010000:00000080:3.0:1783444571.979233:0:24881:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fce00 x1870073557905152/t4294969515(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444571.979288:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2404:x1870073557905152:12345-192.168.204.20@tcp:4:dd.0 Request processed in 396us (598us total) trans 4294969515 rc 0/0 00000100:00100000:3.0:1783444571.979297:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1047 00002000:00100000:3.0:1783444571.979303:0:24881:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x395:0x0] (0->1023) req@ffff9368ff5fce00 x1870073557905152/t4294969515(0) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 1512/448 e 0 to 0 dl 1783444582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783444571.979310:0:24881:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9368ff5fce00 with x1870073557905152 ext(0->1023) 00002000:00010000:3.0:1783444571.979314:0:24881:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9368ff5fce00 00000100:00100000:0.0:1783444571.980653:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905280 00000100:00100000:0.0:1783444571.980664:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905280 00000100:00100000:0.0:1783444571.980716:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5985 00000100:00100000:0.0:1783444571.980725:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2404:x1870073557905280:12345-192.168.204.20@tcp:16:kworker.0 00000001:00080000:2.0:1783444571.981128:0:8415:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969515 is committed 00010000:00000080:0.0:1783444571.981263:0:26202:0:(ldlm_lib.c:3289:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9368ff5fca80 x1870073557905280/t0(0) o16->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:192/0 lens 440/432 e 0 to 0 dl 1783444582 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444571.981316:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2404:x1870073557905280:12345-192.168.204.20@tcp:16:kworker.0 Request processed in 592us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444571.981323:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5985 00010000:00010000:1.0:1783444572.253073:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783444572.526637:0:95990:0:(tgt_mount.c:2063:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1783444572.526687:0:95990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.526702:0:95990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.526710:0:95990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.526718:0:95990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.526734:0:95990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783444572.526739:0:95990:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1783444572.526764:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783444572.526769:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.526923:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c27c00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:3.0:1783444572.526928:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.527066:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783444572.527082:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783444572.527089:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783444572.527091:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783444572.527094:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783444572.527128:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.527133:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783444572.527186:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575456512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783444572.527201:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444572.527258:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444572.527308:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575456512 00000100:00100000:1.0:1783444572.527315:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575456512 00000100:00100000:1.0:1783444572.527364:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1783444572.527372:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575456512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444572.527383:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783444572.527397:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583f800/0x42cb6883e3833b3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833b34 expref: 24 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444572.527411:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783444572.527443:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3634:x1870073575456512:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444572.527449:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00010000:00010000:3.0:1783444572.527555:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c27c00/0x42cb6883e3833b34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833b3b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.527566:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444572.527568:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444572.527570:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783444572.527585:0:95990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783444572.527589:0:95990:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783444572.527594:0:95990:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783444572.527607:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575456512:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783444572.527614:0:95990:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783444572.527652:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575456640:0@lo:39:umount.0 00000100:00100000:1.0:1783444572.527680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444572.528016:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575456640 00000100:00100000:0.0:1783444572.528021:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575456640 00000100:00080000:3.0:1783444572.528052:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444572.528104:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:0.0:1783444572.528114:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1870073575456640:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783444572.528147:0:67017:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3833760 00000100:00080000:0.0:1783444572.528163:0:67017:0:(import.c:65:import_set_state_nolock()) ffff9368ff649000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783444572.530024:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3632:x1870073575456640:12345-0@lo:39:umount.0 Request processed in 1907us (2336us total) trans 0 rc 0/0 00000100:00080000:1.0:1783444572.530093:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783444572.530114:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000020:00000080:0.0:1783444572.530129:0:67017:0:(genops.c:906:class_export_put()) final put ffff9368ff64d800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:1.0:1783444572.530148:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575456640:0@lo:39:umount.0 00010000:00010000:0.0:1783444572.530176:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783444572.530199:0:95990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:0.0:1783444572.530212:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff64d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783444572.530264:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368ff649000 for lustre-MDT0000 00000100:00100000:3.0:1783444572.530291:0:95990:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783444572.530297:0:95990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783444572.532717:0:95990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783444572.532724:0:95990:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783444572.532730:0:95990:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783444572.532756:0:95990:0:(import.c:65:import_set_state_nolock()) ffff9368eb787000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783444572.532825:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1870073575456768:0@lo:39:umount.0 00000100:00100000:1.0:1783444572.532889:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444572.533265:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575456768 00000100:00100000:0.0:1783444572.533274:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575456768 00000100:00080000:3.0:1783444572.533354:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444572.533806:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1783444572.533818:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1870073575456768:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783444572.533846:0:66223:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e382cfd3 00000100:00080000:0.0:1783444572.533854:0:66223:0:(import.c:65:import_set_state_nolock()) ffff9368f8ca2000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783444572.533933:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+1:3632:x1870073575456768:12345-0@lo:39:umount.0 Request processed in 119us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444572.533940:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000020:00000080:0.0:1783444572.533950:0:66223:0:(genops.c:906:class_export_put()) final put ffff9368f8ca1800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1783444572.533973:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f8ca1800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1783444572.534006:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368f8ca2000 for lustre-MDT0001 00010000:00010000:1.0:1783444572.534030:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783444572.534042:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb787000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783444572.534708:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff5fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1870073575456768:0@lo:39:umount.0 00000100:00080000:3.0:1783444572.534756:0:95990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783444572.534761:0:95990:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783444572.534765:0:95990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783444572.537585:0:95990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.537605:0:95990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.537612:0:95990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.537618:0:95990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.537639:0:95990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783444572.537646:0:95990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.537653:0:95990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.537672:0:95990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.537678:0:95990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.538170:0:95990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783444572.538177:0:95990:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1783444572.538224:0:95990:0:(tgt_mount.c:2113:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1783444572.538229:0:95990:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:3.0:1783444572.538234:0:95990:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1783444572.538240:0:95990:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:0.0:1783444572.540480:0:6494:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783444572.540493:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444572.541356:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644200 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:0.0:1783444572.541362:0:6494:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444572.541373:0:6494:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783444572.541380:0:6494:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444572.541386:0:6494:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783444572.541389:0:6494:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1783444572.541392:0:6494:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1783444572.541438:0:6494:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444572.541444:0:6494:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783444572.541493:0:6493:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783444572.541501:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444572.541509:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf90c00 already unused, calling callback (ffffffffc122fc20) 00000100:00100000:2.0:1783444572.541519:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575456896:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1783444572.541520:0:6493:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444572.541535:0:6493:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783444572.541541:0:6493:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444572.541546:0:6493:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783444572.541548:0:6493:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783444572.541550:0:6493:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783444572.541568:0:6493:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444572.541575:0:6493:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783444572.541609:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783444572.541719:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444572.541727:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c7644200/0x42cb6883e3833b42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833b49 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444572.541743:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444572.541745:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444572.541747:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444572.541874:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575457024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783444572.541903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444572.541945:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575456896 00000100:00100000:0.0:1783444572.541958:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575456896 00000100:00100000:0.0:1783444572.542000:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575457024 00000100:00100000:0.0:1783444572.542003:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575457024 00000100:00100000:0.0:1783444572.542040:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1783444572.542049:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575456896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444572.542177:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444572.542194:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367c583e600/0x42cb6883e3833b49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e3833b42 expref: 24 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444572.542208:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00000080:3.0:1783444572.542648:0:95990:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:3.0:1783444572.542682:0:95990:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:3.0:1783444572.543894:0:95990:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1783444572.543905:0:95990:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9368ff57a000 08efc25c-17e5-4d29-97d2-f1505f195a06 192.168.204.20@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969515 stale:0 00000020:00080000:3.0:1783444572.543912:0:95990:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9367cae8e000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969471 stale:0 00000020:00080000:3.0:1783444572.543917:0:95990:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9368c6bcf000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969442 stale:0 00000020:00080000:3.0:1783444572.543921:0:95990:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff9368e71219c0) has exports, disconnecting them 00000020:00080000:3.0:1783444572.543926:0:95990:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.204.20@tcp (ffff9368ff57a000), last request at 1783444571 00000020:00000080:3.0:1783444572.543932:0:95990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3833974 00000020:00010000:3.0:1783444572.543940:0:95990:0:(genops.c:1944:obd_stale_export_put()) Put export ffff9368ff57a000: total 0 00000100:00080000:3.0:1783444572.543945:0:95990:0:(import.c:65:import_set_state_nolock()) ffff9367c17cf800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783444572.543964:0:95990:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.204.20@tcp (ffff9368ff57a000): rc 0 00000020:00080000:3.0:1783444572.543968:0:95990:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9367cae8e000), last request at 1783444568 00000020:00000080:3.0:1783444572.543971:0:95990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e3833617 00000100:00080000:3.0:1783444572.543975:0:95990:0:(import.c:65:import_set_state_nolock()) ffff9367cae88000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783444572.543999:0:95990:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367cae8e000): rc 0 00000020:00000080:3.0:1783444572.544002:0:95990:0:(genops.c:906:class_export_put()) final put ffff9367cae8e000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1783444572.544011:0:95990:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9368c6bcf000), last request at 1783444568 00000020:00000080:3.0:1783444572.544015:0:95990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e382cf47 00000100:00080000:3.0:1783444572.544020:0:95990:0:(import.c:65:import_set_state_nolock()) ffff9368c6bcb800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783444572.544388:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9367cae8e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783444572.544427:0:92306:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367cae88000 for lustre-OST0000 00000020:00080000:3.0:1783444572.544441:0:95990:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9368c6bcf000): rc 0 00000020:00000080:3.0:1783444572.544444:0:95990:0:(genops.c:906:class_export_put()) final put ffff9368c6bcf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783444572.544458:0:92306:0:(genops.c:865:class_export_destroy()) destroying export ffff9368c6bcf000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783444572.544474:0:92306:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368c6bcb800 for lustre-OST0000 00000020:00080000:3.0:1783444572.544512:0:95990:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9368e71219c0) has no exports 00010000:00010000:3.0:1783444572.544565:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38340f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a006 expref: 21 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544593:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f088b43a/0x42cb6883e38340f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a006 expref: 21 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544629:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000001bfce64d/0x42cb6883e38341f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a05a expref: 20 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544641:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bfce64d/0x42cb6883e38341f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a05a expref: 20 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544671:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000de2ebbf0/0x42cb6883e38341fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a06f expref: 19 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544699:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de2ebbf0/0x42cb6883e38341fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a06f expref: 19 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544731:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000025b862d4/0x42cb6883e38342ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ae expref: 18 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544743:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025b862d4/0x42cb6883e38342ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ae expref: 18 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544773:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000e5bed62b/0x42cb6883e383435a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0d1 expref: 17 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544785:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5bed62b/0x42cb6883e383435a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0d1 expref: 17 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544838:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000002bb4783e/0x42cb6883e38343ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ed expref: 16 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544850:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bb4783e/0x42cb6883e38343ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0ed expref: 16 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544878:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000e467d6bb/0x42cb6883e3834123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a014 expref: 15 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544905:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e467d6bb/0x42cb6883e3834123 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a014 expref: 15 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544934:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000054f4509f/0x42cb6883e38341e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a053 expref: 14 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544947:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054f4509f/0x42cb6883e38341e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a053 expref: 14 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544977:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3834273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a084 expref: 13 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.544989:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df8eb8f0/0x42cb6883e3834273 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a084 expref: 13 pid: 17653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545017:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e383427a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a099 expref: 12 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545028:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83264e8/0x42cb6883e383427a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a099 expref: 12 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545441:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3834368 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0d8 expref: 11 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545467:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a7446da/0x42cb6883e3834368 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a0d8 expref: 11 pid: 8824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545494:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e38343e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a102 expref: 10 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545504:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490bea8e/0x42cb6883e38343e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a102 expref: 10 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545530:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000004bdfad08/0x42cb6883e3834425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a125 expref: 9 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545539:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bdfad08/0x42cb6883e3834425 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a125 expref: 9 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545565:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e38344a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a13a expref: 8 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545572:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2d31b97/0x42cb6883e38344a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a13a expref: 8 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545597:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000001a1491bd/0x42cb6883e38344aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a14f expref: 7 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545618:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a1491bd/0x42cb6883e38344aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a14f expref: 7 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545647:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000a0cf449d/0x42cb6883e38341a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a03e expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545657:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0cf449d/0x42cb6883e38341a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a03e expref: 6 pid: 8422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545685:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e38344b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a156 expref: 5 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545695:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084611bc6/0x42cb6883e38344b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a156 expref: 5 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545722:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000001dcb511c/0x42cb6883e383452f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a16b expref: 4 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545733:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dcb511c/0x42cb6883e383452f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a16b expref: 4 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545762:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e383454b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a180 expref: 3 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545813:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6ff54e/0x42cb6883e383454b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a180 expref: 3 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545845:0:95990:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3834544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a179 expref: 2 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444572.545856:0:95990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179a3220/0x42cb6883e3834544 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a179 expref: 2 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444572.546028:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444572.546039:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367caf90c00/0x42cb6883e383371a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x42cb6883e3833721 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1783444572.546054:0:6493:0:(genops.c:1930:obd_stale_export_get()) Get export ffff9368ff57a000: total 0 00010000:00010000:1.0:1783444572.546127:0:6493:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9368ff57a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1783444572.546145:0:6493:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9368ff57a000, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1783444572.546157:0:6493:0:(genops.c:906:class_export_put()) final put ffff9368ff57a000/08efc25c-17e5-4d29-97d2-f1505f195a06 00010000:00010000:1.0:1783444572.546171:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444572.546171:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:3635:x1870073575456896:12345-0@lo:103:ldlm_bl.0 Request processed in 4119us (4558us total) trans 0 rc 0/0 00010000:00010000:1.0:1783444572.546175:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444572.546178:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444572.546190:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444572.546198:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000020:00000080:1.0:1783444572.546200:0:67553:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ff57a000/08efc25c-17e5-4d29-97d2-f1505f195a06 for lustre-OST0000 00000100:00100000:0.0:1783444572.546228:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1783444572.546239:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:3636:x1870073575457024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444572.546257:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783444572.546269:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c0030600/0x42cb6883e3833721 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42cb6883e383371a expref: 22 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444572.546282:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783444572.546343:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3636:x1870073575457024:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (4438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444572.546350:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00010000:00010000:0.0:1783444572.546370:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444572.546399:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575457024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444572.546422:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783444572.546492:0:67553:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c17cf800 for lustre-OST0000 00000100:00100000:2.0:1783444572.546628:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575456896:0@lo:103:ldlm_bl.0 00000020:01000000:3.0:1783444572.547681:0:95990:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c2df34e0 - data ffff9368f6314438/ffff9367c22f8000 00000020:01000000:3.0:1783444572.548005:0:95990:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9367c1d49180 - data ffff9368f615ed80/ffff9367c17ae400 00100000:10000000:3.0:1783444572.564016:0:95990:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783444572.575904:0:95990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e37e6132 00000020:00000080:1.0:1783444572.575917:0:95990:0:(genops.c:906:class_export_put()) final put ffff9368ef0ce000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783444572.575935:0:67553:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef0ce000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1783444572.575952:0:95990:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9368ef29c800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783444572.575956:0:95990:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ef29c800 2 00000020:01000004:1.0:1783444572.575959:0:95990:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9368ef29c800 from lustre-OST0000 00000020:00000080:1.0:1783444572.575989:0:95990:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444572.576007:0:95990:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783444572.576010:0:95990:0:(genops.c:906:class_export_put()) final put ffff9368ef336000/lustre-OST0000_UUID 00000020:00000080:1.0:1783444572.576013:0:95990:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef336000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783444572.576019:0:95990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783444572.576090:0:95990:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1783444572.576095:0:95990:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783444572.576099:0:95990:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783444572.576105:0:95990:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783444572.576112:0:95990:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9367c17cc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783444572.576118:0:95990:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9367c1e819c0) has exports, disconnecting them 00000020:00080000:1.0:1783444572.576122:0:95990:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9367c17cc000), last request at 1783441256 00000020:00000080:1.0:1783444572.576126:0:95990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e37e615c 00000020:00080000:1.0:1783444572.576137:0:95990:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367c17cc000): rc 0 00000020:00000080:1.0:1783444572.576143:0:95990:0:(genops.c:906:class_export_put()) final put ffff9367c17cc000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783444572.576162:0:67553:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17cc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783444572.579898:0:95990:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783444572.579907:0:95990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783444572.579926:0:95990:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783444572.579933:0:95990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783444572.579962:0:15368:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9367c17ce000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783444572.580252:0:95990:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783444572.580266:0:95990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783444572.580272:0:95990:0:(genops.c:906:class_export_put()) final put ffff9367c17ce800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783444572.580276:0:95990:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17ce800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1783444572.580286:0:95990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783444572.580971:0:95990:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783444572.580976:0:95990:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783444572.580984:0:95990:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783444572.580991:0:95990:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9367c17cd800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783444572.580997:0:95990:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9367c1e84d40) has exports, disconnecting them 00000020:00080000:0.0:1783444572.581002:0:95990:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9367c17cd800), last request at 1783441256 00000020:00000080:0.0:1783444572.581781:0:95990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e37e6171 00000020:00080000:0.0:1783444572.581878:0:95990:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9367c17cd800): rc 0 00000020:00000080:0.0:1783444572.581885:0:95990:0:(genops.c:906:class_export_put()) final put ffff9367c17cd800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1783444572.581919:0:15368:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17cd800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1783444572.592867:0:95990:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783444572.592876:0:95990:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783444572.592881:0:95990:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783444572.592889:0:95990:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783444572.592919:0:93850:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9368eb787000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1783444572.594129:0:95990:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783444572.594145:0:95990:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1783444572.594151:0:95990:0:(genops.c:906:class_export_put()) final put ffff9367c17c8000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1783444572.594155:0:95990:0:(genops.c:865:class_export_destroy()) destroying export ffff9367c17c8000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1783444572.594171:0:95990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1783444572.594270:0:95990:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9368ef29c800 1 00000020:00000080:2.0:1783444572.594277:0:95990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x42cb6883e37e60fa 00000020:00000080:2.0:1783444572.594284:0:95990:0:(genops.c:906:class_export_put()) final put ffff9368f9916000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783444572.594294:0:95990:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783444572.594304:0:93850:0:(genops.c:865:class_export_destroy()) destroying export ffff9368f9916000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783444572.594315:0:95990:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783444572.594330:0:95990:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783444572.594334:0:95990:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff936901dc99c0) has no exports 00000020:00000080:1.0:1783444572.642128:0:95990:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783444572.642148:0:95990:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1783444572.642153:0:95990:0:(genops.c:906:class_export_put()) final put ffff9368ef29e800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783444572.642158:0:95990:0:(genops.c:865:class_export_destroy()) destroying export ffff9368ef29e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1783444572.642174:0:95990:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1783444572.642390:0:95990:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9368ef29d000 00000020:02000400:1.0:1783444572.642461:0:95990:0:(tgt_mount.c:2182:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:1.0:1783444572.957006:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575457152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444572.957103:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444572.957165:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575457152 00000100:00100000:1.0:1783444572.957174:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575457152 00000100:00100000:1.0:1783444572.957232:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:1.0:1783444572.957240:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575457152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444572.957267:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783444572.957309:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575457152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444572.957316:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00080000:1.0:1783444572.957339:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444572.957372:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575457152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444572.961278:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff5fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575457280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783444572.961349:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444572.961443:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575457280 00000100:00100000:3.0:1783444572.961450:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575457280 00000100:00100000:3.0:1783444572.961496:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:3.0:1783444572.961504:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3634:x1870073575457280:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1783444572.961511:0:8423:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783444572.961553:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3634:x1870073575457280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (203us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444572.961573:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:02020000:1.0:1783444572.961745:0:3634:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1783444572.961751:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783444572.961756:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783444572.961760:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1783444572.961776:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1783444572.961779:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783444572.961783:0:3634:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2739 00000100:00080000:1.0:1783444572.961812:0:3634:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9367c17bb000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1783444572.961835:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368dd108700 x1870073575457408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444572.964045:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575457536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444572.964122:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444572.964202:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575457536 00000100:00100000:3.0:1783444572.964209:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575457536 00000100:00100000:3.0:1783444572.964266:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:3.0:1783444572.964275:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575457536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444572.964327:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:0.0:1783444572.966100:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575457408:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:0.0:1783444572.966163:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444572.966397:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575457408 00000100:00100000:1.0:1783444572.966416:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575457408 00000100:00100000:1.0:1783444572.966455:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5986 00000100:00100000:1.0:1783444572.966462:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3632:x1870073575457408:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1783444572.966485:0:8421:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444572.966531:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3632:x1870073575457408:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 69us (367us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444572.966538:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5986 00000100:00080000:1.0:1783444572.966594:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444572.966599:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783444572.966603:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575457408:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:3.0:1783444572.967359:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575457536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3082us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444572.967370:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:2.0:1783444572.967827:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575457536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444573.261546:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444573.261588:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444573.261615:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444573.261634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444573.261655:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444573.261682:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905664 00000100:00100000:0.0:1783444573.261692:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905664 00000100:00100000:0.0:1783444573.261753:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905536 00000100:00100000:0.0:1783444573.261770:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905536 00000100:00100000:0.0:1783444573.261824:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1212 00000100:00100000:0.0:1783444573.261835:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557905664:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444573.261991:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557905664:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 156us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444573.262000:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1212 00000100:00100000:0.0:1783444573.262019:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1213 00000100:00100000:0.0:1783444573.262026:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+151:2403:x1870073557905536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444573.262070:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+151:2403:x1870073557905536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444573.262077:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1213 00000100:00100000:0.0:1783444573.262101:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905920 00000100:00100000:0.0:1783444573.262106:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905920 00000100:00100000:0.0:1783444573.262129:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905792 00000100:00100000:0.0:1783444573.262132:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905792 00000100:00100000:0.0:1783444573.262146:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2581 00000100:00100000:0.0:1783444573.262152:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557905920:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444573.262178:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557905920:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444573.262185:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2581 00000100:00100000:0.0:1783444573.262198:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5987 00000100:00100000:0.0:1783444573.262202:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2403:x1870073557905792:12345-192.168.204.20@tcp:400:kworker.0 00000020:00080000:0.0:1783444573.262208:0:26206:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.204.20@tcp 00000100:00100000:0.0:1783444573.262231:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2403:x1870073557905792:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (575us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783444573.262249:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5987 00000100:00080000:0.0:1783444573.262264:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783444573.262268:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444573.262269:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444573.262980:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905408 00000100:00100000:3.0:1783444573.262987:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905408 00000100:00100000:3.0:1783444573.263027:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:3.0:1783444573.263035:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557905408:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444573.263087:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557905408:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 52us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444573.263095:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:1.0:1783444573.269465:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444573.270738:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557906048 00000100:00100000:2.0:1783444573.270751:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557906048 00000100:00100000:2.0:1783444573.270825:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5988 00000100:00100000:2.0:1783444573.270834:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2400:x1870073557906048:12345-192.168.204.20@tcp:8:ptlrpcd_01_00.0 00010000:00020000:2.0:1783444573.270858:0:26200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783444573.270924:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2400:x1870073557906048:12345-192.168.204.20@tcp:8:ptlrpcd_01_00.0 Request processed in 90us (1466us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783444573.270932:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5988 00010000:00010000:1.0:1783444573.279035:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783444573.478086:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575458048:0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.478166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444573.478205:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575458560:0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.478233:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444573.478257:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783444573.478264:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575457664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444573.478295:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444573.478315:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575458176:0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.478333:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444573.478354:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575458688:0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.478376:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444573.478415:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575457664 00000100:00100000:3.0:1783444573.478423:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575457664 00000100:00100000:3.0:1783444573.478467:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575458176 00000100:00100000:3.0:1783444573.478482:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575458176 00000100:00100000:3.0:1783444573.478508:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1783444573.478516:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3635:x1870073575457664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444573.479160:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00100000:3.0:1783444573.479215:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3635:x1870073575457664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 700us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444573.479223:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1783444573.479243:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:3.0:1783444573.479250:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575458176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.479279:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575458176:12345-0@lo:400:kworker.0 Request processed in 30us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444573.479286:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:3.0:1783444573.479306:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575458560 00000100:00100000:3.0:1783444573.479310:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575458560 00000100:00100000:3.0:1783444573.479332:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575458688 00000100:00100000:3.0:1783444573.479334:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575458688 00000100:00100000:3.0:1783444573.479365:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1783444573.479371:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575458688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.479401:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575458688:12345-0@lo:400:kworker.0 Request processed in 30us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444573.479407:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1783444573.479417:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5989 00000100:00100000:3.0:1783444573.479421:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3635:x1870073575458560:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783444573.479426:0:26211:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783444573.479448:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3635:x1870073575458560:12345-0@lo:400:kworker.0 Request processed in 25us (1214us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783444573.479453:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5989 00000100:00100000:3.0:1783444573.479514:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575457664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783444573.479523:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575458176:0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.479534:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575458688:0@lo:400:kworker.0 00000100:00080000:3.0:1783444573.479545:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783444573.479716:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783444573.479722:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1783444573.479734:0:3635:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1783444573.479737:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783444573.479742:0:3635:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3507 00000100:00080000:3.0:1783444573.479747:0:3635:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368cb786800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1783444573.479774:0:3635:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c33f5180 x1870073575458944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783444573.479811:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575458560:0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.479848:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575458944:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:3.0:1783444573.479877:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444573.479909:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575458944 00000100:00100000:3.0:1783444573.479913:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575458944 00000100:00100000:3.0:1783444573.479935:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5990 00000100:00100000:3.0:1783444573.479939:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3632:x1870073575458944:12345-0@lo:8:ptlrpcd_00_02.0 00010000:00020000:3.0:1783444573.479957:0:26210:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783444573.479987:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3632:x1870073575458944:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 46us (109us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783444573.479993:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5990 00000100:00080000:3.0:1783444573.480040:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783444573.480046:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783444573.480048:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575458944:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:0.0:1783444573.480183:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575457792:0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444573.480253:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575458304:0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480274:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444573.480304:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575458816:0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480325:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444573.480341:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783444573.480347:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575457920:0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480363:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444573.480377:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575458432:0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444573.480422:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575458048 00000100:00100000:0.0:1783444573.480426:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575458048 00000100:00100000:0.0:1783444573.480453:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575458816 00000100:00100000:0.0:1783444573.480456:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575458816 00000100:00100000:0.0:1783444573.480472:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575457920 00000100:00100000:0.0:1783444573.480474:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575457920 00000100:00100000:0.0:1783444573.480487:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575458432 00000100:00100000:0.0:1783444573.480489:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575458432 00000100:00100000:0.0:1783444573.480503:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1783444573.480509:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575458048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480563:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575458048:12345-0@lo:400:kworker.0 Request processed in 53us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444573.480578:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1783444573.480591:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1783444573.480592:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575458048:0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480596:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575458816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480640:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575458816:12345-0@lo:400:kworker.0 Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444573.480649:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1783444573.480662:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1783444573.480668:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575457920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480695:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575457920:12345-0@lo:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444573.480700:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1783444573.480710:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:0.0:1783444573.480715:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575458432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480739:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575458432:12345-0@lo:400:kworker.0 Request processed in 24us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444573.480744:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:0.0:1783444573.480762:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575458304 00000100:00100000:0.0:1783444573.480766:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575458304 00000100:00100000:0.0:1783444573.480806:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1783444573.480813:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575458304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783444573.480842:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575458304:12345-0@lo:400:kworker.0 Request processed in 30us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444573.480849:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00080000:0.0:1783444573.480872:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783444573.480875:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783444573.480884:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444573.480917:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575457920:0@lo:400:kworker.0 00000100:00100000:2.0:1783444573.480927:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575458432:0@lo:400:kworker.0 00000100:00100000:2.0:1783444573.480936:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575458304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444573.480944:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575458816:0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.481345:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575457792 00000100:00100000:3.0:1783444573.481350:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575457792 00000100:00100000:3.0:1783444573.481389:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783444573.481395:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575457792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444573.481440:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575457792:12345-0@lo:400:kworker.0 Request processed in 45us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444573.481446:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783444573.482120:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575457792:0@lo:400:kworker.0 00000100:00100000:2.0:1783444573.982914:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783444573.982937:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575459072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783444573.983003:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444573.983060:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575459072 00000100:00100000:2.0:1783444573.983079:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575459072 00000100:00100000:2.0:1783444573.983126:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:2.0:1783444573.983135:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575459072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444573.983167:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444573.983210:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575459072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444573.983217:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:2.0:1783444573.983271:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575459072:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783444574.301992:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444575.328581:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783444576.030377:0:94354:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051730 is committed 00010000:00010000:3.0:1783444576.030584:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030597:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030605:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030611:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6f200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.030616:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030624:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030643:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff9368d40f4900) 00010000:00010000:3.0:1783444576.030646:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.030665:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030672:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6f200/0x42cb6883e38340ba lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030691:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030698:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030703:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030708:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.030711:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030717:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030726:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff9368d40f4300) 00010000:00010000:3.0:1783444576.030728:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.030731:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030736:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10e00/0x42cb6883e38340f9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030746:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030752:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030762:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030767:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6fa00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.030770:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030776:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030784:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff9368c59a7e00) 00010000:00010000:3.0:1783444576.030786:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.030842:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030848:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6fa00/0x42cb6883e3834177 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030860:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030865:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030871:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030875:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.030878:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030892:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030901:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff9368d40f4700) 00010000:00010000:3.0:1783444576.030903:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.030906:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030911:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70000/0x42cb6883e38341a1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030923:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030929:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030934:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030938:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6ea00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.030950:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030956:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030962:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff9368c59a7300) 00010000:00010000:3.0:1783444576.030965:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.030967:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030983:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6ea00/0x42cb6883e38341e0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.030995:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031000:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031023:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031029:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6d70c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031032:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031037:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031045:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff9368f57c6a00) 00010000:00010000:3.0:1783444576.031047:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031050:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031056:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c6d70c00/0x42cb6883e38341ee lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031067:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031073:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031085:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031091:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367caf91600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031093:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031099:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031107:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff9367c98c8400) 00010000:00010000:3.0:1783444576.031109:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031113:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031118:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367caf91600/0x42cb6883e3834242 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031130:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031135:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031140:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031145:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031148:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031162:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031170:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff9368f57c6300) 00010000:00010000:3.0:1783444576.031172:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031175:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031180:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10000/0x42cb6883e383426c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031192:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031197:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031202:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031207:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c7644c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031210:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031216:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031223:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff9368d40f4800) 00010000:00010000:3.0:1783444576.031225:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031228:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031242:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c7644c00/0x42cb6883e38342b2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031255:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031260:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031265:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031269:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031272:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031277:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031284:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff9368f57c6c00) 00010000:00010000:3.0:1783444576.031285:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031288:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031293:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11600/0x42cb6883e38342f1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031301:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031307:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031318:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031323:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c10600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031325:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031331:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031339:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff9367c98c8900) 00010000:00010000:3.0:1783444576.031341:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031344:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031348:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c10600/0x42cb6883e3834361 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 71469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031358:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031364:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031369:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031373:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f9b6e000 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031375:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031389:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031396:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff9368d40f4d00) 00010000:00010000:3.0:1783444576.031398:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031400:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031404:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f9b6e000/0x42cb6883e383437d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031414:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031419:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031424:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031429:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031432:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031437:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031444:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff9368f57c6b00) 00010000:00010000:3.0:1783444576.031447:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031449:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031464:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5e00/0x42cb6883e38343a7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031475:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031481:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031486:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031491:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4c11a00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.031494:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031932:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031983:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff9368c59a7700) 00010000:00010000:3.0:1783444576.031987:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.031990:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.031997:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4c11a00/0x42cb6883e38343fb lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032021:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032028:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032039:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032045:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e5200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.032047:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032054:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032062:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff9368c59a7500) 00010000:00010000:3.0:1783444576.032064:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.032067:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032073:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e5200/0x42cb6883e383442c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032084:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032090:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032096:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032101:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c54e4600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.032104:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032118:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032126:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff9368f57c6500) 00010000:00010000:3.0:1783444576.032128:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.032131:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032136:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c54e4600/0x42cb6883e3834495 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032148:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032153:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032158:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032163:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5757e00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.032165:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032171:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032178:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff9368f57c6800) 00010000:00010000:3.0:1783444576.032180:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.032183:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032198:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9368f5757e00/0x42cb6883e383449c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032210:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032215:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032220:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032225:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4751600 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.032228:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032234:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032242:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff9367c98c8300) 00010000:00010000:3.0:1783444576.032244:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.032247:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032251:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4751600/0x42cb6883e38344f7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032261:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032266:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032278:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032283:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c4750c00 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.032285:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032291:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032298:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff9367c98c8f00) 00010000:00010000:3.0:1783444576.032300:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.032303:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032309:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367c4750c00/0x42cb6883e3834536 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032321:0:3619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032327:0:3619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032332:0:3619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032336:0:3619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367ccfb8200 already unused, calling callback (ffffffffc18404f0) 00010000:00010000:3.0:1783444576.032339:0:3619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032413:0:3619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032425:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff9368f57c6200) 00010000:00010000:3.0:1783444576.032428:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783444576.032430:0:3619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444576.032436:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9367ccfb8200/0x42cb6883e383453d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 80475 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444576.354829:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444577.374238:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783444578.077004:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783444578.077026:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575459200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444578.077099:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.077154:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575459200 00000100:00100000:2.0:1783444578.077161:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575459200 00000100:00100000:2.0:1783444578.077211:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:2.0:1783444578.077220:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575459200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444578.077255:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:2.0:1783444578.077297:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575459200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.077304:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:2.0:1783444578.077351:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575459200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444578.077886:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444578.077896:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575459328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444578.077931:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.077963:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575459328 00000100:00100000:2.0:1783444578.077980:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575459328 00000100:00100000:2.0:1783444578.078021:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:2.0:1783444578.078039:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575459328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444578.078059:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444578.078095:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575459328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.078102:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00080000:2.0:1783444578.078118:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444578.078144:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575459328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783444578.378122:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444578.378170:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557906560 00000100:00100000:1.0:1783444578.378180:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557906560 00000100:00100000:1.0:1783444578.378233:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5991 00000100:00100000:1.0:1783444578.378242:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2400:x1870073557906560:12345-192.168.204.20@tcp:8:kworker.0 00010000:00020000:1.0:1783444578.378269:0:26208:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783444578.378343:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2400:x1870073557906560:12345-192.168.204.20@tcp:8:kworker.0 Request processed in 91us (222us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444578.378353:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5991 00000100:00100000:3.0:1783444578.397182:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444578.397235:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444578.397268:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444578.397293:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444578.397320:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557906688 00000100:00100000:3.0:1783444578.397330:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557906688 00000100:00100000:3.0:1783444578.397393:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2584 00000100:00100000:3.0:1783444578.397404:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557906688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444578.397475:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557906688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 72us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444578.397483:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2584 00000100:00100000:3.0:1783444578.397506:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557906176 00000100:00100000:3.0:1783444578.397510:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557906176 00000100:00100000:3.0:1783444578.397537:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:3.0:1783444578.397543:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557906176:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444578.397586:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557906176:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444578.397592:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:3.0:1783444578.397619:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557906304 00000100:00100000:3.0:1783444578.397623:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557906304 00000100:00100000:3.0:1783444578.397651:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557906432 00000100:00100000:3.0:1783444578.397654:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557906432 00000100:00100000:3.0:1783444578.397675:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1218 00000100:00100000:3.0:1783444578.397682:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2403:x1870073557906304:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444578.397710:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2403:x1870073557906304:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 30us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444578.397717:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1218 00000100:00100000:3.0:1783444578.397729:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1219 00000100:00100000:3.0:1783444578.397736:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557906432:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444578.397759:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557906432:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444578.397765:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1219 00000100:00080000:3.0:1783444578.397781:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783444578.397785:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444578.397817:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783444578.399038:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783444578.591190:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444578.591197:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783444578.591201:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444578.591210:0:15368:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3564 00000100:00080000:0.0:1783444578.591215:0:15368:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783444578.591222:0:15368:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9367c17bb000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444578.591242:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368f9bc6d80 x1870073575459968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783444578.591274:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444578.591278:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783444578.591279:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444578.591283:0:15368:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3564 00000100:00080000:0.0:1783444578.591286:0:15368:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783444578.591289:0:15368:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368cb786800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1783444578.591302:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368eb7aa300 x1870073575460224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783444578.591343:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575459968:0@lo:8:kworker.0 00000100:00100000:0.0:1783444578.591403:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444578.591436:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575460224:0@lo:8:kworker.0 00000100:00100000:0.0:1783444578.591456:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444578.591492:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575459968 00000100:00100000:0.0:1783444578.591500:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575459968 00000100:00100000:0.0:1783444578.591542:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575460224 00000100:00100000:0.0:1783444578.591545:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575460224 00000100:00100000:0.0:1783444578.591564:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5992 00000100:00100000:0.0:1783444578.591571:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3632:x1870073575459968:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783444578.591595:0:26212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444578.591634:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3632:x1870073575459968:12345-0@lo:8:kworker.0 Request processed in 61us (230us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444578.591641:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5992 00000100:00100000:0.0:1783444578.591654:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5993 00000100:00100000:0.0:1783444578.591658:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3632:x1870073575460224:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783444578.591667:0:26212:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783444578.591686:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3632:x1870073575460224:12345-0@lo:8:kworker.0 Request processed in 26us (229us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783444578.591691:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5993 00000100:00080000:0.0:1783444578.591724:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444578.591728:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444578.591731:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575459968:0@lo:8:kworker.0 00000100:00080000:0.0:1783444578.591739:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444578.591741:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783444578.591744:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575460224:0@lo:8:kworker.0 00000100:00100000:2.0:1783444578.592171:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575459456:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592207:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.592237:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575460096:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592259:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.592277:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783444578.592282:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575459584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592298:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.592318:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575460352:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592336:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.592358:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575459712:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592377:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.592390:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575460480:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592408:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.592425:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783444578.592431:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575459840:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592453:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444578.592484:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575460352 00000100:00100000:2.0:1783444578.592489:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575460352 00000100:00100000:2.0:1783444578.592542:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1783444578.592548:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575460352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592593:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575460352:12345-0@lo:400:kworker.0 Request processed in 45us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.592600:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1783444578.592622:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575459456 00000100:00100000:2.0:1783444578.592626:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575459456 00000100:00100000:2.0:1783444578.592651:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783444578.592657:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575459456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592684:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575459456:12345-0@lo:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.592690:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783444578.592714:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575460096 00000100:00100000:2.0:1783444578.592717:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575460096 00000100:00100000:2.0:1783444578.592736:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575459584 00000100:00100000:2.0:1783444578.592738:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575459584 00000100:00100000:2.0:1783444578.592754:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575459712 00000100:00100000:2.0:1783444578.592757:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575459712 00000100:00100000:2.0:1783444578.592768:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575460480 00000100:00100000:2.0:1783444578.592770:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575460480 00000100:00100000:2.0:1783444578.592779:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1783444578.592784:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575460096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592832:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575460096:12345-0@lo:400:kworker.0 Request processed in 47us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.592839:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1783444578.592850:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1783444578.592855:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575459584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592880:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575459584:12345-0@lo:400:kworker.0 Request processed in 25us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.592896:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1783444578.592908:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1783444578.592914:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575459712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.592945:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575459712:12345-0@lo:400:kworker.0 Request processed in 32us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.592951:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1783444578.592972:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1783444578.592977:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575460480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.593001:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575460480:12345-0@lo:400:kworker.0 Request processed in 24us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.593007:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1783444578.593031:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575459840 00000100:00100000:2.0:1783444578.593034:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575459840 00000100:00100000:2.0:1783444578.593056:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:2.0:1783444578.593061:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575459840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.593087:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575459840:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444578.593093:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00080000:2.0:1783444578.593121:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444578.593124:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783444578.593127:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444578.593163:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575459840:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.593174:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575459712:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.593182:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575460480:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.593227:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575459584:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.593237:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575460352:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.593244:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575459456:0@lo:400:kworker.0 00000100:00100000:2.0:1783444578.593253:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575460096:0@lo:400:kworker.0 00000100:00100000:0.0:1783444578.604062:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444578.604085:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575460608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444578.604153:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444578.604201:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575460608 00000100:00100000:0.0:1783444578.604208:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575460608 00000100:00100000:0.0:1783444578.604250:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:0.0:1783444578.604265:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575460608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783444578.604298:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00100000:0.0:1783444578.604337:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575460608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444578.604344:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:0.0:1783444578.604384:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575460608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444579.111596:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783444579.111618:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575460736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444579.111681:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444579.113629:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575460736 00000100:00100000:3.0:1783444579.113643:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575460736 00000100:00100000:3.0:1783444579.113707:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1783444579.113716:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575460736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444579.113741:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444579.113854:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575460736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444579.113862:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1783444579.113912:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575460736:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1783444579.196145:0:96335:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:3.0:1783444579.422123:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444580.446340:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444581.470498:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444582.494404:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1783444583.199651:0:94371:0:(genops.c:1231:class_import_get()) import ffff9368cab9e800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1783444583.199717:0:94371:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d9465b4e] to pc [ptlrpcd_00_01+1] req@ffff9367c33f4e00 x1870073575460864/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.201836:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1783444583.201860:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c33f4e00 x1870073575460864/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.201895:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575460864:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1783444583.201927:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c33f4e00 x1870073575460864/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.201936:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.201975:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd19b480 x1870073575460864 msgsize 224 00000100:00100000:2.0:1783444583.201980:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444583.202003:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c33f4e00 x1870073575460864/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.202015:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5413 usecs (6 jiffies) 00000100:00100000:2.0:1783444583.202079:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575460864 00000100:00100000:2.0:1783444583.202086:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575460864 00000020:00000040:2.0:1783444583.202089:0:8431:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833609 00000020:00000040:2.0:1783444583.202093:0:8431:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368cb781800 refcount=5 00000100:00000040:2.0:1783444583.202113:0:8431:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1783444583.202133:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00000040:2.0:1783444583.202138:0:8431:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368cb781800 : new rpc_count 1 00000100:00000040:2.0:1783444583.202143:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd19b480 x1870073575460864/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.202168:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575460864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444583.202249:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00010000:00000040:2.0:1783444583.202277:0:8431:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575460864 00000100:00000040:2.0:1783444583.202289:0:8431:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444583.202294:0:8431:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.202312:0:8431:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9367c33f4e00 x1870073575460864/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.202331:0:8431:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444583.202336:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd19b480 x1870073575460864/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:204/0 lens 224/368 e 0 to 0 dl 1783444594 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.202345:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575460864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.202352:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00000040:2.0:1783444583.202355:0:8431:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368cb781800 : new rpc_count 0 00000020:00000040:2.0:1783444583.202377:0:8431:0:(genops.c:900:class_export_put()) PUTting export ffff9368cb781800 : new refcount 4 00000100:00000040:2.0:1783444583.202620:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783444583.202626:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c33f4e00 x1870073575460864/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783444583.202638:0:3633:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352788 avail=317085 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:2.0:1783444583.202645:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f4e00 x1870073575460864/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.202653:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575460864:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1783444583.202658:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c33f4e00 x1870073575460864/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444583.202678:0:3633:0:(genops.c:1244:class_import_put()) import ffff9368cab9e800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:1.0:1783444583.204761:0:75662:0:(genops.c:1231:class_import_get()) import ffff9367c3a03800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783444583.204818:0:75662:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d9c40b03] to pc [ptlrpcd_00_02+2] req@ffff9368dd108380 x1870073575460992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.204884:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:1.0:1783444583.204897:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368dd108380 x1870073575460992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.204908:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575460992:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1783444583.204938:0:3636:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368dd108380 x1870073575460992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444599 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.204946:0:3636:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444583.204981:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd10aa00 x1870073575460992 msgsize 224 00000100:00100000:1.0:1783444583.204985:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444583.205008:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368dd108380 x1870073575460992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.205021:0:3636:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4512 usecs (5 jiffies) 00000100:00100000:1.0:1783444583.205043:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575460992 00000100:00100000:1.0:1783444583.205049:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575460992 00000020:00000040:1.0:1783444583.205052:0:13537:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf55 00000020:00000040:1.0:1783444583.205055:0:13537:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a07800 refcount=5 00000020:00000040:1.0:1783444583.205072:0:13537:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:1.0:1783444583.205095:0:13537:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1783444583.205117:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00000040:1.0:1783444583.205121:0:13537:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c3a07800 : new rpc_count 1 00000100:00000040:1.0:1783444583.205126:0:13537:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd10aa00 x1870073575460992/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.205138:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575460992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783444583.205165:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1783444583.205174:0:13537:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1870073575460992 00000100:00000040:1.0:1783444583.205184:0:13537:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444583.205188:0:13537:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444583.205212:0:13537:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368dd108380 x1870073575460992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.205230:0:13537:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444583.205234:0:13537:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd10aa00 x1870073575460992/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:204/0 lens 224/368 e 0 to 0 dl 1783444594 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.205242:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575460992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444583.205248:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00000040:1.0:1783444583.205250:0:13537:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c3a07800 : new rpc_count 0 00000020:00000040:1.0:1783444583.205298:0:13537:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a07800 : new refcount 4 00000100:00080000:1.0:1783444583.205434:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1783444583.205438:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:1.0:1783444583.205467:0:3636:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969457 00000100:00000040:1.0:1783444583.205474:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368dd108380 x1870073575460992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1783444583.205483:0:3636:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:1.0:1783444583.205486:0:3636:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1783444583.205493:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd108380 x1870073575460992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.205501:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575460992:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1783444583.205507:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368dd108380 x1870073575460992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444583.205515:0:3636:0:(genops.c:1244:class_import_put()) import ffff9367c3a03800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1783444583.500013:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f8ff4050 x1870073557906816 msgsize 224 00000100:00100000:3.0:1783444583.500030:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:3.0:1783444583.500033:0:3627:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1783444583.500065:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557906816 00000100:00000040:3.0:1783444583.500067:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f6300 x1870073557907072 msgsize 224 00000100:00100000:3.0:1783444583.500075:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444583.500076:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557906816 00000020:00000040:0.0:1783444583.500081:0:94359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833679 00000020:00000040:0.0:1783444583.500086:0:94359:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c6ab4800 refcount=10 00000100:00000040:0.0:1783444583.500112:0:94359:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444583.500148:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00000040:0.0:1783444583.500153:0:94359:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c6ab4800 : new rpc_count 1 00000100:00000040:0.0:1783444583.500160:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f8ff4050 x1870073557906816/t0(0) o400->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.500173:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557906816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00000040:3.0:1783444583.500198:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f5500 x1870073557906944 msgsize 224 00010000:00000040:0.0:1783444583.500205:0:94359:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073557906816 00000100:00100000:3.0:1783444583.500206:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:0.0:1783444583.500219:0:94359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444583.500226:0:94359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444583.500272:0:94359:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444583.500277:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f8ff4050 x1870073557906816/t0(0) o400->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.500286:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557906816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 115us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444583.500307:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00000040:0.0:1783444583.500310:0:94359:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c6ab4800 : new rpc_count 0 00000020:00000040:0.0:1783444583.500320:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c6ab4800 : new refcount 9 00000100:00100000:2.0:1783444583.508597:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557907072 00000100:00100000:2.0:1783444583.508614:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557907072 00000020:00000040:2.0:1783444583.508618:0:66225:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3832bdd 00000020:00000040:2.0:1783444583.508625:0:66225:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368dd20c800 refcount=11 00000020:00000040:2.0:1783444583.508643:0:66225:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000100:00000040:2.0:1783444583.508720:0:66225:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1783444583.508759:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557906944 00000100:00100000:2.0:1783444583.508763:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557906944 00000020:00000040:2.0:1783444583.508765:0:71469:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38335ca 00000020:00000040:2.0:1783444583.508768:0:71469:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c5621800 refcount=51 00000020:00000040:2.0:1783444583.508774:0:71469:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 14 - evictor 00000100:00100000:0.0:1783444583.509435:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1224 00000100:00000040:0.0:1783444583.509441:0:80475:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368dd20c800 : new rpc_count 1 00000100:00000040:0.0:1783444583.509450:0:80475:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f6300 x1870073557907072/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.509466:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557907072:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:0.0:1783444583.509492:0:80475:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 77309411468, transno 0, xid 1870073557907072 00000100:00000040:0.0:1783444583.509503:0:80475:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444583.509509:0:80475:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444583.509567:0:80475:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444583.509573:0:80475:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f6300 x1870073557907072/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.509582:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557907072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 121us (9513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444583.509589:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1224 00000100:00000040:0.0:1783444583.509592:0:80475:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368dd20c800 : new rpc_count 0 00000020:00000040:0.0:1783444583.509603:0:80475:0:(genops.c:900:class_export_put()) PUTting export ffff9368dd20c800 : new refcount 10 00000100:00000040:0.0:1783444583.509656:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7a9880 x1870073557907328 msgsize 224 00000100:00100000:0.0:1783444583.509662:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:0.0:1783444583.510049:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7aaa00 x1870073557907200 msgsize 520 00000100:00100000:0.0:1783444583.510055:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444583.510496:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557907328 00000100:00100000:3.0:1783444583.510503:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557907328 00000020:00000040:3.0:1783444583.510506:0:26211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383397b 00000020:00000040:3.0:1783444583.510510:0:26211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c518e000 refcount=7 00000020:00000040:3.0:1783444583.510520:0:26211:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00080000:1.0:1783444583.510569:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1783444583.510574:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00080000:1.0:1783444583.510577:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1783444583.510596:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9367c2c63380) now 14 - evictor 00000100:00080000:1.0:1783444583.510599:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1783444583.510602:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000100:00100000:1.0:1783444583.510614:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557907200 00000100:00100000:1.0:1783444583.510619:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557907200 00000020:00000040:1.0:1783444583.510620:0:26201:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833974 00000100:00100000:1.0:1783444583.510663:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5994 00000100:00000040:1.0:1783444583.510669:0:26201:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7aaa00 x1870073557907200/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444603 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.510690:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2400:x1870073557907200:12345-192.168.204.20@tcp:8:kworker.0 00010000:00020000:1.0:1783444583.510713:0:26201:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1783444583.510732:0:26201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444583.510735:0:26201:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444583.510739:0:26201:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444583.510776:0:26201:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444583.510781:0:26201:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7aaa00 x1870073557907200/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.510808:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2400:x1870073557907200:12345-192.168.204.20@tcp:8:kworker.0 Request processed in 118us (757us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444583.510815:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5994 00000100:00000040:2.0:1783444583.513848:0:71469:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1783444583.513908:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1225 00000100:00000040:2.0:1783444583.513913:0:71469:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c5621800 : new rpc_count 1 00000100:00000040:2.0:1783444583.513921:0:71469:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f5500 x1870073557906944/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.513939:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2404:x1870073557906944:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:2.0:1783444583.513965:0:71469:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1870073557906944 00000100:00000040:2.0:1783444583.513974:0:71469:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444583.513980:0:71469:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444583.514023:0:71469:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444583.514028:0:71469:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f5500 x1870073557906944/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.514039:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2404:x1870073557906944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 106us (13839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.514046:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1225 00000100:00000040:2.0:1783444583.514130:0:71469:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c5621800 : new rpc_count 0 00000020:00000040:2.0:1783444583.514142:0:71469:0:(genops.c:900:class_export_put()) PUTting export ffff9367c5621800 : new refcount 50 00010000:00010000:0.0:1783444583.517526:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1783444583.520332:0:26211:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1783444583.520649:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2586 00000100:00000040:2.0:1783444583.520655:0:26211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c518e000 : new rpc_count 1 00000100:00000040:2.0:1783444583.520665:0:26211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7a9880 x1870073557907328/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.520683:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557907328:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:2.0:1783444583.520710:0:26211:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073557907328 00000100:00000040:2.0:1783444583.520722:0:26211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444583.520729:0:26211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444583.520878:0:26211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444583.520885:0:26211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9880 x1870073557907328/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.520894:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557907328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 217us (11236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.520901:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2586 00000100:00000040:2.0:1783444583.520904:0:26211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c518e000 : new rpc_count 0 00000020:00000040:2.0:1783444583.520916:0:26211:0:(genops.c:900:class_export_put()) PUTting export ffff9368c518e000 : new refcount 6 00000020:00000040:0.0:1783444583.710416:0:75658:0:(genops.c:1231:class_import_get()) import ffff9368f8ca7800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783444583.710482:0:75658:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c49d2846] to pc [ptlrpcd_00_03+3] req@ffff9368eb7a9c00 x1870073575461120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.710574:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444583.710584:0:15368:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444583.710606:0:15368:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c89ab73b-dbb2-4305-b221-37cc64d61227->MGS req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.710618:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000097d85fa9] to pc [ptlrpcd_00_00+0] req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.710638:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444583.710645:0:15368:0:(genops.c:1231:class_import_get()) import ffff9367c2faf000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1783444583.710653:0:15368:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.710664:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c7bd36ca] to pc [ptlrpcd_00_01+1] req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.710674:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444583.710679:0:15368:0:(genops.c:1231:class_import_get()) import ffff9367c2faf800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1783444583.710688:0:15368:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.710697:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009a8f9114] to pc [ptlrpcd_00_02+2] req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.710708:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444583.710712:0:15368:0:(genops.c:1231:class_import_get()) import ffff9368f8ca7800 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783444583.710718:0:15368:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.710739:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000004496c2d] to pc [ptlrpcd_00_03+3] req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444583.710747:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444583.710750:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783444583.710753:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444583.710758:0:15368:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3569 00000100:00080000:0.0:1783444583.710763:0:15368:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:0.0:1783444583.710765:0:15368:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 50 to 0@lo 00000100:00000040:0.0:1783444583.710769:0:15368:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 51 to 0@lo 00000020:00000040:0.0:1783444583.710772:0:15368:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf32 00000020:00000040:0.0:1783444583.710776:0:15368:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a05000 refcount=4 00000100:00000040:0.0:1783444583.710779:0:15368:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 50 to 0@lo 00000100:00000040:0.0:1783444583.710781:0:15368:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 51 to 0@lo 00000020:00000040:0.0:1783444583.710785:0:15368:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a05000 : new refcount 3 00000100:00080000:0.0:1783444583.710805:0:15368:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9367c17bb000 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:0.0:1783444583.710816:0:15368:0:(genops.c:1231:class_import_get()) import ffff9367c17bb000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1783444583.711523:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.711536:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea087b32] to pc [ptlrpcd_rcv+-1] req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.711557:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444583.711567:0:15368:0:(genops.c:1231:class_import_get()) import ffff9368dd118000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1783444583.711574:0:15368:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.711583:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000dc8da2ef] to pc [ptlrpcd_00_00+0] req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444583.711596:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783444583.711600:0:15368:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783444583.711601:0:15368:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444583.711606:0:15368:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3569 00000100:00080000:0.0:1783444583.711608:0:15368:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:0.0:1783444583.711611:0:15368:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 50 to 0@lo 00000100:00000040:0.0:1783444583.711614:0:15368:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 51 to 0@lo 00000020:00000040:0.0:1783444583.711616:0:15368:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833610 00000020:00000040:0.0:1783444583.711619:0:15368:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368eb6ff000 refcount=4 00000100:00000040:0.0:1783444583.711621:0:15368:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 50 to 0@lo 00000100:00000040:0.0:1783444583.711624:0:15368:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 51 to 0@lo 00000020:00000040:0.0:1783444583.711626:0:15368:0:(genops.c:900:class_export_put()) PUTting export ffff9368eb6ff000 : new refcount 3 00000100:00080000:0.0:1783444583.711629:0:15368:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368cb786800 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:0.0:1783444583.711636:0:15368:0:(genops.c:1231:class_import_get()) import ffff9368cb786800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783444583.711646:0:15368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.711655:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009d12c350] to pc [ptlrpcd_rcv+-1] req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.711663:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444583.711669:0:15368:0:(genops.c:1231:class_import_get()) import ffff9367c5037000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783444583.711675:0:15368:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.711684:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009242892e] to pc [ptlrpcd_00_01+1] req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.711692:0:15368:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444583.711702:0:15368:0:(genops.c:1231:class_import_get()) import ffff9367cae88800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1783444583.711710:0:15368:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444583.711719:0:15368:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a9b93d77] to pc [ptlrpcd_00_02+2] req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.711730:0:15368:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3579) 00000100:00000040:2.0:1783444583.711752:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a9c00 x1870073575461120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.711757:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.711765:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.711775:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575461120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444583.711819:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575461504:0@lo:400:kworker.0 00000100:00100000:1.0:1783444583.711834:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575461760:0@lo:8:kworker.0 00000100:00000040:0.0:1783444583.711844:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.711856:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444583.711857:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444603 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.711881:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444583.711914:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd108380 x1870073575461760 msgsize 520 00000100:00000040:0.0:1783444583.711914:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7a9f80 x1870073575461504 msgsize 224 00000100:00100000:0.0:1783444583.711921:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444583.711929:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444583.711944:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.711957:0:3635:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7547 usecs (8 jiffies) 00000100:00000040:1.0:1783444583.711966:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444603 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.711967:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.711993:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575462272:0@lo:400:kworker.0 00000100:00000040:1.0:1783444583.711994:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 4165 usecs (5 jiffies) 00000100:00000040:1.0:1783444583.712005:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.712009:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.712028:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575462016:0@lo:8:kworker.0 00000100:00000040:0.0:1783444583.712028:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444583.712041:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bc4e00 x1870073575462272 msgsize 224 00000100:00100000:0.0:1783444583.712046:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444583.712049:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444603 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.712061:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444583.712062:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.712079:0:3635:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 10036 usecs (11 jiffies) 00000100:00000040:1.0:1783444583.712080:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd10b100 x1870073575462016 msgsize 520 00000100:00100000:1.0:1783444583.712087:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444583.712107:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444603 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.712108:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.712128:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8046 usecs (9 jiffies) 00000100:00100000:0.0:1783444583.712129:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575461248:0@lo:400:kworker.0 00000100:00000040:0.0:1783444583.712146:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.712153:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1783444583.712160:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575461760 00000100:00100000:1.0:1783444583.712168:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575461760 00000100:00000040:0.0:1783444583.712170:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368f8ff7050 x1870073575461248 msgsize 224 00000020:00000040:1.0:1783444583.712171:0:8824:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf47 00000100:00000040:2.0:1783444583.712178:0:3636:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a9c00 x1870073575461120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.712178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444583.712190:0:3636:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444583.712195:0:3633:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1783444583.712208:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575462016 00000100:00100000:1.0:1783444583.712212:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575462016 00000100:00000040:2.0:1783444583.712215:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd19a300 x1870073575461120 msgsize 224 00000020:00000040:1.0:1783444583.712216:0:8824:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833617 00000100:00000040:0.0:1783444583.712217:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.712231:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444583.712244:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5995 00000100:00000040:1.0:1783444583.712251:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd108380 x1870073575461760/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444603 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.712259:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.712269:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a9c00 x1870073575461120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.712272:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575461888:0@lo:400:kworker.0 00000100:00100000:1.0:1783444583.712283:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1870073575461760:12345-0@lo:8:kworker.0 00000100:00000040:0.0:1783444583.712291:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:1.0:1783444583.712306:0:8824:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1783444583.712308:0:3636:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1796415 usecs (1797 jiffies) 00000100:00000040:0.0:1783444583.712310:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.712320:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.712325:0:8824:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444583.712328:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bc4700 x1870073575461888 msgsize 224 00000100:00000040:1.0:1783444583.712333:0:8824:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00100000:0.0:1783444583.712337:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444583.712340:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575461632:0@lo:400:kworker.0 00000100:00000040:1.0:1783444583.712350:0:8824:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444583.712356:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.712367:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 148833 usecs (149 jiffies) 00000100:00100000:0.0:1783444583.712375:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:0.0:1783444583.712381:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.712400:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575461376:0@lo:400:kworker.0 00000100:00000040:1.0:1783444583.713159:0:8824:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444603 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.713181:0:8824:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444583.713186:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd108380 x1870073575461760/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.713195:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1870073575461760:12345-0@lo:8:kworker.0 Request processed in 914us (1280us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444583.713202:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5995 00000100:00100000:1.0:1783444583.713225:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5996 00000100:00000040:1.0:1783444583.713230:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd10b100 x1870073575462016/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444603 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.713238:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1870073575462016:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783444583.713252:0:8824:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1783444583.713736:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.713746:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444583.713764:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bc4a80 x1870073575461376 msgsize 224 00000100:00100000:0.0:1783444583.713769:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444583.713785:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.713811:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7943 usecs (8 jiffies) 00000100:00000040:0.0:1783444583.713821:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.713833:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575462144:0@lo:400:kworker.0 00000100:00000040:1.0:1783444583.713836:0:8824:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444583.713841:0:8824:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444583.713845:0:8824:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444583.713852:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.713871:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444583.713886:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bc5c00 x1870073575462144 msgsize 224 00000100:00100000:0.0:1783444583.713890:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444583.713904:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.713912:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7627 usecs (8 jiffies) 00000100:00000040:1.0:1783444583.713937:0:8824:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444603 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.713947:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575461504 00000100:00100000:0.0:1783444583.713954:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575461504 00000100:00000040:1.0:1783444583.713956:0:8824:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000020:00000040:0.0:1783444583.713957:0:80475:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cfda 00000100:00000040:1.0:1783444583.713964:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd10b100 x1870073575462016/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444583.713964:0:80475:0:(lustre_handles.c:147:class_handle2object()) GET export ffff936901db8800 refcount=5 00000100:00100000:1.0:1783444583.713976:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3632:x1870073575462016:12345-0@lo:8:kworker.0 Request processed in 737us (1894us total) trans 0 rc -19/-19 00000020:00000040:0.0:1783444583.713979:0:80475:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000100:00100000:1.0:1783444583.713984:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5996 00000100:00100000:1.0:1783444583.714001:0:8824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575462144 00000100:00100000:1.0:1783444583.714016:0:8824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575462144 00000020:00000040:1.0:1783444583.714025:0:8824:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833633 00000020:00000040:1.0:1783444583.714027:0:8824:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c5118000 refcount=5 00000020:00000040:1.0:1783444583.714035:0:8824:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:1.0:1783444583.714046:0:8824:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1783444583.714068:0:8824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00000040:1.0:1783444583.714071:0:8824:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c5118000 : new rpc_count 1 00000100:00000040:1.0:1783444583.714075:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bc5c00 x1870073575462144/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.714086:0:8824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575462144:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1783444583.714094:0:3636:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444583.714103:0:8824:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969460, transno 0, xid 1870073575462144 00000100:00000040:1.0:1783444583.714112:0:8824:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444583.714117:0:3636:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444583.714121:0:8824:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.714144:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd199c00 x1870073575461632 msgsize 224 00000100:00000040:1.0:1783444583.714146:0:8824:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.714154:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444583.714178:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444599 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.714179:0:8824:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444583.714189:0:8824:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc5c00 x1870073575462144/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.714195:0:3636:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1796415 usecs (1797 jiffies) 00000100:00100000:1.0:1783444583.714202:0:8824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575462144:12345-0@lo:400:kworker.0 Request processed in 117us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444583.714211:0:8824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00000040:1.0:1783444583.714214:0:8824:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c5118000 : new rpc_count 0 00000100:00100000:2.0:1783444583.714222:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575462272 00000020:00000040:1.0:1783444583.714224:0:8824:0:(genops.c:900:class_export_put()) PUTting export ffff9368c5118000 : new refcount 4 00000100:00100000:2.0:1783444583.714227:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575462272 00000020:00000040:2.0:1783444583.714231:0:66223:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833775 00000020:00000040:2.0:1783444583.714235:0:66223:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c9a14000 refcount=5 00000100:00080000:1.0:1783444583.714253:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1783444583.714258:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:0.0:1783444583.714337:0:80475:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1783444583.714356:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575461888 00000100:00100000:0.0:1783444583.714366:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575461888 00000020:00000040:0.0:1783444583.714368:0:80475:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383376e 00000020:00000040:0.0:1783444583.714370:0:80475:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368dd11c000 refcount=5 00000100:00100000:2.0:1783444583.714408:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575461376 00000100:00100000:2.0:1783444583.714412:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575461376 00000020:00000040:2.0:1783444583.714414:0:66223:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833767 00000020:00000040:2.0:1783444583.714417:0:66223:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368ff64d000 refcount=5 00000020:00000040:2.0:1783444583.714424:0:66223:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 14 - evictor 00000100:00100000:2.0:1783444583.714438:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00000040:2.0:1783444583.714441:0:66223:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff936901db8800 : new rpc_count 1 00000100:00000040:2.0:1783444583.714446:0:66223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7a9f80 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.714456:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575461504:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783444583.714474:0:66223:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575461504 00000100:00000040:2.0:1783444583.714479:0:66223:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444583.714483:0:66223:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.714503:0:66223:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.714522:0:66223:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444583.714526:0:66223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9f80 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.714546:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1870073575461504:12345-0@lo:400:kworker.0 Request processed in 80us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.714554:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00000040:2.0:1783444583.714557:0:66223:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff936901db8800 : new rpc_count 0 00000020:00000040:2.0:1783444583.714566:0:66223:0:(genops.c:900:class_export_put()) PUTting export ffff936901db8800 : new refcount 4 00000100:00100000:2.0:1783444583.714576:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00000040:2.0:1783444583.714578:0:66223:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c9a14000 : new rpc_count 1 00000100:00000040:2.0:1783444583.714583:0:66223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bc4e00 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.714594:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575462272:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783444583.714608:0:66223:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575462272 00000100:00000040:2.0:1783444583.714613:0:66223:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444583.714616:0:66223:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.714635:0:66223:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.714648:0:66223:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444583.714652:0:66223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc4e00 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.714671:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575462272:12345-0@lo:400:kworker.0 Request processed in 79us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.714678:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00000040:2.0:1783444583.714680:0:66223:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c9a14000 : new rpc_count 0 00000020:00000040:2.0:1783444583.714688:0:66223:0:(genops.c:900:class_export_put()) PUTting export ffff9368c9a14000 : new refcount 4 00000100:00100000:2.0:1783444583.714697:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00000040:2.0:1783444583.714700:0:66223:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368ff64d000 : new rpc_count 1 00000100:00000040:2.0:1783444583.714703:0:66223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bc4a80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.714715:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575461376:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783444583.714739:0:66223:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575461376 00000100:00000040:2.0:1783444583.714745:0:66223:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444583.714748:0:66223:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.714765:0:66223:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.714777:0:66223:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444583.714781:0:66223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc4a80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.714804:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575461376:12345-0@lo:400:kworker.0 Request processed in 77us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.714810:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00000040:2.0:1783444583.714813:0:66223:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368ff64d000 : new rpc_count 0 00000020:00000040:2.0:1783444583.714820:0:66223:0:(genops.c:900:class_export_put()) PUTting export ffff9368ff64d000 : new refcount 4 00000100:00100000:2.0:1783444583.714843:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575461248 00000100:00080000:1.0:1783444583.714847:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444583.714849:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575461248 00000020:00000040:1.0:1783444583.714852:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9367c2c63380) now 14 - evictor 00000020:00000040:2.0:1783444583.714853:0:94360:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000100:00080000:1.0:1783444583.714856:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1783444583.714859:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000020:00000040:2.0:1783444583.714873:0:94360:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=21 00000100:00000040:2.0:1783444583.714885:0:94360:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783444583.714905:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:2.0:1783444583.714907:0:94360:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:2.0:1783444583.714911:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f8ff7050 x1870073575461248/t0(0) o400->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.714920:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575461248:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783444583.714929:0:94360:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575461248 00000100:00000040:2.0:1783444583.714936:0:94360:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444583.714941:0:94360:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.714961:0:94360:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.714968:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.714977:0:94360:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444583.714987:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f8ff7050 x1870073575461248/t0(0) o400->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444583.714992:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444583.714999:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1783444583.715005:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.715013:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575461760:0@lo:8:kworker.0 00000100:00000040:1.0:1783444583.715030:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444583.715037:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444583.715040:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1783444583.715044:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.715051:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575462016:0@lo:8:kworker.0 00000100:00000040:1.0:1783444583.715056:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a9500 x1870073575461760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444583.715068:0:3632:0:(genops.c:1244:class_import_put()) import ffff9367c17bb000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1783444583.715076:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a8700 x1870073575462016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444603 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444583.715083:0:3632:0:(genops.c:1244:class_import_put()) import ffff9368cb786800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1783444583.715828:0:80475:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1783444583.715838:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783444583.715846:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.715856:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.715872:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00000040:0.0:1783444583.715878:0:80475:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368dd11c000 : new rpc_count 1 00000100:00100000:1.0:1783444583.715887:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575461376:0@lo:400:kworker.0 00000100:00000040:0.0:1783444583.715888:0:80475:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bc4700 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.715909:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575461888:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1783444583.715916:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969460 00000100:00000040:1.0:1783444583.715923:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1783444583.715925:0:80475:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575461888 00000100:00000040:0.0:1783444583.715936:0:80475:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444583.715938:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.715946:0:80475:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1783444583.715954:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575462144:0@lo:400:kworker.0 00000100:00000040:1.0:1783444583.715968:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.715975:0:80475:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.715983:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.715995:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c89ab73b-dbb2-4305-b221-37cc64d61227:3633:1870073575461248:0@lo:400:kworker.0 00000100:00000040:0.0:1783444583.715996:0:80475:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444583.716009:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783444583.716014:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444583.716022:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444583.716028:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575461888:0@lo:400:kworker.0 00000100:00000040:1.0:1783444583.716034:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7aad80 x1870073575461376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444583.716043:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367c2faf000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1783444583.716050:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7aa300 x1870073575462144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444583.716056:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367c5037000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1783444583.716069:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a8a80 x1870073575461248/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444583.716079:0:80475:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc4700 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444583.716080:0:3633:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000100:00000040:1.0:1783444583.716088:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7aa680 x1870073575461888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444583.716096:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575461888:12345-0@lo:400:kworker.0 Request processed in 190us (3764us total) trans 0 rc 0/0 00000020:00000040:1.0:1783444583.716101:0:3633:0:(genops.c:1244:class_import_put()) import ffff9368dd118000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00100000:2.0:1783444583.716196:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f8ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3633:x1870073575461248:12345-0@lo:400:kworker.0 Request processed in 79us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.716205:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:2.0:1783444583.716208:0:94360:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:2.0:1783444583.716218:0:94360:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 20 00000100:00100000:2.0:1783444583.716249:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575461120 00000100:00100000:2.0:1783444583.716254:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575461120 00000020:00000040:2.0:1783444583.716256:0:29151:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38335c3 00000020:00000040:2.0:1783444583.716260:0:29151:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c5624000 refcount=7 00000100:00000040:2.0:1783444583.716271:0:29151:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1783444583.716289:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575461632 00000100:00100000:2.0:1783444583.716292:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575461632 00000020:00000040:2.0:1783444583.716294:0:29151:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38335c3 00000020:00000040:2.0:1783444583.716296:0:29151:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c5624000 refcount=8 00000100:00100000:2.0:1783444583.716325:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00000040:2.0:1783444583.716328:0:29151:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c5624000 : new rpc_count 1 00000100:00000040:2.0:1783444583.716332:0:29151:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd19a300 x1870073575461120/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.716343:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3636:x1870073575461120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444583.716369:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00010000:00000040:2.0:1783444583.716378:0:29151:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870073575461120 00000100:00000040:2.0:1783444583.716383:0:29151:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444583.716386:0:29151:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.716405:0:29151:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368eb7a9c00 x1870073575461120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.716425:0:29151:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444583.716430:0:29151:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd19a300 x1870073575461120/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:204/0 lens 224/368 e 0 to 0 dl 1783444594 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.716438:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3636:x1870073575461120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.716444:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00000040:2.0:1783444583.716446:0:29151:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c5624000 : new rpc_count 0 00000020:00000040:2.0:1783444583.716452:0:29151:0:(genops.c:900:class_export_put()) PUTting export ffff9367c5624000 : new refcount 7 00000100:00100000:2.0:1783444583.716460:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00000040:2.0:1783444583.716463:0:29151:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c5624000 : new rpc_count 1 00000100:00000040:2.0:1783444583.716466:0:29151:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd199c00 x1870073575461632/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:204/0 lens 224/0 e 0 to 0 dl 1783444594 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.716476:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575461632:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783444583.716486:0:29151:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870073575461632 00000100:00000040:2.0:1783444583.716490:0:29151:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444583.716500:0:29151:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444583.716518:0:29151:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.716531:0:29151:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444583.716547:0:29151:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd199c00 x1870073575461632/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:204/0 lens 224/224 e 0 to 0 dl 1783444594 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.716554:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575461632:12345-0@lo:400:kworker.0 Request processed in 80us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444583.716561:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00000040:2.0:1783444583.716563:0:29151:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c5624000 : new rpc_count 0 00000020:00000040:2.0:1783444583.716569:0:29151:0:(genops.c:900:class_export_put()) PUTting export ffff9367c5624000 : new refcount 6 00000100:00000040:2.0:1783444583.716631:0:3635:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783444583.716638:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.716653:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.716661:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1870073575461504:0@lo:400:kworker.0 00000100:00000040:2.0:1783444583.716675:0:3635:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783444583.716680:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.716687:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.716694:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575462272:0@lo:400:kworker.0 00000100:00000040:2.0:1783444583.716701:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7ab800 x1870073575461504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444583.716720:0:3635:0:(genops.c:1244:class_import_put()) import ffff9367c2faf800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1783444583.716728:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a8380 x1870073575462272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444583.716737:0:3635:0:(genops.c:1244:class_import_put()) import ffff9367cae88800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1783444583.716763:0:3636:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1783444583.716769:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a9c00 x1870073575461120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783444583.716778:0:3636:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352727 avail=317024 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023568 state=0: rc = 0 00000100:00000040:2.0:1783444583.716786:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9c00 x1870073575461120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.716815:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575461120:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1783444583.716825:0:3636:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1783444583.716829:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444583.716837:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444583.716844:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575461632:0@lo:400:kworker.0 00000100:00000040:2.0:1783444583.716849:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a9c00 x1870073575461120/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444583.716856:0:3636:0:(genops.c:1244:class_import_put()) import ffff9368f8ca7800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783444583.716873:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a9180 x1870073575461632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444583.716880:0:3636:0:(genops.c:1244:class_import_put()) import ffff9368f8ca7800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1783444583.716932:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00000040:0.0:1783444583.716935:0:80475:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368dd11c000 : new rpc_count 0 00000020:00000040:0.0:1783444583.716943:0:80475:0:(genops.c:900:class_export_put()) PUTting export ffff9368dd11c000 : new refcount 4 00000020:00000040:1.0:1783444584.222455:0:94375:0:(genops.c:1231:class_import_get()) import ffff9367c5037000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1783444584.222495:0:94375:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000050c25fb9] to pc [ptlrpcd_00_03+3] req@ffff9368dd108a80 x1870073575462400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444584.222539:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:1.0:1783444584.222553:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368dd108a80 x1870073575462400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444584.222568:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575462400:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1783444584.222602:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368dd108a80 x1870073575462400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444600 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444584.222611:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444584.222651:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd108e00 x1870073575462400 msgsize 224 00000100:00100000:1.0:1783444584.222656:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444584.222681:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368dd108a80 x1870073575462400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444600 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444584.222696:0:3635:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7546 usecs (8 jiffies) 00000100:00100000:1.0:1783444584.222721:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575462400 00000100:00100000:1.0:1783444584.222729:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575462400 00000020:00000040:1.0:1783444584.222732:0:8424:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833633 00000020:00000040:1.0:1783444584.222737:0:8424:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c5118000 refcount=5 00000100:00000040:1.0:1783444584.222776:0:8424:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1783444584.224489:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00000040:1.0:1783444584.224496:0:8424:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c5118000 : new rpc_count 1 00000100:00000040:1.0:1783444584.224504:0:8424:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd108e00 x1870073575462400/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:205/0 lens 224/0 e 0 to 0 dl 1783444595 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444584.224524:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575462400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444584.224549:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1783444584.224559:0:8424:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969460, transno 0, xid 1870073575462400 00000100:00000040:1.0:1783444584.224571:0:8424:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444584.224577:0:8424:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444584.224611:0:8424:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368dd108a80 x1870073575462400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444600 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444584.224635:0:8424:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444584.224640:0:8424:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd108e00 x1870073575462400/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:205/0 lens 224/368 e 0 to 0 dl 1783444595 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444584.224649:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575462400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444584.224657:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00000040:1.0:1783444584.224660:0:8424:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c5118000 : new rpc_count 0 00000020:00000040:1.0:1783444584.224674:0:8424:0:(genops.c:900:class_export_put()) PUTting export ffff9368c5118000 : new refcount 4 00000100:00000040:1.0:1783444584.228404:0:3635:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969460 00000100:00000040:1.0:1783444584.228422:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368dd108a80 x1870073575462400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1783444584.228436:0:3635:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:1.0:1783444584.228441:0:3635:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1783444584.228450:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd108a80 x1870073575462400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444600 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444584.228459:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575462400:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1783444584.228467:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368dd108a80 x1870073575462400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444600 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444584.228486:0:3635:0:(genops.c:1244:class_import_put()) import ffff9367c5037000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:1.0:1783444584.545881:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444585.578296:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783444586.590524:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444587.617889:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1783444588.318962:0:94371:0:(genops.c:1231:class_import_get()) import ffff9368cab9e800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1783444588.319012:0:94371:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000c5d8864] to pc [ptlrpcd_00_00+0] req@ffff9368dd199500 x1870073575462528/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.319043:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:2.0:1783444588.319054:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368dd199500 x1870073575462528/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.319068:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368dd199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575462528:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1783444588.319099:0:3634:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368dd199500 x1870073575462528/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.319108:0:3634:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.319151:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf5880 x1870073575462528 msgsize 224 00000100:00100000:2.0:1783444588.319157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444588.319183:0:3634:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368dd199500 x1870073575462528/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.319196:0:3634:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5342 usecs (6 jiffies) 00000100:00100000:2.0:1783444588.319222:0:29151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575462528 00000100:00100000:2.0:1783444588.319230:0:29151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575462528 00000020:00000040:2.0:1783444588.319234:0:29151:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833609 00000020:00000040:2.0:1783444588.319238:0:29151:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368cb781800 refcount=5 00000100:00000040:2.0:1783444588.319261:0:29151:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1783444588.319292:0:29151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00000040:2.0:1783444588.319296:0:29151:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368cb781800 : new rpc_count 1 00000100:00000040:2.0:1783444588.319301:0:29151:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf5880 x1870073575462528/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.319313:0:29151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575462528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783444588.319346:0:29151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00010000:00000040:2.0:1783444588.319358:0:29151:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575462528 00000100:00000040:2.0:1783444588.319367:0:29151:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444588.319372:0:29151:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.319397:0:29151:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368dd199500 x1870073575462528/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.319418:0:29151:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444588.319423:0:29151:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5880 x1870073575462528/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:209/0 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.319434:0:29151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575462528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444588.319441:0:29151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00000040:2.0:1783444588.319445:0:29151:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368cb781800 : new rpc_count 0 00000020:00000040:2.0:1783444588.319456:0:29151:0:(genops.c:900:class_export_put()) PUTting export ffff9368cb781800 : new refcount 4 00000100:00000040:2.0:1783444588.319491:0:3634:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783444588.319498:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368dd199500 x1870073575462528/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783444588.319509:0:3634:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352788 avail=317085 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:2.0:1783444588.319518:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd199500 x1870073575462528/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.319526:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368dd199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575462528:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1783444588.319535:0:3634:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368dd199500 x1870073575462528/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.319545:0:3634:0:(genops.c:1244:class_import_put()) import ffff9368cab9e800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:2.0:1783444588.320187:0:75662:0:(genops.c:1231:class_import_get()) import ffff9367c3a03800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1783444588.320207:0:75662:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006451a8f7] to pc [ptlrpcd_00_01+1] req@ffff9368eaaf5c00 x1870073575462656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.320243:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1783444588.320254:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf5c00 x1870073575462656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.320279:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575462656:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1783444588.320298:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf5c00 x1870073575462656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444604 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.320305:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.320326:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf4700 x1870073575462656 msgsize 224 00000100:00100000:2.0:1783444588.320332:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444588.320350:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf5c00 x1870073575462656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.320361:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4501 usecs (5 jiffies) 00000100:00100000:2.0:1783444588.320382:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575462656 00000100:00100000:2.0:1783444588.320387:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575462656 00000020:00000040:2.0:1783444588.320389:0:8423:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf55 00000020:00000040:2.0:1783444588.320393:0:8423:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a07800 refcount=5 00000020:00000040:2.0:1783444588.320404:0:8423:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:2.0:1783444588.320423:0:8423:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1783444588.320444:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00000040:2.0:1783444588.320447:0:8423:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c3a07800 : new rpc_count 1 00000100:00000040:2.0:1783444588.320452:0:8423:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf4700 x1870073575462656/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.320463:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575462656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444588.320485:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1783444588.320494:0:8423:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1870073575462656 00000100:00000040:2.0:1783444588.320501:0:8423:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444588.320505:0:8423:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.320524:0:8423:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368eaaf5c00 x1870073575462656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.320544:0:8423:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444588.320556:0:8423:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf4700 x1870073575462656/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:209/0 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.320565:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575462656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444588.320571:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00000040:2.0:1783444588.320574:0:8423:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c3a07800 : new rpc_count 0 00000020:00000040:2.0:1783444588.320581:0:8423:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a07800 : new refcount 4 00000100:00080000:2.0:1783444588.320595:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1783444588.320598:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:2.0:1783444588.320622:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969457 00000100:00000040:2.0:1783444588.320627:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf5c00 x1870073575462656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783444588.320635:0:3633:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1783444588.320638:0:3633:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1783444588.320645:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5c00 x1870073575462656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.320653:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575462656:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1783444588.320682:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf5c00 x1870073575462656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.320692:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367c3a03800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783444588.619382:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368f572d450 x1870073557907456 msgsize 224 00000100:00100000:1.0:1783444588.619396:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444588.619399:0:3626:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783444588.619426:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd108a80 x1870073557907712 msgsize 224 00000100:00100000:1.0:1783444588.619430:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444588.619447:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd10a680 x1870073557907584 msgsize 224 00000100:00100000:1.0:1783444588.619451:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444588.619469:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd10bb80 x1870073557907968 msgsize 224 00000100:00100000:1.0:1783444588.619473:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444588.619494:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd10b800 x1870073557907840 msgsize 520 00000100:00100000:1.0:1783444588.619498:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444588.619527:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557907456 00000100:00100000:1.0:1783444588.619536:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557907456 00000020:00000040:1.0:1783444588.619540:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833679 00000020:00000040:1.0:1783444588.619544:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c6ab4800 refcount=10 00000100:00000040:1.0:1783444588.619566:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783444588.619602:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00000040:1.0:1783444588.619607:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c6ab4800 : new rpc_count 1 00000100:00000040:1.0:1783444588.619614:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f572d450 x1870073557907456/t0(0) o400->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.619627:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557907456:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:1.0:1783444588.619650:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073557907456 00000100:00000040:1.0:1783444588.619661:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444588.619666:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444588.619706:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444588.619723:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f572d450 x1870073557907456/t0(0) o400->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.619732:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557907456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 107us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444588.619739:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00000040:1.0:1783444588.619742:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c6ab4800 : new rpc_count 0 00000020:00000040:1.0:1783444588.619755:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c6ab4800 : new refcount 9 00000100:00100000:1.0:1783444588.619809:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557907968 00000100:00100000:1.0:1783444588.619814:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557907968 00000020:00000040:1.0:1783444588.619815:0:26208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383397b 00000020:00000040:1.0:1783444588.619818:0:26208:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c518e000 refcount=7 00000020:00000040:1.0:1783444588.619827:0:26208:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:1.0:1783444588.619842:0:26208:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1783444588.619860:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557907840 00000100:00100000:1.0:1783444588.619863:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557907840 00000020:00000040:1.0:1783444588.619865:0:26208:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833974 00000100:00100000:1.0:1783444588.619880:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2588 00000100:00000040:1.0:1783444588.619882:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c518e000 : new rpc_count 1 00000100:00000040:1.0:1783444588.619887:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd10bb80 x1870073557907968/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.619899:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557907968:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:1.0:1783444588.619911:0:26208:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073557907968 00000100:00000040:1.0:1783444588.619917:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444588.619921:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444588.619935:0:26208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444588.619940:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd10bb80 x1870073557907968/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.619949:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2404:x1870073557907968:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 52us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444588.619963:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2588 00000100:00000040:1.0:1783444588.619965:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c518e000 : new rpc_count 0 00000020:00000040:1.0:1783444588.619971:0:26208:0:(genops.c:900:class_export_put()) PUTting export ffff9368c518e000 : new refcount 6 00000100:00100000:1.0:1783444588.619980:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5997 00000100:00000040:1.0:1783444588.619984:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd10b800 x1870073557907840/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444608 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.619993:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2400:x1870073557907840:12345-192.168.204.20@tcp:8:kworker.0 00010000:00020000:1.0:1783444588.620018:0:26208:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.204.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1783444588.620030:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444588.620034:0:26208:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444588.620038:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444588.620051:0:26208:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444588.620055:0:26208:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd10b800 x1870073557907840/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783444608 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.620063:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2400:x1870073557907840:12345-192.168.204.20@tcp:8:kworker.0 Request processed in 71us (568us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444588.620069:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5997 00000100:00100000:2.0:1783444588.620587:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557907712 00000100:00100000:2.0:1783444588.620594:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557907712 00000020:00000040:2.0:1783444588.620596:0:66226:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3832bdd 00000020:00000040:2.0:1783444588.620600:0:66226:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368dd20c800 refcount=11 00000020:00000040:2.0:1783444588.620608:0:66226:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000100:00000040:2.0:1783444588.620619:0:66226:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1783444588.620638:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557907584 00000100:00100000:2.0:1783444588.620648:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557907584 00000020:00000040:2.0:1783444588.620650:0:66226:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38335ca 00000020:00000040:2.0:1783444588.620653:0:66226:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c5621800 refcount=51 00000020:00000040:2.0:1783444588.620658:0:66226:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 14 - evictor 00000100:00100000:2.0:1783444588.620680:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1230 00000100:00000040:2.0:1783444588.620682:0:66226:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368dd20c800 : new rpc_count 1 00000100:00000040:2.0:1783444588.620687:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd108a80 x1870073557907712/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.620700:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557907712:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:2.0:1783444588.620717:0:66226:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 77309411468, transno 0, xid 1870073557907712 00000100:00000040:2.0:1783444588.620723:0:66226:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444588.620727:0:66226:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444588.620744:0:66226:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444588.620749:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd108a80 x1870073557907712/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.620758:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2404:x1870073557907712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 60us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444588.620765:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1230 00000100:00000040:2.0:1783444588.624833:0:66226:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368dd20c800 : new rpc_count 0 00000020:00000040:2.0:1783444588.624851:0:66226:0:(genops.c:900:class_export_put()) PUTting export ffff9368dd20c800 : new refcount 10 00000100:00100000:2.0:1783444588.624880:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1231 00000100:00000040:2.0:1783444588.624884:0:66226:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c5621800 : new rpc_count 1 00000100:00000040:2.0:1783444588.624893:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd10a680 x1870073557907584/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.624911:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2404:x1870073557907584:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:2.0:1783444588.624939:0:66226:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1870073557907584 00000100:00000040:2.0:1783444588.624959:0:66226:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444588.624965:0:66226:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444588.625007:0:66226:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444588.625013:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd10a680 x1870073557907584/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.625022:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2404:x1870073557907584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 117us (5572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444588.625030:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1231 00000100:00000040:2.0:1783444588.625032:0:66226:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c5621800 : new rpc_count 0 00000020:00000040:2.0:1783444588.625038:0:66226:0:(genops.c:900:class_export_put()) PUTting export ffff9367c5621800 : new refcount 50 00000100:00080000:2.0:1783444588.625194:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1783444588.625200:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9367c2c63380) now 14 - evictor 00000100:00080000:2.0:1783444588.625204:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1783444588.625207:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000100:00080000:2.0:1783444588.625210:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1783444588.625213:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00010000:00010000:2.0:1783444588.638542:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1783444588.828882:0:93203:0:(pinger.c:229:ptlrpc_pinger_process_import()) c89ab73b-dbb2-4305-b221-37cc64d61227->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444588.828903:0:93203:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444588.828935:0:93203:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c89ab73b-dbb2-4305-b221-37cc64d61227->MGS req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444588.828972:0:93203:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000031e20989] to pc [ptlrpcd_00_02+2] req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.828983:0:75658:0:(genops.c:1231:class_import_get()) import ffff9368f8ca7800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783444588.828994:0:93203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783444588.828998:0:75658:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006451a8f7] to pc [ptlrpcd_00_03+3] req@ffff9368eaaf5c00 x1870073575462912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444588.828999:0:93203:0:(genops.c:1231:class_import_get()) import ffff9367c2faf000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1783444588.829006:0:93203:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1783444588.829015:0:93203:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007631cc11] to pc [ptlrpcd_00_00+0] req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.829113:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.829126:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575463040:0@lo:400:kworker.0 00000100:00000040:1.0:1783444588.829140:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.829150:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575462784:0@lo:400:kworker.0 00000100:00000040:2.0:1783444588.829156:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.829163:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444588.829164:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.829170:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.829205:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf7100 x1870073575463040 msgsize 224 00000100:00000040:1.0:1783444588.829205:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9368f572e050 x1870073575462784 msgsize 224 00000100:00100000:2.0:1783444588.829211:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444588.829211:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444588.829218:0:3635:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783444588.829237:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.829238:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.829252:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7941 usecs (8 jiffies) 00000100:00100000:3.0:1783444588.829288:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575463040 00000100:00100000:3.0:1783444588.829296:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575463040 00000020:00000040:3.0:1783444588.829299:0:66223:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833767 00000020:00000040:3.0:1783444588.829304:0:66223:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368ff64d000 refcount=5 00000020:00000040:3.0:1783444588.829316:0:66223:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 14 - evictor 00000100:00000040:3.0:1783444588.829348:0:66223:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1783444588.829375:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00000040:3.0:1783444588.829379:0:66223:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368ff64d000 : new rpc_count 1 00000100:00000040:3.0:1783444588.829389:0:66223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf7100 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444588.829399:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575463040:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1783444588.829416:0:66223:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575463040 00000100:00000040:3.0:1783444588.829424:0:66223:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:3.0:1783444588.829432:0:66223:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1783444588.829466:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:1.0:1783444588.829471:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf5c00 x1870073575462912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.829479:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575462912:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1783444588.829490:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf5c00 x1870073575462912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.829496:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444588.829510:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd10b480 x1870073575462912 msgsize 224 00000100:00100000:1.0:1783444588.829513:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444588.829525:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf5c00 x1870073575462912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.829532:0:3635:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1784206 usecs (1785 jiffies) 00000100:00000040:0.0:1783444588.829756:0:93203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444588.829775:0:93203:0:(genops.c:1231:class_import_get()) import ffff9367c2faf800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00080000:2.0:1783444588.829778:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1783444588.829783:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9367c2c63380) now 14 - evictor 00000100:00000040:0.0:1783444588.829786:0:93203:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444588.829812:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575462912 00000100:00100000:2.0:1783444588.829815:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575462912 00000100:00000040:0.0:1783444588.829816:0:93203:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b2a305a0] to pc [ptlrpcd_00_01+1] req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.829817:0:8431:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38335c3 00000020:00000040:2.0:1783444588.829820:0:8431:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c5624000 refcount=7 00000100:00080000:0.0:1783444588.829830:0:93203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783444588.829832:0:8431:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00080000:0.0:1783444588.829833:0:93203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783444588.829837:0:93203:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783444588.829841:0:93203:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3574 00000100:00080000:0.0:1783444588.829845:0:93203:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:0.0:1783444588.829848:0:93203:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00100000:2.0:1783444588.829849:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00000040:0.0:1783444588.829850:0:93203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444588.829852:0:8431:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c5624000 : new rpc_count 1 00000020:00000040:0.0:1783444588.829852:0:93203:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf32 00000020:00000040:0.0:1783444588.829855:0:93203:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a05000 refcount=4 00000100:00000040:2.0:1783444588.829856:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd10b480 x1870073575462912/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.829857:0:93203:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:0.0:1783444588.829865:0:93203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00100000:2.0:1783444588.829866:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575462912:12345-0@lo:41:osp-pre-0-1.0 00000020:00000040:0.0:1783444588.829868:0:93203:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a05000 : new refcount 3 00000100:00080000:0.0:1783444588.829871:0:93203:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9367c17bb000 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:0.0:1783444588.829881:0:93203:0:(genops.c:1231:class_import_get()) import ffff9367c17bb000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1783444588.829892:0:93203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00000024:2.0:1783444588.829894:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00000040:0.0:1783444588.829901:0:93203:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007eeec9c4] to pc [ptlrpcd_rcv+-1] req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783444588.829904:0:8431:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870073575462912 00000100:00000040:2.0:1783444588.829908:0:8431:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000100:00000040:2.0:1783444588.829911:0:8431:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444588.829913:0:93203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444588.829918:0:93203:0:(genops.c:1231:class_import_get()) import ffff9368dd118000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1783444588.829923:0:93203:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444588.829929:0:8431:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368eaaf5c00 x1870073575462912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.829932:0:93203:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a089da59] to pc [ptlrpcd_00_02+2] req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444588.829944:0:93203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783444588.829947:0:8431:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00080000:0.0:1783444588.829947:0:93203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783444588.829948:0:93203:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:2.0:1783444588.829951:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd10b480 x1870073575462912/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:209/0 lens 224/368 e 0 to 0 dl 1783444599 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444588.829952:0:93203:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3574 00000100:00080000:0.0:1783444588.829955:0:93203:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:0.0:1783444588.829957:0:93203:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00100000:2.0:1783444588.829960:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575462912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (448us total) trans 0 rc 0/0 00000100:00000040:0.0:1783444588.829960:0:93203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000020:00000040:0.0:1783444588.829962:0:93203:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833610 00000020:00000040:0.0:1783444588.829964:0:93203:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368eb6ff000 refcount=4 00000100:00100000:2.0:1783444588.829967:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00000040:0.0:1783444588.829967:0:93203:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:0.0:1783444588.829969:0:93203:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444588.829970:0:8431:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c5624000 : new rpc_count 0 00000020:00000040:0.0:1783444588.829971:0:93203:0:(genops.c:900:class_export_put()) PUTting export ffff9368eb6ff000 : new refcount 3 00000100:00080000:0.0:1783444588.829973:0:93203:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368cb786800 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:0.0:1783444588.829983:0:93203:0:(genops.c:1231:class_import_get()) import ffff9368cb786800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1783444588.829991:0:93203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1783444588.829994:0:8431:0:(genops.c:900:class_export_put()) PUTting export ffff9367c5624000 : new refcount 6 00000100:00000040:0.0:1783444588.829999:0:93203:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a2fd7778] to pc [ptlrpcd_rcv+-1] req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830007:0:93203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:2.0:1783444588.830011:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444588.830011:0:93203:0:(genops.c:1231:class_import_get()) import ffff9367c5037000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783444588.830017:0:93203:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444588.830021:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575463424:0@lo:400:kworker.0 00000100:00000040:0.0:1783444588.830026:0:93203:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000161e91d5] to pc [ptlrpcd_00_03+3] req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830033:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830034:0:93203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1783444588.830039:0:93203:0:(genops.c:1231:class_import_get()) import ffff9367cae88800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1783444588.830040:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444588.830044:0:93203:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444588.830052:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf7480 x1870073575463424 msgsize 224 00000100:00000040:0.0:1783444588.830053:0:93203:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d46ac527] to pc [ptlrpcd_00_00+0] req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830056:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444588.830063:0:93203:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3584) 00000100:00000040:2.0:1783444588.830067:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830075:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830076:0:3635:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 148075 usecs (149 jiffies) 00000100:00100000:0.0:1783444588.830083:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575463680:0@lo:400:kworker.0 00000100:00000040:2.0:1783444588.830093:0:3635:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:0.0:1783444588.830095:0:3636:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830098:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf5c00 x1870073575462912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830103:0:3636:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000004:00000040:2.0:1783444588.830108:0:3635:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352727 avail=317024 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023568 state=0: rc = 0 00000100:00000040:2.0:1783444588.830115:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5c00 x1870073575462912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830116:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afea00 x1870073575463680 msgsize 224 00000100:00100000:2.0:1783444588.830122:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575462912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444588.830124:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444588.830128:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf5c00 x1870073575462912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.830137:0:3635:0:(genops.c:1244:class_import_put()) import ffff9368f8ca7800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:2.0:1783444588.830157:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575463424 00000100:00100000:2.0:1783444588.830160:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575463424 00000020:00000040:2.0:1783444588.830162:0:66226:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383376e 00000020:00000040:2.0:1783444588.830165:0:66226:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368dd11c000 refcount=5 00000100:00100000:2.0:1783444588.830195:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00000040:2.0:1783444588.830197:0:66226:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368dd11c000 : new rpc_count 1 00000100:00000040:2.0:1783444588.830201:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf7480 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830203:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830212:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575463424:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783444588.830214:0:3636:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7540 usecs (8 jiffies) 00010000:00000040:2.0:1783444588.830222:0:66226:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575463424 00000100:00000040:2.0:1783444588.830227:0:66226:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000100:00000040:2.0:1783444588.830231:0:66226:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783444588.830236:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575463680 00000100:00100000:0.0:1783444588.830239:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575463680 00000020:00000040:0.0:1783444588.830241:0:26206:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833633 00000020:00000040:0.0:1783444588.830243:0:26206:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c5118000 refcount=5 00000100:00000040:2.0:1783444588.830246:0:66226:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444588.830251:0:26206:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:2.0:1783444588.830263:0:66226:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444588.830264:0:26206:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:2.0:1783444588.830267:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf7480 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830274:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1870073575463424:12345-0@lo:400:kworker.0 Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444588.830279:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1783444588.830280:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00000040:0.0:1783444588.830281:0:26206:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c5118000 : new rpc_count 1 00000100:00000040:2.0:1783444588.830283:0:66226:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368dd11c000 : new rpc_count 0 00000100:00000040:0.0:1783444588.830285:0:26206:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afea00 x1870073575463680/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.830288:0:66226:0:(genops.c:900:class_export_put()) PUTting export ffff9368dd11c000 : new refcount 4 00000100:00100000:0.0:1783444588.830296:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575463680:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783444588.830300:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1783444588.830302:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00010000:00000040:0.0:1783444588.830306:0:26206:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969460, transno 0, xid 1870073575463680 00000100:00000040:0.0:1783444588.830310:0:26206:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000100:00000040:0.0:1783444588.830313:0:26206:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.830317:0:3635:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783444588.830321:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830328:0:26206:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830329:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830336:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3635:1870073575463424:0@lo:400:kworker.0 00000100:00000040:2.0:1783444588.830349:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afdf80 x1870073575463424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.830357:0:3635:0:(genops.c:1244:class_import_put()) import ffff9368dd118000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1783444588.830370:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830379:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575463808:0@lo:400:kworker.0 00000100:00000040:2.0:1783444588.830391:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830397:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.830409:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf5c00 x1870073575463808 msgsize 224 00000100:00100000:2.0:1783444588.830413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444588.830425:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830434:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 9760 usecs (10 jiffies) 00000100:00100000:2.0:1783444588.830441:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1783444588.830445:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830453:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575463168:0@lo:400:kworker.0 00000100:00000040:2.0:1783444588.830464:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830469:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.830480:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf7b80 x1870073575463168 msgsize 224 00000100:00100000:2.0:1783444588.830484:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444588.830495:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830504:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7547 usecs (8 jiffies) 00000100:00100000:2.0:1783444588.830517:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575463808 00000100:00100000:2.0:1783444588.830526:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575463808 00000020:00000040:2.0:1783444588.830528:0:67017:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833775 00000020:00000040:2.0:1783444588.830530:0:67017:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c9a14000 refcount=5 00000100:00000040:0.0:1783444588.830539:0:26206:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444588.830544:0:26206:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afea00 x1870073575463680/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830551:0:67017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575463168 00000100:00100000:0.0:1783444588.830552:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575463680:12345-0@lo:400:kworker.0 Request processed in 257us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444588.830553:0:67017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575463168 00000020:00000040:2.0:1783444588.830555:0:67017:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cfda 00000020:00000040:2.0:1783444588.830557:0:67017:0:(lustre_handles.c:147:class_handle2object()) GET export ffff936901db8800 refcount=5 00000100:00100000:0.0:1783444588.830558:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00000040:0.0:1783444588.830561:0:26206:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c5118000 : new rpc_count 0 00000020:00000040:2.0:1783444588.830564:0:67017:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000020:00000040:0.0:1783444588.830567:0:26206:0:(genops.c:900:class_export_put()) PUTting export ffff9368c5118000 : new refcount 4 00000100:00100000:2.0:1783444588.830580:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00000040:2.0:1783444588.830582:0:67017:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c9a14000 : new rpc_count 1 00000100:00000040:2.0:1783444588.830586:0:67017:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf5c00 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830595:0:3636:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969460 00000100:00100000:2.0:1783444588.830596:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575463808:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1783444588.830599:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783444588.830605:0:67017:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575463808 00000100:00000040:0.0:1783444588.830607:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830609:0:67017:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000100:00000040:2.0:1783444588.830612:0:67017:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783444588.830614:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575463680:0@lo:400:kworker.0 00000100:00000040:0.0:1783444588.830619:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3affb80 x1870073575463680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444588.830626:0:3636:0:(genops.c:1244:class_import_put()) import ffff9367c5037000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1783444588.830628:0:67017:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830643:0:67017:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444588.830647:0:67017:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5c00 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.830651:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1783444588.830655:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830656:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575463808:12345-0@lo:400:kworker.0 Request processed in 61us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444588.830662:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00000040:2.0:1783444588.830664:0:67017:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c9a14000 : new rpc_count 0 00000100:00000040:0.0:1783444588.830664:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.830669:0:67017:0:(genops.c:900:class_export_put()) PUTting export ffff9368c9a14000 : new refcount 4 00000100:00100000:0.0:1783444588.830670:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575463808:0@lo:400:kworker.0 00000100:00000040:0.0:1783444588.830675:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afd180 x1870073575463808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830677:0:67017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00000040:2.0:1783444588.830679:0:67017:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff936901db8800 : new rpc_count 1 00000100:00000040:2.0:1783444588.830683:0:67017:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf7b80 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444588.830683:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367cae88800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00100000:2.0:1783444588.830699:0:67017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575463168:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783444588.830708:0:67017:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575463168 00000100:00000040:2.0:1783444588.830712:0:67017:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000100:00000040:2.0:1783444588.830715:0:67017:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444588.830730:0:67017:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.830751:0:67017:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444588.830756:0:67017:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf7b80 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.830756:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.830776:0:67017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1870073575463168:12345-0@lo:400:kworker.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444588.830777:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575463296:0@lo:8:kworker.0 00000100:00100000:2.0:1783444588.830782:0:67017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00000040:2.0:1783444588.830785:0:67017:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff936901db8800 : new rpc_count 0 00000020:00000040:2.0:1783444588.830808:0:67017:0:(genops.c:900:class_export_put()) PUTting export ffff936901db8800 : new refcount 4 00000100:00080000:2.0:1783444588.830824:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1783444588.830827:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000100:00000040:1.0:1783444588.830833:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444613 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.830841:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444588.830855:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd109f80 x1870073575463296 msgsize 520 00000100:00100000:1.0:1783444588.830859:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444588.830878:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444613 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.830887:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 4166 usecs (5 jiffies) 00000100:00000040:1.0:1783444588.830892:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.830911:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575463552:0@lo:8:kworker.0 00000100:00000040:1.0:1783444588.830922:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444613 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.830928:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444588.830940:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd109c00 x1870073575463552 msgsize 520 00000100:00100000:1.0:1783444588.830943:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444588.830953:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444613 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.830961:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7913 usecs (8 jiffies) 00000100:00100000:2.0:1783444588.831079:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575463296 00000100:00100000:2.0:1783444588.831083:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575463296 00000020:00000040:2.0:1783444588.831085:0:26203:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf47 00000100:00100000:2.0:1783444588.831157:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575463552 00000100:00100000:2.0:1783444588.831161:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575463552 00000020:00000040:2.0:1783444588.831162:0:26203:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833617 00000100:00100000:1.0:1783444588.831214:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5998 00000100:00000040:0.0:1783444588.831219:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1783444588.831220:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd109f80 x1870073575463296/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444608 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444588.831223:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.831229:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3632:x1870073575463296:12345-0@lo:8:kworker.0 00000100:00000040:0.0:1783444588.831232:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444588.831237:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1870073575463168:0@lo:400:kworker.0 00010000:00020000:1.0:1783444588.831246:0:26200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1783444588.831249:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3aff100 x1870073575463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.831255:0:26200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000020:00000040:0.0:1783444588.831256:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367c2faf800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1783444588.831258:0:26200:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000100:00000040:1.0:1783444588.831261:0:26200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444588.831282:0:26200:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444613 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.831304:0:26200:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444588.831308:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd109f80 x1870073575463296/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783444608 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.831315:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3632:x1870073575463296:12345-0@lo:8:kworker.0 Request processed in 86us (458us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444588.831320:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5998 00000100:00100000:1.0:1783444588.831333:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5999 00000100:00000040:1.0:1783444588.831342:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd109c00 x1870073575463552/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444608 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.831351:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3632:x1870073575463552:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783444588.831362:0:26200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1783444588.831370:0:26200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000100:00000040:1.0:1783444588.831372:0:26200:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000100:00000040:1.0:1783444588.831375:0:26200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444588.831389:0:26200:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444613 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.831402:0:26200:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444588.831405:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd109c00 x1870073575463552/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783444608 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.831412:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3632:x1870073575463552:12345-0@lo:8:kworker.0 Request processed in 62us (471us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783444588.831417:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5999 00000100:00000040:0.0:1783444588.831526:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444613 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444588.831715:0:66223:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444588.831753:0:66223:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:3.0:1783444588.831761:0:66223:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf7100 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444588.831784:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1870073575463040:12345-0@lo:400:kworker.0 Request processed in 2384us (2576us total) trans 0 rc 0/0 00000100:00000040:2.0:1783444588.831785:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00100000:3.0:1783444588.831813:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00000040:3.0:1783444588.831816:0:66223:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368ff64d000 : new rpc_count 0 00000020:00000040:3.0:1783444588.831827:0:66223:0:(genops.c:900:class_export_put()) PUTting export ffff9368ff64d000 : new refcount 4 00000100:00000040:2.0:1783444588.831873:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444588.831882:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444588.831901:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1870073575463040:0@lo:400:kworker.0 00000100:00000040:2.0:1783444588.831907:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368f9bc6d80 x1870073575463040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444588.831916:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367c2faf000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1783444588.831970:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575462784 00000100:00100000:1.0:1783444588.831974:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575462784 00000020:00000040:1.0:1783444588.831976:0:94360:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:1.0:1783444588.831980:0:94360:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=21 00000100:00000040:1.0:1783444588.831992:0:94360:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783444588.832012:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:1.0:1783444588.832015:0:94360:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:1.0:1783444588.832020:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f572e050 x1870073575462784/t0(0) o400->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:209/0 lens 224/0 e 0 to 0 dl 1783444599 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.832030:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3635:x1870073575462784:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783444588.832041:0:94360:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575462784 00000100:00000040:1.0:1783444588.832046:0:94360:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444588.832054:0:94360:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444588.832076:0:94360:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444588.832097:0:94360:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444588.832101:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f572e050 x1870073575462784/t0(0) o400->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:209/0 lens 224/224 e 0 to 0 dl 1783444599 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.832110:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:3635:x1870073575462784:12345-0@lo:400:kworker.0 Request processed in 80us (2902us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444588.832117:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:1.0:1783444588.832120:0:94360:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:1.0:1783444588.832130:0:94360:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 20 00000100:00000040:3.0:1783444588.832138:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444588.832149:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444588.832158:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575462784:0@lo:400:kworker.0 00000100:00000040:3.0:1783444588.832165:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368f9bc7100 x1870073575462784/t0(0) o400->MGC192.168.204.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783444588.832174:0:3635:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000100:00080000:0.0:1783444588.832327:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783444588.832400:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:0.0:1783444588.832407:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444613 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444588.832414:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575463296:0@lo:8:kworker.0 00000100:00000040:1.0:1783444588.832942:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444613 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783444588.832952:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783444588.832955:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1783444588.832959:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444613 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444588.832966:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575463552:0@lo:8:kworker.0 00000100:00000040:1.0:1783444588.832972:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afdc00 x1870073575463296/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444613 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444588.832981:0:3632:0:(genops.c:1244:class_import_put()) import ffff9367c17bb000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1783444588.832992:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afe680 x1870073575463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444613 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444588.832998:0:3632:0:(genops.c:1244:class_import_put()) import ffff9368cb786800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:0.0:1783444589.345458:0:94375:0:(genops.c:1231:class_import_get()) import ffff9367c5037000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1783444589.345499:0:94375:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b2a305a0] to pc [ptlrpcd_00_01+1] req@ffff9367c3aff100 x1870073575463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444589.345556:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1783444589.345571:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3aff100 x1870073575463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444589.345585:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575463936:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1783444589.345614:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3aff100 x1870073575463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444605 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444589.345621:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444589.345660:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afd180 x1870073575463936 msgsize 224 00000100:00100000:0.0:1783444589.345665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444589.345686:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3aff100 x1870073575463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444605 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444589.345698:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7318 usecs (8 jiffies) 00000100:00100000:0.0:1783444589.345721:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575463936 00000100:00100000:0.0:1783444589.345735:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575463936 00000020:00000040:0.0:1783444589.345738:0:13537:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833633 00000020:00000040:0.0:1783444589.345742:0:13537:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c5118000 refcount=5 00000100:00000040:0.0:1783444589.345776:0:13537:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1783444589.345826:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00000040:0.0:1783444589.345830:0:13537:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c5118000 : new rpc_count 1 00000100:00000040:0.0:1783444589.345836:0:13537:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afd180 x1870073575463936/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:210/0 lens 224/0 e 0 to 0 dl 1783444600 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444589.345848:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575463936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783444589.345870:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1783444589.345883:0:13537:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969460, transno 0, xid 1870073575463936 00000100:00000040:0.0:1783444589.345894:0:13537:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444589.345898:0:13537:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444589.345916:0:13537:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9367c3aff100 x1870073575463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444605 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444589.345934:0:13537:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:0.0:1783444589.345939:0:13537:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afd180 x1870073575463936/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:210/0 lens 224/368 e 0 to 0 dl 1783444600 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444589.345947:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575463936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444589.345954:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00000040:0.0:1783444589.345957:0:13537:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c5118000 : new rpc_count 0 00000020:00000040:0.0:1783444589.345965:0:13537:0:(genops.c:900:class_export_put()) PUTting export ffff9368c5118000 : new refcount 4 00000100:00000040:0.0:1783444589.345996:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969460 00000100:00000040:0.0:1783444589.346002:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3aff100 x1870073575463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1783444589.346011:0:3633:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1783444589.346014:0:3633:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1783444589.346029:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3aff100 x1870073575463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444605 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444589.346037:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575463936:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1783444589.346043:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3aff100 x1870073575463936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444605 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444589.346054:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367c5037000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:1.0:1783444589.661354:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783444589.909950:0:96931:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783444589.909955:0:96931:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783444589.909956:0:96931:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1783444589.910063:0:96931:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9367c17b3000 00000020:01000004:0.0:1783444589.910081:0:96931:0:(tgt_mount.c:2501:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783444589.910097:0:96931:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783444589.910111:0:96931:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9367c1e819c0) 00000020:00000040:0.0:1783444589.910119:0:96931:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368f9916000 with handle 0x42cb6883e3834552 to hash 00000020:00000040:0.0:1783444589.910125:0:96931:0:(genops.c:900:class_export_put()) PUTting export ffff9368f9916000 : new refcount 1 00000020:00000040:0.0:1783444589.910134:0:96931:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9367c1e819c0) now 2 - obd_device_list 00000020:00000080:0.0:1783444589.910139:0:96931:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000001:00000040:0.0:1783444590.470414:0:96931:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:0.0:1783444590.490447:0:96931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783444590.490608:0:96931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783444590.490636:0:96931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1783444590.490661:0:96931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783444590.490689:0:96931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783444590.491509:0:96931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783444590.491541:0:96931:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1783444590.495561:0:96931:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:0.0:1783444590.497498:0:96931:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9367c1e819c0) now 3 - setup 00000020:00000080:0.0:1783444590.497506:0:96931:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783444590.497530:0:96931:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000040:0.0:1783444590.497536:0:96931:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368f9911000 with handle 0x42cb6883e3834559 to hash 00000020:00000040:0.0:1783444590.497543:0:96931:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9367c1e819c0) now 4 - export 00000020:00000040:0.0:1783444590.497546:0:96931:0:(genops.c:900:class_export_put()) PUTting export ffff9368f9911000 : new refcount 1 00000020:00000080:0.0:1783444590.497549:0:96931:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42cb6883e3834559 00000020:00000040:0.0:1783444590.497551:0:96931:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3834559 00000020:00000040:0.0:1783444590.497553:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368f9911000 refcount=2 00000020:01000004:0.0:1783444590.497560:0:96931:0:(tgt_mount.c:2586:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783444590.497583:0:96931:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783444590.497587:0:96931:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783444590.497593:0:96931:0:(tgt_mount.c:1810:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783444590.497623:0:96931:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783444590.497627:0:96931:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:0.0:1783444590.499195:0:96931:0:(genops.c:889:class_export_get()) GET export ffff9368f9916000 refcount=2 00000040:00000040:0.0:1783444590.499203:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c403d780 : new refcount 2 00000040:00000040:0.0:1783444590.501380:0:96931:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c403d780 : new refcount 1 00000040:01000000:0.0:1783444590.501387:0:96931:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 10000000:00000040:0.0:1783444590.501391:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c403d780 : new refcount 2 10000000:00000040:0.0:1783444590.501393:0:96931:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c403d780 : new refcount 1 00000020:00000040:0.0:1783444590.501397:0:96931:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.120@tcp (ffff9368c507b380) now 6 - mgc_fs 00000020:01000004:0.0:1783444590.501431:0:96931:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1783444590.501436:0:96931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783444590.501438:0:96931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783444590.501439:0:96931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444590.501441:0:96931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444590.501442:0:96931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444590.501443:0:96931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444590.501445:0:96931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444590.501447:0:96931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444590.501448:0:96931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783444590.501452:0:96931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1783444590.501454:0:96931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783444590.501455:0:96931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783444590.501456:0:96931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444590.501463:0:96931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444590.501464:0:96931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444590.501465:0:96931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444590.501466:0:96931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444590.501467:0:96931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444590.501468:0:96931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:0.0:1783444590.501474:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 10000000:01000000:0.0:1783444590.501498:0:96931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:0.0:1783444590.501517:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3aff100 x1870073575464064/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.501531:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3aff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464064:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1783444590.501560:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3aff100 x1870073575464064/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.501569:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.501615:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368f572c450 x1870073575464064 msgsize 4848 00000100:00100000:0.0:1783444590.501620:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.501622:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.501640:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3aff100 x1870073575464064/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.501670:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444590.504244:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575464064 00000100:00100000:1.0:1783444590.504274:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575464064 00000020:00000040:1.0:1783444590.504278:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:1.0:1783444590.504284:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=21 00000100:00000040:1.0:1783444590.504311:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783444590.504351:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1783444590.504356:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:1.0:1783444590.504363:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f572c450 x1870073575464064/t0(0) o253->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 4848/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.504376:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:96931:x1870073575464064:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783444590.504410:0:94365:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783444590.504413:0:94365:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783444590.504417:0:94365:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:1.0:1783444590.504778:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575464064 00000100:00000040:1.0:1783444590.504816:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444590.504822:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.504874:0:94365:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9367c3aff100 x1870073575464064/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.504902:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444590.504908:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f572c450 x1870073575464064/t0(0) o253->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 4848/4768 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.504917:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:96931:x1870073575464064:12345-0@lo:253:mount.lustre.0 Request processed in 543us (3300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.504925:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1783444590.504928:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:1.0:1783444590.504940:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 20 00000100:00000040:2.0:1783444590.505141:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3aff100 x1870073575464064/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.505152:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3aff100 x1870073575464064/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.505159:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3aff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464064:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1783444590.505169:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3aff100 x1870073575464064/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783444590.505180:0:96931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783444590.505184:0:96931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783444590.505186:0:96931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783444590.505187:0:96931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783444590.505188:0:96931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783444590.505190:0:96931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783444590.505191:0:96931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783444590.505192:0:96931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783444590.505194:0:96931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783444590.505196:0:96931:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:2.0:1783444590.505200:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3aff100 x1870073575464064/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.505212:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000020:01000004:2.0:1783444590.505234:0:96931:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9367c17b3000 from lustre-OST0000 10000000:01000000:2.0:1783444590.505266:0:96931:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783444590.505269:0:96931:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:2.0:1783444590.505277:0:96931:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff9368eb706200) refs 5 10000000:01000000:2.0:1783444590.505288:0:96931:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9368c507b380 local copy 00000020:00000040:2.0:1783444590.505291:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c6d70600 refcount=2 00010000:00010000:2.0:1783444590.505299:0:96931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:2.0:1783444590.505327:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9368caa40300 : new refcount 2 10000000:00000040:2.0:1783444590.505329:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c403d780 : new refcount 2 10000000:00000040:2.0:1783444590.505332:0:96931:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.120@tcp: copy local log lustre-sptlrpc 00000020:00000040:2.0:1783444590.505380:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:2.0:1783444590.505386:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:2.0:1783444590.505428:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.505441:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464192:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1783444590.505462:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.505470:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.505490:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368f572fc50 x1870073575464192 msgsize 512 00000100:00100000:2.0:1783444590.505494:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.505496:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 62 buffers still posted 00000100:00000040:2.0:1783444590.505517:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.505542:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575464192 00000100:00100000:2.0:1783444590.505546:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575464192 00000020:00000040:2.0:1783444590.505548:0:94360:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:2.0:1783444590.505551:0:94360:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=21 00000100:00000040:2.0:1783444590.505563:0:94360:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783444590.505583:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:2.0:1783444590.505586:0:94360:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:2.0:1783444590.505590:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f572fc50 x1870073575464192/t0(0) o501->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 512/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.505613:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:96931:x1870073575464192:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1783444590.505627:0:94360:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:2.0:1783444590.505631:0:94360:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:2.0:1783444590.505652:0:94360:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:2.0:1783444590.505656:0:94360:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575464192 00000100:00000040:2.0:1783444590.505661:0:94360:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444590.505664:0:94360:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.505681:0:94360:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.505709:0:94360:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444590.505714:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f572fc50 x1870073575464192/t0(0) o501->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 512/272 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.505722:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f572fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+21:96931:x1870073575464192:12345-0@lo:501:mount.lustre.0 Request processed in 111us (231us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783444590.505729:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:2.0:1783444590.505741:0:94360:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:2.0:1783444590.505748:0:94360:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 20 00000100:00100000:2.0:1783444590.505811:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0f90d80 going to sleep for 11 seconds 00000100:00000040:2.0:1783444590.505826:0:96931:0:(client.c:1497:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.505834:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.505842:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.505848:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464192:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1783444590.505861:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.505870:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000100:00000040:2.0:1783444590.505873:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf4a80 x1870073575464192/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.505880:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 10000000:01000000:2.0:1783444590.505886:0:96931:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783444590.505904:0:96931:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:2.0:1783444590.505908:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c6d70600 refcount=3 00010000:00010000:2.0:1783444590.505913:0:96931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.505922:0:96931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444590.505966:0:96931:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9367c17b3000 10000000:01000000:2.0:1783444590.505972:0:96931:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:2.0:1783444590.505976:0:96931:0:(genops.c:889:class_export_get()) GET export ffff9368eb770000 refcount=18 10000000:00000040:2.0:1783444590.505980:0:96931:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff9368c59cfa00) refs 4 10000000:01000000:2.0:1783444590.505982:0:96931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783444590.505986:0:96931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1783444590.505988:0:96931:0:(genops.c:889:class_export_get()) GET export ffff9368eb770000 refcount=19 10000000:01000000:2.0:1783444590.505993:0:96931:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783444590.505996:0:96931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:2.0:1783444590.506415:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00010000:00000040:2.0:1783444590.506433:0:96931:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368f575fa00 count: 8 00000020:00000040:2.0:1783444590.506441:0:96931:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368f5757c00 with handle 0x42cb6883e3834560 to hash 00010000:00010000:2.0:1783444590.506448:0:96931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e3834560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.506466:0:96931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e3834560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.506476:0:96931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e3834560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444590.506490:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf4a80 x1870073575464320/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.506500:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464320:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1783444590.506513:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf4a80 x1870073575464320/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.506520:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.506538:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9367c54d4850 x1870073575464320 msgsize 328 00000100:00100000:2.0:1783444590.506542:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.506544:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 62 buffers still posted 00000100:00000040:2.0:1783444590.506569:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9368eaaf4a80 x1870073575464320/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.506587:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368d0f90d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783444590.506658:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575464320 00000100:00100000:1.0:1783444590.506663:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575464320 00000020:00000040:1.0:1783444590.506665:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:1.0:1783444590.506668:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=21 00000100:00000040:1.0:1783444590.506685:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783444590.506769:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:1.0:1783444590.506772:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:1.0:1783444590.506777:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c54d4850 x1870073575464320/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.506805:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c54d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+21:96931:x1870073575464320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783444590.506816:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1783444590.506824:0:94365:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368f57c6400 count: 10 00000020:00000040:1.0:1783444590.506830:0:94365:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367c583f400 with handle 0x42cb6883e3834567 to hash 00010000:00010000:1.0:1783444590.506834:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c583f400/0x42cb6883e3834567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3834560 expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506841:0:94365:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9367c229a800 : new locks_count 16 00000020:00000040:1.0:1783444590.506843:0:94365:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=22 00010000:00000040:1.0:1783444590.506860:0:94365:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9368f57c6400) refcount = 10 00010000:00000040:1.0:1783444590.506863:0:94365:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1783444590.506867:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7645600/0x42cb6883e3833b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b50 expref: 22 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506875:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c583f200/0x42cb6883e3833b2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b26 expref: 22 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506880:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c583e000/0x42cb6883e3833b1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b18 expref: 22 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506886:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7644800/0x42cb6883e3833b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b0a expref: 22 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506892:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c6d71400/0x42cb6883e3833b03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833afc expref: 22 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506909:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7645000/0x42cb6883e3833af5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833aee expref: 22 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506916:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833ae0 expref: 22 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506925:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c6c26400/0x42cb6883e3833ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e69 expref: 9 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.506931:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7644600/0x42cb6883e3833ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e62 expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.506937:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c583f400/0x42cb6883e3834567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3834560 expref: 22 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.507408:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c583f400/0x42cb6883e3834567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3834560 expref: 22 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.507417:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c583f400, rc 0) 00010000:00000040:1.0:1783444590.507421:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575464320 00000100:00000040:1.0:1783444590.507428:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444590.507433:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.507456:0:94365:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9368eaaf4a80 x1870073575464320/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.507484:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444590.507489:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c54d4850 x1870073575464320/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/344 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.507497:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c54d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464320:12345-0@lo:101:mount.lustre.0 Request processed in 711us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.507512:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:1.0:1783444590.507514:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:1.0:1783444590.507525:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 21 00000100:00000040:2.0:1783444590.507675:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf4a80 x1870073575464320/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.507686:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf4a80 x1870073575464320/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.507782:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464320:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1783444590.507872:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf4a80 x1870073575464320/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.507883:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368f5757c00 refcount=4 00010000:00000040:2.0:1783444590.507894:0:96931:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9368f5757c00, remote cookie: 0x42cb6883e3834567, flags: 0x0 00010000:00000040:2.0:1783444590.507899:0:96931:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9368f575fa00) refcount = 8 00010000:00000040:2.0:1783444590.507901:0:96931:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783444590.507903:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.507910:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.507916:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.507921:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.507927:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.507933:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833af5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.507939:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833ae7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.508241:0:96931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e3834560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3834567 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.508252:0:96931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e3834560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3834567 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444590.508262:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf4a80 x1870073575464320/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.508283:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 10000000:00000040:2.0:1783444590.508292:0:96931:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff9367c7640a00) refs 2 00000020:00000040:2.0:1783444590.508295:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368f5757c00 refcount=3 10000000:00000040:0.0:1783444590.508415:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9368caa40300 : new refcount 2 10000000:00000040:0.0:1783444590.508419:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c403d780 : new refcount 2 10000000:00000040:0.0:1783444590.508422:0:96931:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.120@tcp: copy local log lustre-OST0000 00000040:00080000:0.0:1783444590.508583:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783444590.509328:0:96931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783444590.511917:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783444590.512230:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783444590.512251:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783444590.512275:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783444590.512292:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783444590.512355:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783444590.512386:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783444590.512401:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:0.0:1783444590.512479:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.512486:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.512529:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3affb80 x1870073575464448/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.512543:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3affb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464448:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783444590.512568:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3affb80 x1870073575464448/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.512577:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.512615:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9367c54d7450 x1870073575464448 msgsize 512 00000100:00100000:0.0:1783444590.512620:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.512622:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.512786:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3affb80 x1870073575464448/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.512840:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783444590.512898:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575464448 00000100:00100000:2.0:1783444590.512907:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575464448 00000020:00000040:2.0:1783444590.512910:0:94359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:2.0:1783444590.512915:0:94359:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=22 00000100:00000040:2.0:1783444590.512937:0:94359:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783444590.513011:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1783444590.513016:0:94359:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:2.0:1783444590.513022:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c54d7450 x1870073575464448/t0(0) o501->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 512/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.513034:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c54d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464448:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1783444590.513054:0:94359:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:2.0:1783444590.513057:0:94359:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:2.0:1783444590.513129:0:94359:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00000020:00000040:2.0:1783444590.513138:0:94359:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=23 00000020:00000040:2.0:1783444590.513141:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00010000:00000040:2.0:1783444590.513145:0:94359:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575464448 00000100:00000040:2.0:1783444590.513154:0:94359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444590.513159:0:94359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.513178:0:94359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9367c3affb80 x1870073575464448/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.513209:0:94359:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444590.513213:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c54d7450 x1870073575464448/t0(0) o501->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 512/272 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.513221:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c54d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464448:12345-0@lo:501:mount.lustre.0 Request processed in 189us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.513237:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1783444590.513241:0:94359:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:2.0:1783444590.513250:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 21 00000100:00000040:1.0:1783444590.513326:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3affb80 x1870073575464448/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.513337:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3affb80 x1870073575464448/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.513345:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3affb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464448:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1783444590.513352:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3affb80 x1870073575464448/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.513361:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000100:00000040:1.0:1783444590.513365:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3affb80 x1870073575464448/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.513373:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.513383:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.513387:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:1.0:1783444590.513401:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a9180 x1870073575464576/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.513409:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464576:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1783444590.513435:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a9180 x1870073575464576/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.513442:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.513459:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9367c338a450 x1870073575464576 msgsize 272 00000100:00100000:1.0:1783444590.513462:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444590.513464:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783444590.514259:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9368eb7a9180 x1870073575464576/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.514281:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dd1d93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444590.514362:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575464576 00000100:00100000:0.0:1783444590.514368:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575464576 00000020:00000040:0.0:1783444590.514370:0:94361:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444590.514374:0:94361:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=22 00000100:00000040:0.0:1783444590.514393:0:94361:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444590.514417:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:0.0:1783444590.514421:0:94361:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444590.514425:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c338a450 x1870073575464576/t0(0) o503->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.514435:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c338a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464576:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1783444590.514460:0:94361:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:0.0:1783444590.514536:0:94361:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:0.0:1783444590.514540:0:94361:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575464576 00000100:00000040:0.0:1783444590.514552:0:94361:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444590.514556:0:94361:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.514580:0:94361:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9368eb7a9180 x1870073575464576/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.514599:0:94361:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:0.0:1783444590.514604:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c338a450 x1870073575464576/t0(0) o503->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8416 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.514611:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c338a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464576:12345-0@lo:503:mount.lustre.0 Request processed in 177us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444590.514628:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:0.0:1783444590.514630:0:94361:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:0.0:1783444590.514638:0:94361:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 21 00000100:00000040:0.0:1783444590.514678:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a9180 x1870073575464576/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.514686:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9180 x1870073575464576/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.514829:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464576:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1783444590.514837:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a9180 x1870073575464576/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.514851:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a9180 x1870073575464576/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.514864:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.514870:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:0.0:1783444590.515377:0:96931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1783444590.515434:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.515441:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.515464:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3aff800 x1870073575464704/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.515484:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3aff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464704:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783444590.515510:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3aff800 x1870073575464704/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.515518:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.515542:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3389050 x1870073575464704 msgsize 272 00000100:00100000:0.0:1783444590.515545:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.515547:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.515567:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3aff800 x1870073575464704/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.515592:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575464704 00000100:00100000:0.0:1783444590.515597:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575464704 00000020:00000040:0.0:1783444590.515599:0:94361:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444590.515602:0:94361:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=22 00000100:00000040:0.0:1783444590.515614:0:94361:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444590.515630:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1783444590.515633:0:94361:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444590.515638:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3389050 x1870073575464704/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.515649:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464704:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1783444590.515672:0:94361:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000100:00100000:1.0:1783444590.516433:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e69c0240 going to sleep for 11 seconds 00000040:00000040:0.0:1783444590.516527:0:94361:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:0.0:1783444590.516533:0:94361:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575464704 00000100:00000040:0.0:1783444590.516543:0:94361:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444590.516608:0:94361:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.516638:0:94361:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9367c3aff800 x1870073575464704/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.516767:0:94361:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:0.0:1783444590.516780:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3389050 x1870073575464704/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8472 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.516804:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3389050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464704:12345-0@lo:502:mount.lustre.0 Request processed in 1141us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444590.516812:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1783444590.516815:0:94361:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:0.0:1783444590.516827:0:94361:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 21 00000100:00000040:1.0:1783444590.517366:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3aff800 x1870073575464704/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.517377:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3aff800 x1870073575464704/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.517384:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3aff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464704:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783444590.517392:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3aff800 x1870073575464704/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.517406:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3aff800 x1870073575464704/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.517421:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.517428:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:1.0:1783444590.517645:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783444590.517679:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783444590.518970:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783444590.519150:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783444590.519170:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783444590.519184:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783444590.519198:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783444590.519210:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783444590.519220:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1783444590.519232:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1783444590.519243:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1783444590.519255:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:1.0:1783444590.519263:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.519270:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:1.0:1783444590.519313:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a9c00 x1870073575464832/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.519326:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464832:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783444590.519360:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a9c00 x1870073575464832/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.519368:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.519405:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9367c338b450 x1870073575464832 msgsize 272 00000100:00100000:1.0:1783444590.519410:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444590.519412:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783444590.519486:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9368eb7a9c00 x1870073575464832/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.522833:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dd1d93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444590.523262:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575464832 00000100:00100000:0.0:1783444590.523274:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575464832 00000020:00000040:0.0:1783444590.523277:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444590.523283:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=22 00000100:00000040:0.0:1783444590.523317:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444590.523355:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1783444590.523361:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444590.523369:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c338b450 x1870073575464832/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.523383:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c338b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464832:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1783444590.523425:0:94365:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:0.0:1783444590.523483:0:94365:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:0.0:1783444590.523488:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575464832 00000100:00000040:0.0:1783444590.523498:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444590.523503:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.523553:0:94365:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9368eb7a9c00 x1870073575464832/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.523785:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:0.0:1783444590.523810:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c338b450 x1870073575464832/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8472 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.523820:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c338b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464832:12345-0@lo:502:mount.lustre.0 Request processed in 439us (4413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444590.523835:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1783444590.523838:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:0.0:1783444590.523850:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 21 00000100:00000040:1.0:1783444590.526267:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a9c00 x1870073575464832/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.526285:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9c00 x1870073575464832/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.526293:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464832:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783444590.526303:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a9c00 x1870073575464832/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.526319:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a9c00 x1870073575464832/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.526343:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.526354:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:1.0:1783444590.526421:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1783444590.526436:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:1.0:1783444590.527373:0:96931:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9368caa40300 : new refcount 1 00000020:00000040:1.0:1783444590.527381:0:96931:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:3.0:1783444590.528131:0:96935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783444590.528139:0:96935:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783444590.528151:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783444590.528153:0:96935:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783444590.528160:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783444590.528174:0:96935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9367c7250000) 00000020:00000040:3.0:1783444590.528181:0:96935:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367c2299000 with handle 0x42cb6883e383456e to hash 00000020:00000040:3.0:1783444590.528189:0:96935:0:(genops.c:900:class_export_put()) PUTting export ffff9367c2299000 : new refcount 1 00000020:00000040:3.0:1783444590.528204:0:96935:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 2 - obd_device_list 00000020:00000080:3.0:1783444590.528210:0:96935:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:3.0:1783444590.528216:0:96935:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:3.0:1783444590.528218:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783444590.528286:0:96935:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9367c17b3000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783444590.528293:0:96935:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000040:3.0:1783444590.528297:0:96935:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367cae8e000 with handle 0x42cb6883e3834575 to hash 00000020:00000040:3.0:1783444590.528302:0:96935:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9367c1e819c0) now 5 - export 00000020:00000040:3.0:1783444590.528304:0:96935:0:(genops.c:900:class_export_put()) PUTting export ffff9367cae8e000 : new refcount 1 00000020:00000080:3.0:1783444590.528306:0:96935:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42cb6883e3834575 00000020:00000040:3.0:1783444590.528308:0:96935:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3834575 00000020:00000040:3.0:1783444590.528310:0:96935:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367cae8e000 refcount=2 00010000:00010000:3.0:1783444590.534596:0:96935:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:3.0:1783444590.534606:0:96935:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 563, crc32c 6403, adler 434, t10ip512 4159, t10ip4k 3643, t10crc512 737, t10crc4k 671 00002000:00000040:3.0:1783444590.534647:0:96935:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:3.0:1783444590.535164:0:96935:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969453: rc = 0 00000001:00000040:3.0:1783444590.535170:0:96935:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:3.0:1783444590.535179:0:96935:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294969442, last_xid = 1870073574915584, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783444590.535183:0:96935:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294969442 srv lr: 4294969453 lx: 1870073574915584 gen 0 00000020:00000040:3.0:1783444590.535191:0:96935:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367cae88000 with handle 0x42cb6883e383457c to hash 00000020:00000040:3.0:1783444590.535226:0:96935:0:(genops.c:889:class_export_get()) GET export ffff9367cae88000 refcount=3 00000020:00000040:3.0:1783444590.535232:0:96935:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 3 - export 00000001:00000040:3.0:1783444590.535243:0:96935:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1783444590.535247:0:96935:0:(genops.c:900:class_export_put()) PUTting export ffff9367cae88000 : new refcount 2 00000001:00000040:3.0:1783444590.535253:0:96935:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294969471, last_xid = 1870073575449088, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783444590.535257:0:96935:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294969471 srv lr: 4294969453 lx: 1870073575449088 gen 0 00000020:00000040:3.0:1783444590.535263:0:96935:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368c9a17800 with handle 0x42cb6883e3834583 to hash 00000020:00000040:3.0:1783444590.535274:0:96935:0:(genops.c:889:class_export_get()) GET export ffff9368c9a17800 refcount=3 00000020:00000040:3.0:1783444590.535277:0:96935:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 4 - export 00000001:00000040:3.0:1783444590.535279:0:96935:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1783444590.535281:0:96935:0:(genops.c:900:class_export_put()) PUTting export ffff9368c9a17800 : new refcount 2 00000001:00000040:3.0:1783444590.535284:0:96935:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = 08efc25c-17e5-4d29-97d2-f1505f195a06, last_transno = 4294969475, last_xid = 1870073557872256, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1783444590.535288:0:96935:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 08efc25c-17e5-4d29-97d2-f1505f195a06 idx: 2 lr: 4294969475 srv lr: 4294969453 lx: 1870073557872256 gen 0 00000020:00000040:3.0:1783444590.535292:0:96935:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367c17cd800 with handle 0x42cb6883e383458a to hash 00000020:00000040:3.0:1783444590.535301:0:96935:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=3 00000020:00000040:3.0:1783444590.535303:0:96935:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 5 - export 00000001:00000040:3.0:1783444590.535305:0:96935:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID '08efc25c-17e5-4d29-97d2-f1505f195a06' added, generation 0 00000020:00000040:3.0:1783444590.535307:0:96935:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 2 00000001:00000040:3.0:1783444590.535311:0:96935:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:3.0:1783444590.535314:0:96935:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:3.0:1783444590.535318:0:96935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294969475 00000001:00000040:3.0:1783444590.535361:0:96935:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969475: rc = 0 00000001:00000040:3.0:1783444590.535372:0:96935:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969475: rc = 0 00002000:00000040:3.0:1783444590.535385:0:96935:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:3.0:1783444590.535418:0:96935:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:3.0:1783444590.535469:0:96935:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:3.0:1783444590.535480:0:96935:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:3.0:1783444590.535487:0:96935:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:3.0:1783444590.535524:0:96935:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:3.0:1783444590.535531:0:96935:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:3.0:1783444590.535569:0:96935:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:3.0:1783444590.535585:0:96935:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:3.0:1783444590.535622:0:96935:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:3.0:1783444590.535675:0:96935:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:3.0:1783444590.536549:0:96935:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:3.0:1783444590.537248:0:96935:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:3.0:1783444590.537504:0:96935:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:0.0:1783444590.538571:0:96935:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 6 - setup 00000020:00000080:0.0:1783444590.538576:0:96935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783444590.538587:0:96935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444590.538594:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444590.538597:0:96935:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783444590.538600:0:96935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783444590.538603:0:96935:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1783444590.538604:0:96935:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444590.538606:0:96935:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783444590.538608:0:96935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783444590.538610:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444590.538612:0:96935:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783444590.538614:0:96935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444590.538617:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444590.538619:0:96935:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783444590.538621:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783444590.538623:0:96935:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783444590.538626:0:96935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444590.538628:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444590.538629:0:96935:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783444590.538632:0:96935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783444590.538634:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444590.538635:0:96935:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783444590.538638:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783444590.538667:0:96935:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783444590.538671:0:96935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783444590.538672:0:96935:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783444590.538676:0:96935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1783444590.540858:0:96931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1783444590.540908:0:96931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:1.0:1783444590.540929:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368f5757c00 refcount=3 00010000:00010000:1.0:1783444590.540937:0:96931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e3834560 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3834567 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.540949:0:96931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e3834560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3834567 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783444590.540958:0:96931:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9367c17b3000 from 1 10000000:01000000:1.0:1783444590.540961:0:96931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:1.0:1783444590.540969:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00010000:00000040:1.0:1783444590.540993:0:96931:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368c3254500 count: 4 00000020:00000040:1.0:1783444590.540999:0:96931:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367c583ea00 with handle 0x42cb6883e3834591 to hash 00010000:00010000:1.0:1783444590.541007:0:96931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583ea00/0x42cb6883e3834591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.541014:0:96931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c583ea00/0x42cb6883e3834591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.541025:0:96931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c583ea00/0x42cb6883e3834591 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783444590.541049:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a9c00 x1870073575464960/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.541064:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464960:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1783444590.541093:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a9c00 x1870073575464960/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.541101:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.541144:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3389850 x1870073575464960 msgsize 328 00000100:00100000:1.0:1783444590.541156:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444590.541158:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783444590.541179:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9368eb7a9c00 x1870073575464960/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.541209:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dd1d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444590.542111:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575464960 00000100:00100000:2.0:1783444590.542121:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575464960 00000020:00000040:2.0:1783444590.542124:0:94359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:2.0:1783444590.542128:0:94359:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=22 00000100:00000040:2.0:1783444590.542151:0:94359:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783444590.542218:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1783444590.542224:0:94359:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:2.0:1783444590.542231:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3389850 x1870073575464960/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.542243:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575464960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444590.542258:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1783444590.542269:0:94359:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368e7860900 count: 5 00000020:00000040:2.0:1783444590.542276:0:94359:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368f5756a00 with handle 0x42cb6883e3834598 to hash 00010000:00010000:2.0:1783444590.542281:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5756a00/0x42cb6883e3834598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e3834591 expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.542289:0:94359:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9367c229a800 : new locks_count 17 00000020:00000040:2.0:1783444590.542291:0:94359:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=23 00010000:00000040:2.0:1783444590.542309:0:94359:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9368e7860900) refcount = 5 00010000:00000040:2.0:1783444590.542313:0:94359:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783444590.542318:0:94359:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9368c513a800/0x42cb6883e3833752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e00 expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.542325:0:94359:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9368c0030000/0x42cb6883e38336f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336f0 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.542345:0:94359:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9368c0030a00/0x42cb6883e38336cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38336c6 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.542351:0:94359:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367caf90800/0x42cb6883e383364f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833648 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.542358:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5756a00/0x42cb6883e3834598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e3834591 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.542370:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5756a00/0x42cb6883e3834598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3834591 expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.542380:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5756a00, rc 0) 00010000:00000040:2.0:1783444590.542383:0:94359:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575464960 00000100:00000040:2.0:1783444590.542392:0:94359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444590.542397:0:94359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.542425:0:94359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9368eb7a9c00 x1870073575464960/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.542490:0:94359:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444590.542496:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3389850 x1870073575464960/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/344 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.542504:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3389850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575464960:12345-0@lo:101:mount.lustre.0 Request processed in 264us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.542510:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1783444590.542513:0:94359:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:2.0:1783444590.542522:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00000100:00000040:1.0:1783444590.542602:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a9c00 x1870073575464960/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.542613:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9c00 x1870073575464960/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.542620:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575464960:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1783444590.542628:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a9c00 x1870073575464960/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.542638:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c583ea00 refcount=4 00010000:00000040:1.0:1783444590.542643:0:96931:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9367c583ea00, remote cookie: 0x42cb6883e3834598, flags: 0x0 00010000:00000040:1.0:1783444590.542648:0:96931:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9368c3254500) refcount = 4 00010000:00000040:1.0:1783444590.542650:0:96931:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1783444590.542652:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9368c513be00/0x42cb6883e38336f0 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336f7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.542660:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9368c513b000/0x42cb6883e38336c6 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38336cd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.542665:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9368c513b600/0x42cb6883e3833648 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e383364f expref: -99 pid: 94353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.542671:0:96931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c583ea00/0x42cb6883e3834591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3834598 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.542678:0:96931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c583ea00/0x42cb6883e3834591 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3834598 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1783444590.542769:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a9c00 x1870073575464960/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.542779:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 10000000:00000040:1.0:1783444590.543021:0:96931:0:(mgc_request.c:108:config_log_get()) log params (ffff9367c7640c00) refs 2 00000020:00000040:1.0:1783444590.543025:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c583ea00 refcount=3 10000000:00000040:0.0:1783444590.545506:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9368caa40300 : new refcount 2 10000000:00000040:0.0:1783444590.545515:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c403d780 : new refcount 2 10000000:00000040:0.0:1783444590.545526:0:96931:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.120@tcp: copy local log params 00000040:00080000:0.0:1783444590.546274:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783444590.546533:0:96931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783444590.548068:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783444590.548118:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783444590.548143:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783444590.548148:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:0.0:1783444590.548212:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.548219:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.548261:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afd500 x1870073575465088/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.548275:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465088:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783444590.549330:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afd500 x1870073575465088/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.549340:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.549381:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3388c50 x1870073575465088 msgsize 504 00000100:00100000:0.0:1783444590.549385:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.549387:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.549457:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afd500 x1870073575465088/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.549487:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef2809c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444590.553832:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575465088 00000100:00100000:3.0:1783444590.553847:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575465088 00000020:00000040:3.0:1783444590.553850:0:94361:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:3.0:1783444590.553856:0:94361:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=23 00000100:00000040:3.0:1783444590.553881:0:94361:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783444590.553913:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:3.0:1783444590.553918:0:94361:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:3.0:1783444590.553925:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3388c50 x1870073575465088/t0(0) o501->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 504/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.553938:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465088:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1783444590.553975:0:94361:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:3.0:1783444590.553978:0:94361:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:3.0:1783444590.554051:0:94361:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:3.0:1783444590.554058:0:94361:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575465088 00000100:00000040:3.0:1783444590.554069:0:94361:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:3.0:1783444590.554074:0:94361:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444590.554120:0:94361:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9367c3afd500 x1870073575465088/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444590.554145:0:94361:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:3.0:1783444590.554162:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3388c50 x1870073575465088/t0(0) o501->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 504/272 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.554171:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3388c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465088:12345-0@lo:501:mount.lustre.0 Request processed in 235us (4789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444590.554178:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:3.0:1783444590.554181:0:94361:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:3.0:1783444590.554191:0:94361:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00000100:00000040:0.0:1783444590.554940:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afd500 x1870073575465088/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.554964:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afd500 x1870073575465088/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.554971:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465088:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783444590.554980:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afd500 x1870073575465088/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.555007:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.555012:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afd500 x1870073575465088/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.555022:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.555035:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.555039:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.555062:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afd500 x1870073575465216/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.555073:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465216:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1783444590.555106:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afd500 x1870073575465216/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.555114:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.555136:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd10c850 x1870073575465216 msgsize 272 00000100:00100000:0.0:1783444590.555141:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.555143:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.555161:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afd500 x1870073575465216/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.555183:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575465216 00000100:00100000:0.0:1783444590.555187:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575465216 00000020:00000040:0.0:1783444590.555189:0:94360:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444590.555192:0:94360:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=23 00000100:00000040:0.0:1783444590.555211:0:94360:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444590.555238:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:0.0:1783444590.555241:0:94360:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444590.555246:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd10c850 x1870073575465216/t0(0) o503->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.555258:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465216:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1783444590.555286:0:94360:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:0.0:1783444590.555325:0:94360:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:0.0:1783444590.555329:0:94360:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575465216 00000100:00000040:0.0:1783444590.555335:0:94360:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444590.555339:0:94360:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.555359:0:94360:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9367c3afd500 x1870073575465216/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.555373:0:94360:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:0.0:1783444590.555377:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd10c850 x1870073575465216/t0(0) o503->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8416 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.555385:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd10c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465216:12345-0@lo:503:mount.lustre.0 Request processed in 131us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444590.555390:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:0.0:1783444590.555393:0:94360:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:0.0:1783444590.555400:0:94360:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00000100:00100000:0.0:1783444590.555441:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef2809c0 going to sleep for 11 seconds 00000100:00000040:0.0:1783444590.555455:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afd500 x1870073575465216/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.555463:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afd500 x1870073575465216/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.555471:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465216:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1783444590.555476:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afd500 x1870073575465216/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.555486:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afd500 x1870073575465216/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.555499:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.555508:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:0.0:1783444590.556135:0:96931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1783444590.556184:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.556190:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.556212:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afd500 x1870073575465344/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.556222:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465344:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783444590.556246:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afd500 x1870073575465344/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.556252:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.556272:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3388050 x1870073575465344 msgsize 272 00000100:00100000:0.0:1783444590.556275:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.556277:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.556341:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afd500 x1870073575465344/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.556359:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef2809c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783444590.556393:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575465344 00000100:00100000:3.0:1783444590.556399:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575465344 00000020:00000040:3.0:1783444590.556401:0:94361:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:3.0:1783444590.556666:0:94361:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=23 00000100:00000040:3.0:1783444590.556684:0:94361:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783444590.556889:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:3.0:1783444590.556893:0:94361:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:3.0:1783444590.556898:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3388050 x1870073575465344/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.556911:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465344:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1783444590.556938:0:94361:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:3.0:1783444590.556991:0:94361:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:3.0:1783444590.556996:0:94361:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575465344 00000100:00000040:3.0:1783444590.557004:0:94361:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:3.0:1783444590.557008:0:94361:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444590.557031:0:94361:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9367c3afd500 x1870073575465344/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444590.557055:0:94361:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:3.0:1783444590.557059:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3388050 x1870073575465344/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8472 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.557067:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3388050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465344:12345-0@lo:502:mount.lustre.0 Request processed in 159us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444590.557079:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:3.0:1783444590.557081:0:94361:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:3.0:1783444590.557089:0:94361:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00000100:00000040:1.0:1783444590.557208:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afd500 x1870073575465344/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.557217:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afd500 x1870073575465344/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.557224:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465344:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783444590.557231:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afd500 x1870073575465344/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.557243:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afd500 x1870073575465344/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.557257:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.557265:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:1.0:1783444590.557451:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783444590.557471:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783444590.557479:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783444590.557486:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783444590.557492:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:1.0:1783444590.557496:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.557500:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:1.0:1783444590.557515:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a9c00 x1870073575465472/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.557521:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465472:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783444590.557545:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a9c00 x1870073575465472/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.557553:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.557570:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed8a450 x1870073575465472 msgsize 272 00000100:00100000:1.0:1783444590.557574:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444590.557576:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783444590.557601:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9368eb7a9c00 x1870073575465472/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.557617:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575465472 00000100:00100000:1.0:1783444590.557620:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dd1d93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444590.557621:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575465472 00000020:00000040:0.0:1783444590.557624:0:94360:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444590.557627:0:94360:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=23 00000100:00000040:0.0:1783444590.557641:0:94360:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444590.557664:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:0.0:1783444590.557667:0:94360:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444590.557671:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed8a450 x1870073575465472/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.557681:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465472:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1783444590.557883:0:94360:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:0.0:1783444590.557919:0:94360:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:0.0:1783444590.557929:0:94360:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575465472 00000100:00000040:0.0:1783444590.557934:0:94360:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:0.0:1783444590.557939:0:94360:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.558046:0:94360:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9368eb7a9c00 x1870073575465472/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.558064:0:94360:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:0.0:1783444590.558068:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed8a450 x1870073575465472/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8472 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.558076:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465472:12345-0@lo:502:mount.lustre.0 Request processed in 397us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444590.558082:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:0.0:1783444590.558084:0:94360:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:0.0:1783444590.558091:0:94360:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00000100:00000040:1.0:1783444590.559270:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a9c00 x1870073575465472/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.559283:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9c00 x1870073575465472/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.559290:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465472:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783444590.559299:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a9c00 x1870073575465472/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.559313:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a9c00 x1870073575465472/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.559332:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.559341:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:1.0:1783444590.559405:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783444590.559417:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:1.0:1783444590.559699:0:96931:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9368caa40300 : new refcount 1 00000020:00000040:1.0:1783444590.559704:0:96931:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:1.0:1783444590.560423:0:96939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444590.560433:0:96939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444590.560435:0:96939:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783444590.560442:0:96939:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9367c17b3000 00000020:00000080:1.0:1783444590.560451:0:96939:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783444590.560458:0:96939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444590.560461:0:96939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444590.560462:0:96939:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783444590.560464:0:96939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783444590.560466:0:96939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444590.560467:0:96939:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783444590.560470:0:96939:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9367c17b3000 00000020:00000080:1.0:1783444590.560471:0:96939:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783444590.560534:0:96939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783444590.560538:0:96939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783444590.560540:0:96939:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783444590.560542:0:96939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:0.0:1783444590.560629:0:96931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1783444590.560657:0:96931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:0.0:1783444590.560677:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c583ea00 refcount=3 00010000:00010000:0.0:1783444590.560686:0:96931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c583ea00/0x42cb6883e3834591 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3834598 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444590.560698:0:96931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c583ea00/0x42cb6883e3834591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e3834598 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783444590.560764:0:96931:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783444590.560767:0:96931:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9367c17b3000 10000000:01000000:0.0:1783444590.560770:0:96931:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9367c17b3000 10000000:01000000:0.0:1783444590.560774:0:96931:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:0.0:1783444590.560778:0:96931:0:(genops.c:889:class_export_get()) GET export ffff9368eb770000 refcount=20 10000000:01000000:0.0:1783444590.560782:0:96931:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9367c17b3000 from 1 10000000:01000000:0.0:1783444590.560784:0:96931:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:0.0:1783444590.560821:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00010000:00000040:0.0:1783444590.560849:0:96931:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368f575fa00 count: 9 00000020:00000040:0.0:1783444590.560856:0:96931:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367ccfb8e00 with handle 0x42cb6883e383459f to hash 00010000:00010000:0.0:1783444590.560864:0:96931:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367ccfb8e00/0x42cb6883e383459f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444590.560872:0:96931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367ccfb8e00/0x42cb6883e383459f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444590.560881:0:96931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367ccfb8e00/0x42cb6883e383459f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783444590.560901:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afca80 x1870073575465600/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.560914:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465600:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783444590.560953:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afca80 x1870073575465600/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.560961:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.560996:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed89850 x1870073575465600 msgsize 328 00000100:00100000:0.0:1783444590.561000:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.561002:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.561027:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afca80 x1870073575465600/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.561053:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3ac9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783444590.561136:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575465600 00000100:00100000:2.0:1783444590.561144:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575465600 00000020:00000040:2.0:1783444590.561153:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:2.0:1783444590.561156:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=23 00000100:00000040:2.0:1783444590.561172:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783444590.561206:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:2.0:1783444590.561210:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:2.0:1783444590.561215:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed89850 x1870073575465600/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.561225:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:96931:x1870073575465600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783444590.561238:0:94365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1783444590.561247:0:94365:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368f57c6400 count: 11 00000020:00000040:2.0:1783444590.561252:0:94365:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368f5757a00 with handle 0x42cb6883e38345a6 to hash 00010000:00010000:2.0:1783444590.561256:0:94365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9368f5757a00/0x42cb6883e38345a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e383459f expref: -99 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561262:0:94365:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9367c229a800 : new locks_count 18 00000020:00000040:2.0:1783444590.561264:0:94365:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=24 00010000:00000040:2.0:1783444590.561281:0:94365:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9368f57c6400) refcount = 11 00010000:00000040:2.0:1783444590.561284:0:94365:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783444590.561287:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c583f400/0x42cb6883e3834567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3834560 expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561294:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7645600/0x42cb6883e3833b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b50 expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561300:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c583f200/0x42cb6883e3833b2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b26 expref: 24 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561306:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c583e000/0x42cb6883e3833b1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b18 expref: 24 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561312:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7644800/0x42cb6883e3833b11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833b0a expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561323:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c6d71400/0x42cb6883e3833b03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833afc expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561329:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7645000/0x42cb6883e3833af5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833aee expref: 24 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561335:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7644400/0x42cb6883e3833ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833ae0 expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561343:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c6c26400/0x42cb6883e3833ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e69 expref: 9 pid: 94361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.561351:0:94365:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367c7644600/0x42cb6883e3833ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939e62 expref: 9 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.561357:0:94365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5757a00/0x42cb6883e38345a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e383459f expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.561369:0:94365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9368f5757a00/0x42cb6883e38345a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383459f expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.561377:0:94365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9368f5757a00, rc 0) 00010000:00000040:2.0:1783444590.561381:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575465600 00000100:00000040:2.0:1783444590.561389:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444590.561393:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.561411:0:94365:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9367c3afca80 x1870073575465600/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.561429:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444590.561433:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed89850 x1870073575465600/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/344 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.561452:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575465600:12345-0@lo:101:mount.lustre.0 Request processed in 228us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.561457:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:2.0:1783444590.561460:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:2.0:1783444590.561468:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00000100:00000040:0.0:1783444590.562066:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afca80 x1870073575465600/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.562077:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afca80 x1870073575465600/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.562083:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465600:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1783444590.562097:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afca80 x1870073575465600/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.562108:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367ccfb8e00 refcount=4 00010000:00000040:0.0:1783444590.562113:0:96931:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9367ccfb8e00, remote cookie: 0x42cb6883e38345a6, flags: 0x0 00010000:00000040:0.0:1783444590.562118:0:96931:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9368f575fa00) refcount = 9 00010000:00000040:0.0:1783444590.562121:0:96931:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783444590.562124:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9368f5757c00/0x42cb6883e3834560 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3834567 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444590.562131:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6d70600/0x42cb6883e3833b50 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b57 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444590.562137:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6d71c00/0x42cb6883e3833b26 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b2d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444590.562142:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6c27400/0x42cb6883e3833b18 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b1f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444590.562148:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6c27600/0x42cb6883e3833b0a lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b11 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444590.562154:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6d71000/0x42cb6883e3833afc lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833b03 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444590.562160:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6c27000/0x42cb6883e3833aee lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833af5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444590.562164:0:96931:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9367c6c27e00/0x42cb6883e3833ae0 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e3833ae7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444590.562170:0:96931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367ccfb8e00/0x42cb6883e383459f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345a6 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444590.562186:0:96931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367ccfb8e00/0x42cb6883e383459f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38345a6 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1783444590.562196:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afca80 x1870073575465600/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.562204:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 10000000:00000040:0.0:1783444590.562211:0:96931:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff9367c2f44200) refs 2 00000020:00000040:0.0:1783444590.562215:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367ccfb8e00 refcount=3 10000000:00000040:0.0:1783444590.562242:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9368caa40300 : new refcount 2 10000000:00000040:0.0:1783444590.562245:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c403d780 : new refcount 2 10000000:00000040:0.0:1783444590.562248:0:96931:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.204.120@tcp: copy local log lustre-client 00000040:00080000:0.0:1783444590.562447:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1783444590.562678:0:96931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783444590.563094:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783444590.563125:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783444590.563137:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783444590.563147:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783444590.563162:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783444590.563173:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783444590.563184:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783444590.563199:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783444590.563209:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783444590.563216:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783444590.563223:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783444590.563230:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783444590.563237:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783444590.563244:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783444590.563251:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783444590.563259:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783444590.563266:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783444590.563282:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783444590.563289:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783444590.563296:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783444590.563303:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783444590.563310:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783444590.563316:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783444590.563324:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783444590.563330:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1783444590.563337:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1783444590.563344:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1783444590.563351:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1783444590.563358:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1783444590.563364:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1783444590.563372:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1783444590.563379:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1783444590.563386:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1783444590.563393:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1783444590.563400:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1783444590.563407:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1783444590.563414:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1783444590.563424:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1783444590.563428:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:0.0:1783444590.563456:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.563461:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.563485:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afca80 x1870073575465728/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.563494:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465728:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1783444590.563510:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afca80 x1870073575465728/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.563515:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.563544:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed88050 x1870073575465728 msgsize 512 00000100:00100000:0.0:1783444590.563554:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.563556:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.563581:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afca80 x1870073575465728/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.563606:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444590.563610:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575465728 00000100:00100000:2.0:1783444590.563616:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575465728 00000020:00000040:2.0:1783444590.563619:0:94359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:2.0:1783444590.563622:0:94359:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=24 00000100:00000040:2.0:1783444590.563637:0:94359:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783444590.563662:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:2.0:1783444590.563667:0:94359:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:2.0:1783444590.563672:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed88050 x1870073575465728/t0(0) o501->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 512/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.563684:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575465728:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1783444590.563715:0:94359:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:2.0:1783444590.563719:0:94359:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:2.0:1783444590.563775:0:94359:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00000020:00000040:2.0:1783444590.563783:0:94359:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=25 00000020:00000040:2.0:1783444590.563813:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 24 00010000:00000040:2.0:1783444590.563819:0:94359:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575465728 00000100:00000040:2.0:1783444590.563827:0:94359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444590.563831:0:94359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.563849:0:94359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9367c3afca80 x1870073575465728/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.563868:0:94359:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444590.563872:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed88050 x1870073575465728/t0(0) o501->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 512/272 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.563890:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575465728:12345-0@lo:501:mount.lustre.0 Request processed in 208us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.563897:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:2.0:1783444590.563899:0:94359:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:2.0:1783444590.563907:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00000100:00000040:1.0:1783444590.564955:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afca80 x1870073575465728/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.564967:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afca80 x1870073575465728/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.564976:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465728:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1783444590.564983:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afca80 x1870073575465728/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.564995:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000100:00000040:1.0:1783444590.564999:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afca80 x1870073575465728/t0(0) o501->MGC192.168.204.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.565007:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.565018:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.565023:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:1.0:1783444590.565040:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eb7a9c00 x1870073575465856/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.565050:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465856:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1783444590.565084:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eb7a9c00 x1870073575465856/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.565091:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.565116:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed89c50 x1870073575465856 msgsize 272 00000100:00100000:1.0:1783444590.565120:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444590.565122:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783444590.565147:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9368eb7a9c00 x1870073575465856/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.565166:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368dd1d96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783444590.565210:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575465856 00000100:00100000:2.0:1783444590.565217:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575465856 00000020:00000040:2.0:1783444590.565219:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:2.0:1783444590.565223:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=24 00000100:00000040:2.0:1783444590.565236:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1783444590.565262:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1783444590.565266:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:2.0:1783444590.565271:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed89c50 x1870073575465856/t0(0) o503->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.565281:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575465856:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1783444590.565303:0:94365:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:2.0:1783444590.565340:0:94365:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:2.0:1783444590.565344:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575465856 00000100:00000040:2.0:1783444590.565350:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444590.565355:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.565374:0:94365:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9368eb7a9c00 x1870073575465856/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.565390:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:2.0:1783444590.565394:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed89c50 x1870073575465856/t0(0) o503->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8416 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.565403:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575465856:12345-0@lo:503:mount.lustre.0 Request processed in 123us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.565415:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1783444590.565418:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:2.0:1783444590.565426:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00000100:00000040:1.0:1783444590.565916:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eb7a9c00 x1870073575465856/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.565998:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9c00 x1870073575465856/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.566007:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eb7a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465856:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1783444590.566013:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eb7a9c00 x1870073575465856/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.566026:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eb7a9c00 x1870073575465856/t0(0) o503->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.566040:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.566049:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:0.0:1783444590.566674:0:96931:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1783444590.566741:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.566747:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.566771:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afd880 x1870073575465984/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.566781:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465984:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783444590.566905:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afd880 x1870073575465984/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.566913:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.567020:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed89050 x1870073575465984 msgsize 272 00000100:00100000:0.0:1783444590.567025:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.567027:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.567052:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afd880 x1870073575465984/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.567077:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8780 going to sleep for 11 seconds 00000100:00100000:3.0:1783444590.567125:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575465984 00000100:00100000:3.0:1783444590.567131:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575465984 00000020:00000040:3.0:1783444590.567134:0:94359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:3.0:1783444590.567137:0:94359:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=24 00000100:00000040:3.0:1783444590.567153:0:94359:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783444590.567212:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:3.0:1783444590.567217:0:94359:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:3.0:1783444590.567221:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed89050 x1870073575465984/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.567232:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575465984:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1783444590.567260:0:94359:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:3.0:1783444590.567303:0:94359:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:3.0:1783444590.567308:0:94359:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575465984 00000100:00000040:3.0:1783444590.567316:0:94359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:3.0:1783444590.567321:0:94359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444590.567343:0:94359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9367c3afd880 x1870073575465984/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444590.567499:0:94359:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:3.0:1783444590.567505:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed89050 x1870073575465984/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8472 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.567514:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575465984:12345-0@lo:502:mount.lustre.0 Request processed in 283us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444590.567521:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:3.0:1783444590.567524:0:94359:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:3.0:1783444590.567540:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00000100:00000040:1.0:1783444590.567613:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afd880 x1870073575465984/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.567622:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afd880 x1870073575465984/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.567629:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575465984:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1783444590.567645:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afd880 x1870073575465984/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.567655:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afd880 x1870073575465984/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444590.567667:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:1.0:1783444590.567674:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:0.0:1783444590.571826:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783444590.571887:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783444590.571909:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783444590.571924:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783444590.571953:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783444590.571967:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783444590.571980:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783444590.571994:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783444590.572008:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783444590.572031:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783444590.572076:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783444590.572095:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783444590.572108:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783444590.572131:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783444590.572148:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783444590.572163:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783444590.572177:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783444590.572192:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783444590.572206:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783444590.572221:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783444590.572234:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783444590.572247:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783444590.572260:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783444590.572278:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783444590.572293:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1783444590.572308:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1783444590.572322:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1783444590.572336:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1783444590.572349:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1783444590.572363:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1783444590.572377:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1783444590.572517:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1783444590.572545:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1783444590.572560:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1783444590.572574:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1783444590.572585:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1783444590.572598:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1783444590.572612:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1783444590.572627:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1783444590.572643:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1783444590.572655:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1783444590.572669:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1783444590.572684:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1783444590.572724:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783444590.572751:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783444590.572768:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783444590.572782:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783444590.572829:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:0.0:1783444590.572850:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.572858:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.572895:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afe300 x1870073575466112/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.572909:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575466112:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783444590.573062:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afe300 x1870073575466112/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.573071:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.573113:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed88450 x1870073575466112 msgsize 272 00000100:00100000:0.0:1783444590.573118:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.573120:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.573192:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afe300 x1870073575466112/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.573220:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444590.573291:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575466112 00000100:00100000:1.0:1783444590.573299:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575466112 00000020:00000040:1.0:1783444590.573302:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:1.0:1783444590.573307:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=24 00000100:00000040:1.0:1783444590.573328:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783444590.573361:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1783444590.573366:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:1.0:1783444590.573372:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed88450 x1870073575466112/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.573387:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575466112:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1783444590.573523:0:94365:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:1.0:1783444590.573575:0:94365:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:1.0:1783444590.573580:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575466112 00000100:00000040:1.0:1783444590.573590:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444590.573595:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.573616:0:94365:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9367c3afe300 x1870073575466112/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.573678:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444590.573683:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed88450 x1870073575466112/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8472 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.573691:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575466112:12345-0@lo:502:mount.lustre.0 Request processed in 309us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.573705:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1783444590.573708:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:1.0:1783444590.573721:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00000100:00000040:0.0:1783444590.573837:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afe300 x1870073575466112/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.573848:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afe300 x1870073575466112/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.573855:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575466112:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783444590.573862:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afe300 x1870073575466112/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.573873:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afe300 x1870073575466112/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.573893:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.573902:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:0.0:1783444590.574164:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1783444590.574192:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:0.0:1783444590.574208:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1783444590.574222:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:0.0:1783444590.574236:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:0.0:1783444590.574251:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:0.0:1783444590.574265:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:0.0:1783444590.574280:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:0.0:1783444590.574296:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:0.0:1783444590.574311:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:0.0:1783444590.574326:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:0.0:1783444590.574339:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:0.0:1783444590.574351:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:0.0:1783444590.574365:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:0.0:1783444590.574372:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.574376:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.574472:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afe300 x1870073575466240/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.574482:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575466240:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783444590.574506:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afe300 x1870073575466240/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.574512:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.574534:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed8b450 x1870073575466240 msgsize 272 00000100:00100000:0.0:1783444590.574539:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.574540:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.574596:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afe300 x1870073575466240/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.574629:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783444590.574680:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575466240 00000100:00100000:1.0:1783444590.574685:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575466240 00000020:00000040:1.0:1783444590.574687:0:94360:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:1.0:1783444590.574690:0:94360:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=24 00000100:00000040:1.0:1783444590.574703:0:94360:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783444590.574740:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1783444590.574743:0:94360:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:1.0:1783444590.574748:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed8b450 x1870073575466240/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.574758:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575466240:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1783444590.574780:0:94360:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c3ac9e40 : new refcount 2 00000040:00000040:1.0:1783444590.574833:0:94360:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c3ac9e40 : new refcount 1 00010000:00000040:1.0:1783444590.574838:0:94360:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575466240 00000100:00000040:1.0:1783444590.574845:0:94360:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:1.0:1783444590.574849:0:94360:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.574868:0:94360:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9367c3afe300 x1870073575466240/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.574885:0:94360:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 51 to 0@lo 00000100:00000040:1.0:1783444590.574890:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed8b450 x1870073575466240/t0(0) o502->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 272/8472 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.574899:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575466240:12345-0@lo:502:mount.lustre.0 Request processed in 141us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.574905:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1783444590.574908:0:94360:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:1.0:1783444590.574920:0:94360:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00000100:00000040:0.0:1783444590.575052:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afe300 x1870073575466240/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.575060:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afe300 x1870073575466240/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.575068:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575466240:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1783444590.575074:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afe300 x1870073575466240/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.575085:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afe300 x1870073575466240/t0(0) o502->MGC192.168.204.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.575098:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:0.0:1783444590.575103:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000040:00080000:0.0:1783444590.575134:0:96931:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:0.0:1783444590.575145:0:96931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:0.0:1783444590.575428:0:96931:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9368caa40300 : new refcount 1 00000020:00000040:0.0:1783444590.575433:0:96931:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:3.0:1783444590.576293:0:96942:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.120@tcp 192.168.204.120@tcp cnt=1 00000020:01000004:3.0:1783444590.576314:0:96942:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783444590.576338:0:96942:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9367c2000000) 00000020:00000040:3.0:1783444590.576346:0:96942:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367c2fac000 with handle 0x42cb6883e38345ad to hash 00000020:00000040:3.0:1783444590.576352:0:96942:0:(genops.c:900:class_export_put()) PUTting export ffff9367c2fac000 : new refcount 1 00000020:00000040:3.0:1783444590.576366:0:96942:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9367c2000000) now 2 - obd_device_list 00000020:00000080:3.0:1783444590.576372:0:96942:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1783444590.579599:0:96942:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9367c17b3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783444590.579607:0:96942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9367c17b3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783444590.579610:0:96942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9367c17b3000 3 00000020:00000040:2.0:1783444590.579629:0:96942:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9367c2000000) now 3 - import 00000020:00000040:2.0:1783444590.579635:0:96942:0:(genops.c:1244:class_import_put()) import ffff9368eb787000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1783444590.579649:0:96942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444590.579652:0:96942:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 52 to 0@lo 00000100:00000040:2.0:1783444590.579655:0:96942:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.120@tcp -> ffff9368f59e0380 00010000:00080000:2.0:1783444590.579659:0:96942:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368eb787000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1783444590.582956:0:96942:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:2.0:1783444590.583062:0:96942:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9367c2000000) now 4 - setup 00000020:00000080:2.0:1783444590.583066:0:96942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783444590.583110:0:96942:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:2.0:1783444590.583117:0:96942:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368c59f5000 with handle 0x42cb6883e38345b4 to hash 00000020:00000040:2.0:1783444590.583124:0:96942:0:(genops.c:889:class_export_get()) GET export ffff9368c59f5000 refcount=3 00000020:00000040:2.0:1783444590.583128:0:96942:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9367c2000000) now 5 - export 00000020:00000040:2.0:1783444590.583131:0:96942:0:(genops.c:900:class_export_put()) PUTting export ffff9368c59f5000 : new refcount 2 00000020:00000080:2.0:1783444590.583133:0:96942:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x42cb6883e38345b4 00000020:00000040:2.0:1783444590.583136:0:96942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38345b4 00000020:00000040:2.0:1783444590.583138:0:96942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c59f5000 refcount=3 00000100:00080000:2.0:1783444590.583147:0:96942:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:2.0:1783444590.583152:0:96942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 53 to 0@lo 00000020:00000040:2.0:1783444590.583155:0:96942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38345b4 00000020:00000040:2.0:1783444590.583157:0:96942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c59f5000 refcount=4 00000100:00000040:2.0:1783444590.583159:0:96942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 54 to 0@lo 00000020:00000040:2.0:1783444590.583161:0:96942:0:(genops.c:900:class_export_put()) PUTting export ffff9368c59f5000 : new refcount 3 00000100:00080000:2.0:1783444590.583170:0:96942:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9368eb787000 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:2.0:1783444590.583182:0:96942:0:(genops.c:1231:class_import_get()) import ffff9368eb787000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:2.0:1783444590.583205:0:96942:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.583219:0:96942:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006c6614c1] to pc [ptlrpcd_rcv+-1] req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.583255:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.583268:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575466368:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1783444590.583299:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783444600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.583307:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.583344:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf4e00 x1870073575466368 msgsize 520 00000100:00100000:2.0:1783444590.583349:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.583368:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783444600 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.583381:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:2.0:1783444590.583423:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575466368 00000100:00100000:2.0:1783444590.583429:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575466368 00000020:00000040:2.0:1783444590.583431:0:71469:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1783444590.583463:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00000040:2.0:1783444590.583469:0:71469:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf4e00 x1870073575466368/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1783444610 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.583479:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3632:x1870073575466368:12345-0@lo:38:llog_process_th.0 00000020:00000040:2.0:1783444590.583492:0:71469:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 14 - find 00010000:00000040:2.0:1783444590.583502:0:71469:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1783444590.583509:0:71469:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3581 last 0 00000020:00000040:2.0:1783444590.583522:0:71469:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367c4e20800 with handle 0x42cb6883e38345bb to hash 00000020:00000040:2.0:1783444590.583544:0:71469:0:(genops.c:889:class_export_get()) GET export ffff9367c4e20800 refcount=3 00000020:00000040:2.0:1783444590.583547:0:71469:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 15 - export 00000020:00000040:2.0:1783444590.583550:0:71469:0:(genops.c:900:class_export_put()) PUTting export ffff9367c4e20800 : new refcount 2 00000020:00000080:2.0:1783444590.583551:0:71469:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42cb6883e38345bb 00000020:00000040:2.0:1783444590.583553:0:71469:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38345bb 00000020:00000040:2.0:1783444590.583555:0:71469:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c4e20800 refcount=3 00000001:00000040:2.0:1783444590.583564:0:71469:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.120@tcp 00000001:00000040:2.0:1783444590.583568:0:71469:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 17 00000020:00000040:2.0:1783444590.583571:0:71469:0:(genops.c:889:class_export_get()) GET export ffff9367c4e20800 refcount=4 00000001:00000040:2.0:1783444590.583573:0:71469:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 18 00000001:00000040:2.0:1783444590.583576:0:71469:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9367ceb06800) : new refcount 17 00000004:00100000:2.0:1783444590.583581:0:71469:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:2.0:1783444590.583589:0:71469:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9367c4f05f60 for nid 0@lo - ref 6 00000020:00000040:2.0:1783444590.583596:0:71469:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 16 - import 00000020:00000040:2.0:1783444590.583602:0:71469:0:(genops.c:1244:class_import_put()) import ffff9368eab70800 refcount=1 obd=lustre-MDT0000 00000020:00000040:2.0:1783444590.583608:0:71469:0:(genops.c:889:class_export_get()) GET export ffff9367c4e20800 refcount=5 00000100:00000040:2.0:1783444590.583610:0:71469:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9367c4e20800 : new rpc_count 1 00000100:00000040:2.0:1783444590.583614:0:71469:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 55 to 0@lo 00000100:00000040:2.0:1783444590.583616:0:71469:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 55 to 0@lo 00000020:00000040:2.0:1783444590.583619:0:71469:0:(genops.c:889:class_export_get()) GET export ffff9367c4e20800 refcount=6 00000100:00000040:2.0:1783444590.583624:0:71469:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00080000:2.0:1783444590.583631:0:71469:0:(import.c:65:import_set_state_nolock()) ffff9368eab70800 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1783444590.583636:0:71469:0:(genops.c:900:class_export_put()) PUTting export ffff9367c4e20800 : new refcount 5 00000020:00000040:2.0:1783444590.583638:0:71469:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9367c2c63380) now 16 - find 00010000:00000040:2.0:1783444590.583650:0:71469:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575466368 00000100:00000040:2.0:1783444590.583658:0:71469:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.583663:0:71469:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.583679:0:71469:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783444600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.583704:0:71469:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:2.0:1783444590.583708:0:71469:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf4e00 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783444610 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.583717:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3632:x1870073575466368:12345-0@lo:38:llog_process_th.0 Request processed in 238us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.583724:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00000040:2.0:1783444590.583726:0:71469:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c4e20800 : new rpc_count 0 00000020:00000040:2.0:1783444590.583747:0:71469:0:(genops.c:900:class_export_put()) PUTting export ffff9367c4e20800 : new refcount 4 00000100:00080000:2.0:1783444590.583761:0:96942:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:2.0:1783444590.583764:0:96942:0:(genops.c:1231:class_import_get()) import ffff9368eb787000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1783444590.583780:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783444590.583800:0:93850:0:(genops.c:1231:class_import_get()) import ffff9367c2faf000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1783444590.583811:0:93850:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.583821:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000069b0fdee] to pc [ptlrpcd_00_02+2] req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.583839:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783444590.583844:0:93850:0:(genops.c:1231:class_import_get()) import ffff9367c2faf800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1783444590.583850:0:93850:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.583859:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c819c08e] to pc [ptlrpcd_00_03+3] req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.583868:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783444590.583872:0:93850:0:(genops.c:1231:class_import_get()) import ffff9368f8ca7800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783444590.583884:0:93850:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.583893:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000300f8875] to pc [ptlrpcd_00_00+0] req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444590.583910:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444590.583913:0:93850:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783444590.583915:0:93850:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444590.583919:0:93850:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3579 00000100:00080000:2.0:1783444590.583923:0:93850:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:2.0:1783444590.583925:0:93850:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 55 to 0@lo 00000100:00000040:2.0:1783444590.583928:0:93850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 56 to 0@lo 00000020:00000040:2.0:1783444590.583930:0:93850:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf32 00000020:00000040:2.0:1783444590.583932:0:93850:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a05000 refcount=4 00000100:00000040:2.0:1783444590.583935:0:93850:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 55 to 0@lo 00000100:00000040:2.0:1783444590.583937:0:93850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 56 to 0@lo 00000020:00000040:2.0:1783444590.583939:0:93850:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a05000 : new refcount 3 00000100:00080000:2.0:1783444590.583942:0:93850:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9367c17bb000 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:2.0:1783444590.583948:0:93850:0:(genops.c:1231:class_import_get()) import ffff9367c17bb000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1783444590.583956:0:93850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.583964:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003f1f203c] to pc [ptlrpcd_rcv+-1] req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.583972:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783444590.583977:0:93850:0:(genops.c:1231:class_import_get()) import ffff9367c3a03800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1783444590.583983:0:93850:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.584004:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000db6337ce] to pc [ptlrpcd_00_01+1] req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584012:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783444590.584016:0:93850:0:(genops.c:1231:class_import_get()) import ffff9368dd118000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1783444590.584024:0:93850:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.584033:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000058ac2ec2] to pc [ptlrpcd_00_02+2] req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584040:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783444590.584044:0:93850:0:(genops.c:1231:class_import_get()) import ffff9368cab9e800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1783444590.584050:0:93850:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.584058:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ad2a3440] to pc [ptlrpcd_00_03+3] req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444590.584064:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444590.584067:0:93850:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783444590.584069:0:93850:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783444590.584073:0:93850:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3579 00000100:00080000:2.0:1783444590.584076:0:93850:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:2.0:1783444590.584078:0:93850:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 55 to 0@lo 00000100:00000040:2.0:1783444590.584080:0:93850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 56 to 0@lo 00000020:00000040:2.0:1783444590.584082:0:93850:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833610 00000020:00000040:2.0:1783444590.584085:0:93850:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368eb6ff000 refcount=4 00000100:00000040:2.0:1783444590.584087:0:93850:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 55 to 0@lo 00000100:00000040:2.0:1783444590.584094:0:93850:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 56 to 0@lo 00000020:00000040:2.0:1783444590.584096:0:93850:0:(genops.c:900:class_export_put()) PUTting export ffff9368eb6ff000 : new refcount 3 00000100:00080000:2.0:1783444590.584098:0:93850:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368cb786800 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:2.0:1783444590.584103:0:93850:0:(genops.c:1231:class_import_get()) import ffff9368cb786800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1783444590.584112:0:93850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.584120:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000098fc7195] to pc [ptlrpcd_rcv+-1] req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584127:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783444590.584132:0:93850:0:(genops.c:1231:class_import_get()) import ffff9367c5037000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1783444590.584138:0:93850:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.584146:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000031e20989] to pc [ptlrpcd_00_00+0] req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584153:0:93850:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1783444590.584157:0:93850:0:(genops.c:1231:class_import_get()) import ffff9367cae88800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1783444590.584165:0:93850:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.584173:0:93850:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007631cc11] to pc [ptlrpcd_00_01+1] req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584183:0:93850:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3586) 00000100:00000040:2.0:1783444590.584196:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.584206:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575466624:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.584220:0:3636:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584232:0:3636:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.584248:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd199500 x1870073575466624 msgsize 224 00000100:00100000:2.0:1783444590.584252:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.584267:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584277:0:3636:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7538 usecs (8 jiffies) 00000100:00000040:2.0:1783444590.584283:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.584291:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575467264:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.584304:0:3636:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584310:0:3636:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.584325:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff9367c5971f80 x1870073575467264 msgsize 224 00000100:00100000:2.0:1783444590.584328:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.584341:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584350:0:3636:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5166 usecs (6 jiffies) 00000100:00100000:2.0:1783444590.584359:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:2.0:1783444590.584364:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.584372:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575466496:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.584383:0:3636:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584390:0:3636:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.584401:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff9367c5973800 x1870073575466496 msgsize 224 00000100:00100000:2.0:1783444590.584405:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.584417:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584433:0:3636:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7933 usecs (8 jiffies) 00000100:00000040:2.0:1783444590.584439:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.584447:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575467136:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.584458:0:3636:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584465:0:3636:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.584476:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff9367c5970380 x1870073575467136 msgsize 224 00000100:00100000:2.0:1783444590.584480:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.584493:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584501:0:3636:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 147297 usecs (148 jiffies) 00000100:00000040:2.0:1783444590.584516:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.584526:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575466752:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.584537:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584543:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.584555:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368e3efaa00 x1870073575466752 msgsize 224 00000100:00100000:2.0:1783444590.584558:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.584570:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584579:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1778141 usecs (1779 jiffies) 00000100:00000040:2.0:1783444590.584584:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.584591:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575467520:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.584610:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584617:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.584631:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368e3ef8e00 x1870073575467520 msgsize 224 00000100:00100000:2.0:1783444590.584635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.584649:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584658:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7108 usecs (8 jiffies) 00000100:00100000:2.0:1783444590.584666:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:2.0:1783444590.584670:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.584679:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575467008:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.584721:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.584727:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444590.585132:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.585142:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575466880:0@lo:8:kworker.0 00000100:00000040:3.0:1783444590.585157:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444590.585164:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444590.585181:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f5f80 x1870073575466880 msgsize 520 00000100:00100000:3.0:1783444590.585184:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783444590.585204:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444615 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444590.585214:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 4158 usecs (5 jiffies) 00000100:00000040:3.0:1783444590.585219:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.585226:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575467392:0@lo:8:kworker.0 00000100:00000040:3.0:1783444590.585237:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444615 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444590.585242:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444590.585253:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f6680 x1870073575467392 msgsize 520 00000100:00100000:3.0:1783444590.585257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783444590.585269:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444615 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444590.585291:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7762 usecs (8 jiffies) 00000100:00100000:3.0:1783444590.585324:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:3.0:1783444590.585328:0:3632:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:3.0:1783444590.585333:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444590.585344:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000020:00000040:3.0:1783444590.585347:0:3632:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38345b4 00000020:00000040:3.0:1783444590.585350:0:3632:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c59f5000 refcount=4 00000100:00080000:3.0:1783444590.585355:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:3.0:1783444590.585358:0:3632:0:(genops.c:900:class_export_put()) PUTting export ffff9368c59f5000 : new refcount 3 00000100:00080000:3.0:1783444590.585362:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783444590.585365:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb787000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:3.0:1783444590.585371:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444600 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.585377:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3632:1870073575466368:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1783444590.585382:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf4a80 x1870073575466368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444600 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.585495:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368e3ef9180 x1870073575467008 msgsize 224 00000100:00100000:2.0:1783444590.585500:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.585515:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.585525:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4488 usecs (5 jiffies) 00000100:00000040:2.0:1783444590.585598:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.585607:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575467648:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.585619:0:3633:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.585625:0:3633:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.585638:0:3633:0:(events.c:337:request_in_callback()) incoming req@ffff9368e3ef8700 x1870073575467648 msgsize 224 00000100:00100000:2.0:1783444590.585647:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.585662:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.585671:0:3633:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 9158 usecs (10 jiffies) 00000100:00100000:2.0:1783444590.585701:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575466624 00000100:00100000:2.0:1783444590.585707:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575466624 00000020:00000040:2.0:1783444590.585708:0:66225:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cfda 00000020:00000040:2.0:1783444590.585711:0:66225:0:(lustre_handles.c:147:class_handle2object()) GET export ffff936901db8800 refcount=5 00000020:00000040:2.0:1783444590.585722:0:66225:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000020:00000040:3.0:1783444590.586030:0:3632:0:(genops.c:1244:class_import_put()) import ffff9368eb787000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:3.0:1783444590.586064:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575467520 00000100:00100000:3.0:1783444590.586069:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575467520 00000020:00000040:3.0:1783444590.586071:0:26211:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833633 00000020:00000040:3.0:1783444590.586073:0:26211:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c5118000 refcount=5 00000020:00000040:3.0:1783444590.586080:0:26211:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:2.0:1783444590.586193:0:66225:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1783444590.586246:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575466496 00000100:00100000:2.0:1783444590.586250:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575466496 00000020:00000040:2.0:1783444590.586252:0:66225:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833767 00000020:00000040:2.0:1783444590.586254:0:66225:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368ff64d000 refcount=5 00000020:00000040:2.0:1783444590.586261:0:66225:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 16 - evictor 00000100:00100000:1.0:1783444590.586961:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575467264 00000100:00100000:1.0:1783444590.586968:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575467264 00000020:00000040:1.0:1783444590.586970:0:23687:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833609 00000020:00000040:1.0:1783444590.586973:0:23687:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368cb781800 refcount=5 00000100:00000040:1.0:1783444590.586990:0:23687:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1783444590.587007:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575466752 00000100:00100000:1.0:1783444590.587010:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575466752 00000020:00000040:1.0:1783444590.587012:0:23687:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38335c3 00000020:00000040:1.0:1783444590.587014:0:23687:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c5624000 refcount=7 00000100:00100000:1.0:1783444590.587036:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00000040:1.0:1783444590.587040:0:23687:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368cb781800 : new rpc_count 1 00000100:00000040:1.0:1783444590.587045:0:23687:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c5971f80 x1870073575467264/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:211/0 lens 224/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.587057:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575467264:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783444590.587080:0:23687:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575467264 00000100:00000040:1.0:1783444590.587089:0:23687:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:1.0:1783444590.587095:0:23687:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.587123:0:23687:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.587148:0:23687:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:1.0:1783444590.587153:0:23687:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c5971f80 x1870073575467264/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:211/0 lens 224/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.587161:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575467264:12345-0@lo:400:kworker.0 Request processed in 106us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.587167:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00000040:1.0:1783444590.587170:0:23687:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368cb781800 : new rpc_count 0 00000020:00000040:1.0:1783444590.587181:0:23687:0:(genops.c:900:class_export_put()) PUTting export ffff9368cb781800 : new refcount 4 00000100:00100000:1.0:1783444590.587190:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00000040:1.0:1783444590.587200:0:23687:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c5624000 : new rpc_count 1 00000100:00000040:1.0:1783444590.587204:0:23687:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368e3efaa00 x1870073575466752/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:211/0 lens 224/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.587213:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575466752:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783444590.587224:0:23687:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870073575466752 00000100:00000040:1.0:1783444590.587228:0:23687:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:1.0:1783444590.587231:0:23687:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.587247:0:23687:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.587263:0:23687:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:1.0:1783444590.587267:0:23687:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368e3efaa00 x1870073575466752/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:211/0 lens 224/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.587275:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575466752:12345-0@lo:400:kworker.0 Request processed in 63us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.587280:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00000040:1.0:1783444590.587282:0:23687:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c5624000 : new rpc_count 0 00000020:00000040:1.0:1783444590.587288:0:23687:0:(genops.c:900:class_export_put()) PUTting export ffff9367c5624000 : new refcount 6 00000100:00100000:1.0:1783444590.587304:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575467136 00000100:00100000:1.0:1783444590.587307:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575467136 00000020:00000040:1.0:1783444590.587309:0:66226:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383376e 00000020:00000040:1.0:1783444590.587311:0:66226:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368dd11c000 refcount=5 00000100:00100000:1.0:1783444590.587331:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575467648 00000100:00100000:1.0:1783444590.587334:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575467648 00000020:00000040:1.0:1783444590.587335:0:66226:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833775 00000020:00000040:1.0:1783444590.587337:0:66226:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c9a14000 refcount=5 00000100:00100000:1.0:1783444590.587351:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00000040:1.0:1783444590.587354:0:66226:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff936901db8800 : new rpc_count 1 00000100:00000040:1.0:1783444590.587358:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd199500 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:211/0 lens 224/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.587382:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575466624:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783444590.587394:0:66226:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575466624 00000100:00000040:1.0:1783444590.587399:0:66226:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:1.0:1783444590.587402:0:66226:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.587419:0:66226:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.587433:0:66226:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:1.0:1783444590.587437:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd199500 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:211/0 lens 224/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.587444:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575466624:12345-0@lo:400:kworker.0 Request processed in 66us (3194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.587995:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00000040:1.0:1783444590.587999:0:66226:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff936901db8800 : new rpc_count 0 00000020:00000040:1.0:1783444590.588010:0:66226:0:(genops.c:900:class_export_put()) PUTting export ffff936901db8800 : new refcount 4 00000100:00100000:1.0:1783444590.588023:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00000040:1.0:1783444590.588026:0:66226:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368dd11c000 : new rpc_count 1 00000100:00000040:1.0:1783444590.588031:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c5970380 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:211/0 lens 224/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.588043:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575467136:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783444590.588055:0:66226:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575467136 00000100:00000040:1.0:1783444590.588059:0:66226:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:1.0:1783444590.588062:0:66226:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.588082:0:66226:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.588096:0:66226:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:1.0:1783444590.588107:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c5970380 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:211/0 lens 224/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.588115:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575467136:12345-0@lo:400:kworker.0 Request processed in 76us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.588122:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00000040:1.0:1783444590.588124:0:66226:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368dd11c000 : new rpc_count 0 00000020:00000040:1.0:1783444590.588131:0:66226:0:(genops.c:900:class_export_put()) PUTting export ffff9368dd11c000 : new refcount 4 00000100:00100000:1.0:1783444590.588139:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00000040:1.0:1783444590.588141:0:66226:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c9a14000 : new rpc_count 1 00000100:00000040:1.0:1783444590.588144:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368e3ef8700 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:211/0 lens 224/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.588154:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575467648:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1783444590.588163:0:66226:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575467648 00000100:00000040:1.0:1783444590.588168:0:66226:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:1.0:1783444590.588171:0:66226:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.588186:0:66226:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.588198:0:66226:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:1.0:1783444590.588203:0:66226:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368e3ef8700 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:211/0 lens 224/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.588211:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1870073575467648:12345-0@lo:400:kworker.0 Request processed in 59us (2571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.588217:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00000040:1.0:1783444590.588219:0:66226:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c9a14000 : new rpc_count 0 00000020:00000040:1.0:1783444590.588224:0:66226:0:(genops.c:900:class_export_put()) PUTting export ffff9368c9a14000 : new refcount 4 00000100:00100000:2.0:1783444590.591481:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575466880 00000100:00100000:2.0:1783444590.591495:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575466880 00000020:00000040:2.0:1783444590.591498:0:26199:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf47 00000100:00100000:3.0:1783444590.592505:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575467392 00000100:00100000:3.0:1783444590.592514:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575467392 00000020:00000040:3.0:1783444590.592516:0:26210:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833617 00000100:00100000:2.0:1783444590.592663:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575467008 00000100:00100000:2.0:1783444590.592667:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575467008 00000020:00000040:2.0:1783444590.592669:0:26199:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf55 00000020:00000040:2.0:1783444590.592672:0:26199:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a07800 refcount=5 00000100:00000040:2.0:1783444590.592692:0:26199:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1783444590.592717:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00000040:2.0:1783444590.592721:0:26199:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c3a07800 : new rpc_count 1 00000100:00000040:2.0:1783444590.592960:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368e3ef9180 x1870073575467008/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:211/0 lens 224/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.592977:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575467008:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783444590.593010:0:26199:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1870073575467008 00000100:00000040:2.0:1783444590.593022:0:26199:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.593028:0:26199:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.593080:0:26199:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.593103:0:26199:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:2.0:1783444590.593108:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368e3ef9180 x1870073575467008/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:211/0 lens 224/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.593117:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3633:x1870073575467008:12345-0@lo:400:kworker.0 Request processed in 144us (7620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.593124:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00000040:2.0:1783444590.593127:0:26199:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c3a07800 : new rpc_count 0 00000020:00000040:2.0:1783444590.593136:0:26199:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a07800 : new refcount 4 00000100:00100000:2.0:1783444590.593146:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6000 00000100:00000040:2.0:1783444590.593150:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f5f80 x1870073575466880/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444610 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.593158:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3632:x1870073575466880:12345-0@lo:8:kworker.0 00000020:00000040:2.0:1783444590.593175:0:26199:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 7 - find 00010000:00000040:2.0:1783444590.593179:0:26199:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:2.0:1783444590.593182:0:26199:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9367c7250000) now 7 - find 00000100:00000040:2.0:1783444590.593190:0:26199:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.593192:0:26199:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.593195:0:26199:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.593210:0:26199:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.593232:0:26199:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:2.0:1783444590.593236:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f5f80 x1870073575466880/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783444610 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.593244:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3632:x1870073575466880:12345-0@lo:8:kworker.0 Request processed in 85us (8061us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783444590.593250:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6000 00000100:00100000:2.0:1783444590.593267:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6001 00000100:00000040:2.0:1783444590.593270:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f6680 x1870073575467392/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444610 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.593278:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3632:x1870073575467392:12345-0@lo:8:kworker.0 00000020:00000040:2.0:1783444590.593285:0:26199:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 7 - find 00010000:00000040:2.0:1783444590.593288:0:26199:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:2.0:1783444590.593290:0:26199:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9367c7250000) now 7 - find 00000100:00000040:2.0:1783444590.593296:0:26199:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.593299:0:26199:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.593301:0:26199:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.593317:0:26199:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444615 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.593328:0:26199:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:2.0:1783444590.593331:0:26199:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f6680 x1870073575467392/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1783444610 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.593339:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3632:x1870073575467392:12345-0@lo:8:kworker.0 Request processed in 61us (8085us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783444590.593345:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6001 00000100:00000040:3.0:1783444590.594309:0:26211:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1783444590.594347:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00000040:3.0:1783444590.594350:0:26211:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c5118000 : new rpc_count 1 00000100:00000040:3.0:1783444590.594356:0:26211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368e3ef8e00 x1870073575467520/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:211/0 lens 224/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.594369:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575467520:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1783444590.594385:0:26211:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969460, transno 0, xid 1870073575467520 00000100:00000040:3.0:1783444590.594392:0:26211:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:3.0:1783444590.594397:0:26211:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444590.594424:0:26211:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444590.594440:0:26211:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:3.0:1783444590.594443:0:26211:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368e3ef8e00 x1870073575467520/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:211/0 lens 224/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444590.594451:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575467520:12345-0@lo:400:kworker.0 Request processed in 86us (9819us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444590.594457:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00000040:3.0:1783444590.594459:0:26211:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c5118000 : new rpc_count 0 00000020:00000040:3.0:1783444590.594466:0:26211:0:(genops.c:900:class_export_put()) PUTting export ffff9368c5118000 : new refcount 4 00000100:00080000:2.0:1783444590.594524:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1783444590.594598:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9367c2c63380) now 16 - evictor 00000100:00080000:2.0:1783444590.594603:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1783444590.594607:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00080000:2.0:1783444590.594609:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1783444590.594611:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - evictor 00000100:00000040:2.0:1783444590.594662:0:3636:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783444590.594669:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.594679:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.594692:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575467136:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.594707:0:3636:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783444590.594711:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.594718:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.594725:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575466624:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.594827:0:3636:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783444590.594832:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.594839:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.594845:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575467264:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.594851:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf5500 x1870073575467136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.594861:0:3636:0:(genops.c:1244:class_import_put()) import ffff9368dd118000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1783444590.594871:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf4000 x1870073575466624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.594878:0:3636:0:(genops.c:1244:class_import_put()) import ffff9367c2faf800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1783444590.594883:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf6a00 x1870073575467264/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.594889:0:3636:0:(genops.c:1244:class_import_put()) import ffff9368cab9e800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1783444590.594910:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969457 00000100:00000040:2.0:1783444590.594921:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.594928:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.594935:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575467008:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.595057:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1783444590.595063:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.595070:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.595077:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1870073575467648:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.595089:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1783444590.595093:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.595101:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.595107:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575466752:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.595117:0:3633:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969460 00000100:00000040:2.0:1783444590.595121:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.595128:0:3633:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.595134:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575467520:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.595147:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf6300 x1870073575467008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.595154:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367c3a03800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1783444590.595159:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368f9bc6d80 x1870073575467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.595166:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367cae88800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1783444590.595172:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf5f80 x1870073575466752/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.595180:0:3633:0:(genops.c:1244:class_import_put()) import ffff9368f8ca7800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1783444590.595184:0:3633:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368f9bc7100 x1870073575467520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.595190:0:3633:0:(genops.c:1244:class_import_put()) import ffff9367c5037000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1783444590.595230:0:3632:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1783444590.595235:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444615 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444590.595244:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444590.595248:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:2.0:1783444590.595252:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444615 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.595259:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575466880:0@lo:8:kworker.0 00000100:00000040:2.0:1783444590.595268:0:3632:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969454 00000100:00000040:2.0:1783444590.595272:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444615 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444590.595278:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783444590.595281:0:3632:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:2.0:1783444590.595291:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444615 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.595297:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575467392:0@lo:8:kworker.0 00000100:00000040:2.0:1783444590.595302:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf7800 x1870073575466880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444615 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.595311:0:3632:0:(genops.c:1244:class_import_put()) import ffff9367c17bb000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1783444590.595318:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf6680 x1870073575467392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1783444615 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.595324:0:3632:0:(genops.c:1244:class_import_put()) import ffff9368cb786800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1783444590.595345:0:66225:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1783444590.595376:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00000040:2.0:1783444590.595380:0:66225:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368ff64d000 : new rpc_count 1 00000100:00000040:2.0:1783444590.595384:0:66225:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c5973800 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:211/0 lens 224/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.595396:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c5973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575466496:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1783444590.595409:0:66225:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575466496 00000100:00000040:2.0:1783444590.595416:0:66225:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.595420:0:66225:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.595444:0:66225:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.595464:0:66225:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 56 to 0@lo 00000100:00000040:2.0:1783444590.595468:0:66225:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c5973800 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:211/0 lens 224/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.595476:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c5973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575466496:12345-0@lo:400:kworker.0 Request processed in 82us (11073us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.595482:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00000040:2.0:1783444590.595489:0:66225:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368ff64d000 : new rpc_count 0 00000020:00000040:2.0:1783444590.595497:0:66225:0:(genops.c:900:class_export_put()) PUTting export ffff9368ff64d000 : new refcount 4 00000100:00000040:2.0:1783444590.595516:0:3636:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1783444590.595520:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.595527:0:3636:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.595662:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575466496:0@lo:400:kworker.0 00000100:00000040:2.0:1783444590.595668:0:3636:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf5180 x1870073575466496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.595675:0:3636:0:(genops.c:1244:class_import_put()) import ffff9367c2faf000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000020:00000040:2.0:1783444590.596502:0:96942:0:(genops.c:889:class_export_get()) GET export ffff9368c59f5000 refcount=4 00000020:00000040:2.0:1783444590.596611:0:96942:0:(genops.c:889:class_export_get()) GET export ffff9368c59f5000 refcount=5 00000100:00000040:2.0:1783444590.596683:0:96942:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.204.120@tcp 192.168.204.120@tcp cnt=1 00000020:01000004:2.0:1783444590.596704:0:96942:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783444590.596719:0:96942:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9367c3330000) 00000020:00000040:2.0:1783444590.596744:0:96942:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368eab72000 with handle 0x42cb6883e38345c2 to hash 00000020:00000040:2.0:1783444590.596751:0:96942:0:(genops.c:900:class_export_put()) PUTting export ffff9368eab72000 : new refcount 1 00000020:00000040:2.0:1783444590.596765:0:96942:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9367c3330000) now 2 - obd_device_list 00000020:00000080:2.0:1783444590.596772:0:96942:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1783444590.596937:0:96942:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9367c17b3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783444590.596942:0:96942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9367c17b3000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783444590.596955:0:96942:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9367c17b3000 3 00000020:00000040:2.0:1783444590.596972:0:96942:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9367c3330000) now 3 - import 00000020:00000040:2.0:1783444590.596977:0:96942:0:(genops.c:1244:class_import_put()) import ffff9368eb7b5000 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1783444590.597106:0:96942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.597110:0:96942:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 57 to 0@lo 00000100:00000040:2.0:1783444590.597112:0:96942:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.120@tcp -> ffff9368f59e0380 00010000:00080000:2.0:1783444590.597122:0:96942:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9368eb7b5000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.120@tcp at head 00000020:00000040:3.0:1783444590.598935:0:96944:0:(genops.c:889:class_export_get()) GET export ffff9368c59f5000 refcount=6 00000020:00000040:3.0:1783444590.598944:0:96944:0:(genops.c:889:class_export_get()) GET export ffff9368c59f5000 refcount=7 00000020:00000040:3.0:1783444590.598949:0:96944:0:(genops.c:900:class_export_put()) PUTting export ffff9368c59f5000 : new refcount 6 00010000:00010000:2.0:1783444590.601183:0:96942:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:2.0:1783444590.601294:0:96942:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9367c3330000) now 4 - setup 00000020:00000080:2.0:1783444590.601299:0:96942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1783444590.601345:0:96942:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:2.0:1783444590.601352:0:96942:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368ff57a000 with handle 0x42cb6883e38345c9 to hash 00000020:00000040:2.0:1783444590.601360:0:96942:0:(genops.c:889:class_export_get()) GET export ffff9368ff57a000 refcount=3 00000020:00000040:2.0:1783444590.601363:0:96942:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9367c3330000) now 5 - export 00000020:00000040:2.0:1783444590.601367:0:96942:0:(genops.c:900:class_export_put()) PUTting export ffff9368ff57a000 : new refcount 2 00000020:00000080:2.0:1783444590.601369:0:96942:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x42cb6883e38345c9 00000020:00000040:2.0:1783444590.601372:0:96942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38345c9 00000020:00000040:2.0:1783444590.601374:0:96942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368ff57a000 refcount=3 00000100:00080000:2.0:1783444590.601383:0:96942:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:2.0:1783444590.601388:0:96942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 58 to 0@lo 00000020:00000040:2.0:1783444590.601391:0:96942:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38345c9 00000020:00000040:2.0:1783444590.601393:0:96942:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368ff57a000 refcount=4 00000100:00000040:2.0:1783444590.601395:0:96942:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 59 to 0@lo 00000020:00000040:2.0:1783444590.601397:0:96942:0:(genops.c:900:class_export_put()) PUTting export ffff9368ff57a000 : new refcount 3 00000100:00080000:2.0:1783444590.601400:0:96942:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9368eb7b5000 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:2.0:1783444590.601412:0:96942:0:(genops.c:1231:class_import_get()) import ffff9368eb7b5000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:2.0:1783444590.601435:0:96942:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.601449:0:96942:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000537ca50c] to pc [ptlrpcd_rcv+-1] req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444590.601468:0:96942:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:2.0:1783444590.601471:0:96942:0:(genops.c:1231:class_import_get()) import ffff9368eb7b5000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1783444590.601506:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.601528:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1870073575467776:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1783444590.602659:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783444600 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.602668:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.602708:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9368e3efbb80 x1870073575467776 msgsize 520 00000100:00100000:2.0:1783444590.602713:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.602820:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783444600 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444590.602833:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:2.0:1783444590.602883:0:93850:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3586) 00000100:00100000:1.0:1783444590.603071:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575467776 00000100:00100000:1.0:1783444590.603079:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575467776 00000020:00000040:1.0:1783444590.603089:0:80475:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:1.0:1783444590.603118:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00000040:1.0:1783444590.603125:0:80475:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368e3efbb80 x1870073575467776/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1783444610 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.603134:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3632:x1870073575467776:12345-0@lo:38:llog_process_th.0 00000020:00000040:1.0:1783444590.603148:0:80475:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 10 - find 00010000:00000040:1.0:1783444590.603158:0:80475:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1783444590.603165:0:80475:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3581 last 0 00000020:00000040:1.0:1783444590.603173:0:80475:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368c6bcc800 with handle 0x42cb6883e38345d0 to hash 00000020:00000040:1.0:1783444590.603198:0:80475:0:(genops.c:889:class_export_get()) GET export ffff9368c6bcc800 refcount=3 00000020:00000040:1.0:1783444590.603201:0:80475:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 11 - export 00000020:00000040:1.0:1783444590.603204:0:80475:0:(genops.c:900:class_export_put()) PUTting export ffff9368c6bcc800 : new refcount 2 00000020:00000080:1.0:1783444590.603206:0:80475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x42cb6883e38345d0 00000020:00000040:1.0:1783444590.603208:0:80475:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38345d0 00000020:00000040:1.0:1783444590.603209:0:80475:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c6bcc800 refcount=3 00000001:00000040:1.0:1783444590.603218:0:80475:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.120@tcp 00000001:00000040:1.0:1783444590.603223:0:80475:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 18 00000020:00000040:1.0:1783444590.603226:0:80475:0:(genops.c:889:class_export_get()) GET export ffff9368c6bcc800 refcount=4 00000001:00000040:1.0:1783444590.603228:0:80475:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 19 00000001:00000040:1.0:1783444590.603231:0:80475:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9367ceb06800) : new refcount 18 00000004:00100000:1.0:1783444590.603235:0:80475:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1783444590.603244:0:80475:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9367c4942c00 for nid 0@lo - ref 4 00000020:00000040:1.0:1783444590.603251:0:80475:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 12 - import 00000020:00000040:1.0:1783444590.603256:0:80475:0:(genops.c:1244:class_import_put()) import ffff9368c6bce800 refcount=1 obd=lustre-MDT0001 00000020:00000040:1.0:1783444590.603262:0:80475:0:(genops.c:889:class_export_get()) GET export ffff9368c6bcc800 refcount=5 00000100:00000040:1.0:1783444590.603265:0:80475:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9368c6bcc800 : new rpc_count 1 00000100:00000040:1.0:1783444590.603269:0:80475:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 60 to 0@lo 00000100:00000040:1.0:1783444590.603272:0:80475:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 60 to 0@lo 00000020:00000040:1.0:1783444590.603274:0:80475:0:(genops.c:889:class_export_get()) GET export ffff9368c6bcc800 refcount=6 00000100:00000040:1.0:1783444590.603285:0:80475:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 61 to 0@lo 00000100:00080000:1.0:1783444590.603293:0:80475:0:(import.c:65:import_set_state_nolock()) ffff9368c6bce800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1783444590.603298:0:80475:0:(genops.c:900:class_export_put()) PUTting export ffff9368c6bcc800 : new refcount 5 00000020:00000040:1.0:1783444590.603300:0:80475:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9368dcfd99c0) now 12 - find 00010000:00000040:1.0:1783444590.603313:0:80475:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575467776 00000100:00000040:1.0:1783444590.603321:0:80475:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:1.0:1783444590.603326:0:80475:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.603346:0:80475:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783444600 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.603364:0:80475:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00000100:00000040:1.0:1783444590.603368:0:80475:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368e3efbb80 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783444610 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.603376:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3632:x1870073575467776:12345-0@lo:38:llog_process_th.0 Request processed in 242us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.603382:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00000040:1.0:1783444590.603385:0:80475:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c6bcc800 : new rpc_count 0 00000020:00000040:1.0:1783444590.603395:0:80475:0:(genops.c:900:class_export_put()) PUTting export ffff9368c6bcc800 : new refcount 4 00000100:00100000:2.0:1783444590.603636:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:2.0:1783444590.603640:0:3632:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:2.0:1783444590.603646:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444590.603655:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000020:00000040:2.0:1783444590.603657:0:3632:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38345c9 00000020:00000040:2.0:1783444590.603659:0:3632:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368ff57a000 refcount=4 00000100:00080000:2.0:1783444590.603665:0:3632:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1783444590.603667:0:3632:0:(genops.c:900:class_export_put()) PUTting export ffff9368ff57a000 : new refcount 3 00000100:00080000:2.0:1783444590.603672:0:3632:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783444590.603674:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368eb7b5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1783444590.603679:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444600 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.603686:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3632:1870073575467776:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1783444590.603692:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368e3ef9500 x1870073575467776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783444600 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444590.603706:0:3632:0:(genops.c:1244:class_import_put()) import ffff9368eb7b5000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:2.0:1783444590.604063:0:96942:0:(genops.c:889:class_export_get()) GET export ffff9368ff57a000 refcount=4 00000020:00000040:2.0:1783444590.604072:0:96942:0:(genops.c:889:class_export_get()) GET export ffff9368ff57a000 refcount=5 00000040:00080000:2.0:1783444590.604157:0:96942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:01000000:0.0:1783444590.604222:0:96931:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1783444590.604259:0:96931:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:0.0:1783444590.604276:0:96931:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367ccfb8e00 refcount=3 00010000:00010000:0.0:1783444590.604292:0:96931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367ccfb8e00/0x42cb6883e383459f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345a6 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444590.604303:0:96931:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367ccfb8e00/0x42cb6883e383459f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345a6 expref: -99 pid: 96931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783444590.604350:0:96931:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783444590.604352:0:96931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783444590.604357:0:96931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444590.604358:0:96931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444590.604359:0:96931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444590.604361:0:96931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444590.604362:0:96931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444590.604364:0:96931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444590.604365:0:96931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783444590.604369:0:96931:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1783444590.604372:0:96931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783444590.604373:0:96931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783444590.604373:0:96931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444590.604374:0:96931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444590.604375:0:96931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444590.604376:0:96931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444590.604377:0:96931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444590.604378:0:96931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444590.604379:0:96931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:0.0:1783444590.604383:0:96931:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 10000000:01000000:0.0:1783444590.604411:0:96931:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:0.0:1783444590.604425:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afe300 x1870073575467904/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.604436:0:96931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575467904:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1783444590.604456:0:96931:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afe300 x1870073575467904/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.604463:0:96931:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.604489:0:96931:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed8ac50 x1870073575467904 msgsize 4848 00000100:00100000:0.0:1783444590.604493:0:96931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444590.604495:0:96931:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1783444590.604511:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c3afe300 x1870073575467904/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.604529:0:96931:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368e75c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444590.604547:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575467904 00000100:00100000:0.0:1783444590.604551:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575467904 00000020:00000040:0.0:1783444590.604553:0:94361:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444590.604562:0:94361:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=24 00000100:00000040:0.0:1783444590.604579:0:94361:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444590.604599:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:0.0:1783444590.604602:0:94361:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444590.604606:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed8ac50 x1870073575467904/t0(0) o253->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 4848/0 e 0 to 0 dl 1783444601 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.604618:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:96931:x1870073575467904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783444590.604644:0:94361:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783444590.604657:0:94361:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000040:0.0:1783444590.604776:0:96945:0:(genops.c:900:class_export_put()) PUTting export ffff9368ff57a000 : new refcount 4 20000000:01000000:1.0:1783444590.612839:0:94361:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783444590.612864:0:94361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783444590.612882:0:94363:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783444590.612888:0:94363:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:2.0:1783444590.612900:0:94363:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368e7860200 count: 4 00000020:00000040:2.0:1783444590.612912:0:94363:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368f5756600 with handle 0x42cb6883e38345d7 to hash 00010000:00010000:2.0:1783444590.612920:0:94363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.612938:0:94363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e3833680 expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.612947:0:94363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e383369c expref: 24 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.612956:0:94363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 9 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.612964:0:94363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.612971:0:94363:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9368e7860200) refcount = 4 00010000:00000040:2.0:1783444590.612974:0:94363:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1783444590.612977:0:94363:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 9 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.612994:0:94363:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x42cb6883e383369c expref: 24 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.613010:0:94363:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x42cb6883e3833680 expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.613015:0:94363:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:2.0:1783444590.613017:0:94363:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783444590.613037:0:94363:0:(genops.c:1231:class_import_get()) import ffff9367c17b6000 refcount=2 obd=MGS 00010000:00010000:2.0:1783444590.613057:0:94363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 9 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.613070:0:94363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 9 pid: 94359 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444590.613084:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368e3ef9500 x1870073575468032/t0(0) o104->MGS@192.168.204.20@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613096:0:94363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e3ef9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94363:1870073575468032:192.168.204.20@tcp:104: 00000100:00000040:2.0:1783444590.613120:0:94363:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9368e3ef9500 x1870073575468032/t0(0) o104->MGS@192.168.204.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.613128:0:94363:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000020:00000040:2.0:1783444590.613191:0:94363:0:(genops.c:1231:class_import_get()) import ffff9367c229d800 refcount=2 obd=MGS 00010000:00010000:2.0:1783444590.613200:0:94363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e383369c expref: 24 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.613207:0:94363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e383369c expref: 24 pid: 94360 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444590.613216:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368f9bc7100 x1870073575468160/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613232:0:94363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94363:1870073575468160:0@lo:104: 00000100:00000040:2.0:1783444590.613242:0:94363:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9368f9bc7100 x1870073575468160/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.613248:0:94363:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.613277:0:94363:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bc6d80 x1870073575468160 msgsize 328 00000100:00100000:2.0:1783444590.613281:0:94363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.613302:0:94363:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368f9bc7100 x1870073575468160/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1783444590.613317:0:94363:0:(genops.c:1231:class_import_get()) import ffff9367c229d800 refcount=3 obd=MGS 00010000:00010000:2.0:1783444590.613326:0:94363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42cb6883e3833680 expref: 24 pid: 94365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.613334:0:94363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42cb6883e3833680 expref: 24 pid: 94365 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444590.613342:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367ccd92a00 x1870073575468288/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613348:0:94363:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94363:1870073575468288:0@lo:104: 00000100:00000040:2.0:1783444590.613358:0:94363:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9367ccd92a00 x1870073575468288/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.613364:0:94363:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.613374:0:94363:0:(events.c:337:request_in_callback()) incoming req@ffff9367ccd93480 x1870073575468288 msgsize 328 00000100:00100000:2.0:1783444590.613378:0:94363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.613391:0:94363:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367ccd92a00 x1870073575468288/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613403:0:94363:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c3316a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783444590.613426:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575468160 00000100:00100000:2.0:1783444590.613432:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575468160 00000020:00000040:2.0:1783444590.613441:0:6489:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e37e5eae 00000020:00000040:2.0:1783444590.613444:0:6489:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368eb775800 refcount=3 00000100:00000040:2.0:1783444590.613466:0:6489:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00000040:1.0:1783444590.613471:0:3628:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368e3ef9500 x1870073575468032/t0(0) o104->MGS@192.168.204.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613492:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575468288 00000100:00100000:2.0:1783444590.613497:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575468288 00000020:00000040:2.0:1783444590.613499:0:6489:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e37e5eae 00000020:00000040:2.0:1783444590.613501:0:6489:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368eb775800 refcount=4 00000100:00100000:2.0:1783444590.613518:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00000040:2.0:1783444590.613522:0:6489:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368eb775800 : new rpc_count 1 00000100:00000040:2.0:1783444590.613526:0:6489:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bc6d80 x1870073575468160/t0(0) o104->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/0 e 0 to 0 dl 1783444601 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613553:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+4:94363:x1870073575468160:12345-0@lo:104: 00000020:00000040:2.0:1783444590.613561:0:6489:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c6c26000 refcount=2 00010000:00010000:2.0:1783444590.613568:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444590.613585:0:6489:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:2.0:1783444590.613590:0:6489:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.613613:0:6489:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9368f9bc7100 x1870073575468160/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.613642:0:6489:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00010000:00010000:2.0:1783444590.613661:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:2.0:1783444590.613667:0:6489:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc6d80 x1870073575468160/t0(0) o104->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613676:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+4:94363:x1870073575468160:12345-0@lo:104: Request processed in 125us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.613682:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00000040:2.0:1783444590.613685:0:6489:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368eb775800 : new rpc_count 0 00000020:00000040:2.0:1783444590.613703:0:6489:0:(genops.c:900:class_export_put()) PUTting export ffff9368eb775800 : new refcount 3 00000100:00100000:2.0:1783444590.613720:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00000040:2.0:1783444590.613723:0:6489:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368eb775800 : new rpc_count 1 00000100:00000040:2.0:1783444590.613726:0:6489:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367ccd93480 x1870073575468288/t0(0) o104->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/0 e 0 to 0 dl 1783444601 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613752:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:94363:x1870073575468288:12345-0@lo:104: 00000020:00000040:2.0:1783444590.613758:0:6489:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368c513ae00 refcount=2 00010000:00010000:2.0:1783444590.613763:0:6489:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444590.613772:0:6489:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:2.0:1783444590.613776:0:6489:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.613811:0:6489:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9367ccd92a00 x1870073575468288/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.613824:0:6489:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00010000:00010000:2.0:1783444590.613834:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:2.0:1783444590.613838:0:6489:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd93480 x1870073575468288/t0(0) o104->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.613846:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c89ab73b-dbb2-4305-b221-37cc64d61227+3:94363:x1870073575468288:12345-0@lo:104: Request processed in 96us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.613852:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00000040:2.0:1783444590.613854:0:6489:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368eb775800 : new rpc_count 0 00000020:00000040:2.0:1783444590.613861:0:6489:0:(genops.c:900:class_export_put()) PUTting export ffff9368eb775800 : new refcount 2 00010000:00010000:2.0:1783444590.613880:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783444590.613886:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.613893:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9367c6c26000 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444590.613896:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783444590.613909:0:10324:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c6c26000 refcount=3 00010000:00010000:2.0:1783444590.613913:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444590.613920:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444590.613926:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:2.0:1783444590.613929:0:10324:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:2.0:1783444590.613931:0:10324:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:2.0:1783444590.613939:0:10324:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9368f9b54400) refs 2 00000020:00000040:2.0:1783444590.613944:0:10324:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9367c6c26000 with handle 0x42cb6883e383369c from hash 00000020:00000040:2.0:1783444590.613952:0:10324:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00010000:00010000:2.0:1783444590.613962:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.613968:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:2.0:1783444590.613977:0:10324:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002e04c98c] to pc [ptlrpcd_00_02+2] req@ffff9367ccd93100 x1870073575468416/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783444590.613998:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.614005:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9367c6c26000/0x42cb6883e383369c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e38336a3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.614014:0:10324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783444590.614017:0:10324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.614033:0:10324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368c513ae00 already unused, calling callback (ffffffffc122fc20) 10000000:00010000:2.0:1783444590.614036:0:10324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783444590.614042:0:10324:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368c513ae00 refcount=3 00010000:00010000:2.0:1783444590.614045:0:10324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783444590.614051:0:10324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783444590.614056:0:10324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:2.0:1783444590.614058:0:10324:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 10000000:00000040:2.0:1783444590.614060:0:10324:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:2.0:1783444590.614062:0:10324:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9367c39f7400) refs 2 00010000:00010000:0.0:1783444590.614062:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1783444590.614065:0:10324:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9368c513ae00 with handle 0x42cb6883e3833680 from hash 00000020:00000040:2.0:1783444590.614070:0:10324:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=6 obd=MGC192.168.204.120@tcp 00010000:00010000:2.0:1783444590.614078:0:10324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.614083:0:10324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:2.0:1783444590.614090:0:10324:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a2c14efa] to pc [ptlrpcd_00_03+3] req@ffff9367ccd90a80 x1870073575468544/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783444590.614099:0:10324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.614106:0:10324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff9368c513ae00/0x42cb6883e3833680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42cb6883e3833687 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.614121:0:10324:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9368c3254800 count: 0 00010000:00010000:2.0:1783444590.614130:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444590.614134:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783444590.614136:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1783444590.614138:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368f9bc7100 x1870073575468160/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444590.614151:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367ccd93100 x1870073575468416/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.614162:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc7100 x1870073575468160/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.614164:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575468416:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1783444590.614181:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367ccd93100 x1870073575468416/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.614184:0:94363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f9bc7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94363:1870073575468160:0@lo:104: 00000100:00000040:2.0:1783444590.614189:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.614203:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9367ccd90e00 x1870073575468416 msgsize 328 00000100:00000040:1.0:1783444590.614204:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367ccd92a00 x1870073575468288/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.614209:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444590.614227:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367ccd93100 x1870073575468416/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.614246:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575468416 00000100:00100000:2.0:1783444590.614249:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783444590.614250:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575468416 00000020:00000040:0.0:1783444590.614252:0:26213:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000100:00000040:2.0:1783444590.614254:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367ccd90a80 x1870073575468544/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.614255:0:26213:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=25 00000100:00100000:2.0:1783444590.614262:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575468544:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1783444590.614269:0:26213:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000100:00000040:2.0:1783444590.614272:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367ccd90a80 x1870073575468544/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.614275:0:26213:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367caf91400 refcount=4 00000100:00000040:2.0:1783444590.614286:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444590.614298:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9367ccd90000 x1870073575468544 msgsize 328 00000100:00000040:1.0:1783444590.614302:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd92a00 x1870073575468288/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783444590.614306:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444590.614321:0:94363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd92a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94363:1870073575468288:0@lo:104: 00000100:00000040:2.0:1783444590.614322:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367ccd90a80 x1870073575468544/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1783444590.614571:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383369c expref: 25 pid: 94360 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444590.614600:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575468544 00000100:00100000:0.0:1783444590.614603:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575468544 00000020:00000040:0.0:1783444590.614605:0:26213:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444590.614607:0:26213:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=26 00000020:00000040:0.0:1783444590.614620:0:26213:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367caf91a00 refcount=4 00010000:00010000:0.0:1783444590.614624:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833680 expref: 26 pid: 94365 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444590.614645:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00000040:0.0:1783444590.614647:0:26213:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 2 00000100:00000040:0.0:1783444590.614651:0:26213:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367ccd90e00 x1870073575468416/t0(0) o103->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.614668:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+26:3635:x1870073575468416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783444590.614681:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1783444590.614683:0:26213:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367caf91400 refcount=4 00010000:00000040:0.0:1783444590.614686:0:26213:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368e7860200 count: 5 00010000:00010000:0.0:1783444590.614690:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e383369c expref: 26 pid: 94360 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444590.614699:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e383369c expref: 26 pid: 94360 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1783444590.614709:0:26213:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9367caf91400 with handle 0x42cb6883e38336a3 from hash 00010000:00010000:0.0:1783444590.614713:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91400/0x42cb6883e38336a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e383369c expref: 26 pid: 94360 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444590.614719:0:26213:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9367c229a800 : new locks_count 17 00000020:00000040:0.0:1783444590.614721:0:26213:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 25 00010000:00000040:0.0:1783444590.614727:0:26213:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9368f5756600 00010000:00010000:0.0:1783444590.614745:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1783444590.614750:0:26213:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:0.0:1783444590.614754:0:26213:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444590.614773:0:26213:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9367ccd93100 x1870073575468416/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.614811:0:26213:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00000100:00000040:0.0:1783444590.614816:0:26213:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd90e00 x1870073575468416/t0(0) o103->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.614823:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3635:x1870073575468416:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.614933:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00000040:1.0:1783444590.614937:0:6490:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 3 00000100:00000040:1.0:1783444590.614942:0:6490:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367ccd90000 x1870073575468544/t0(0) o103->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.614955:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+25:3635:x1870073575468544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783444590.614964:0:6490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1783444590.614967:0:6490:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367caf91a00 refcount=4 00010000:00000040:1.0:1783444590.614969:0:6490:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368e7860200 count: 4 00010000:00010000:1.0:1783444590.614973:0:6490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42cb6883e3833680 expref: 25 pid: 94365 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.614982:0:6490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42cb6883e3833680 expref: 25 pid: 94365 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1783444590.614991:0:6490:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9367caf91a00 with handle 0x42cb6883e3833687 from hash 00010000:00010000:1.0:1783444590.614995:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9367caf91a00/0x42cb6883e3833687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42cb6883e3833680 expref: 25 pid: 94365 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.615001:0:6490:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9367c229a800 : new locks_count 16 00000020:00000040:1.0:1783444590.615004:0:6490:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 24 00010000:00000040:1.0:1783444590.615008:0:6490:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9368f5756600 00010000:00010000:1.0:1783444590.615010:0:6490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:1.0:1783444590.615013:0:6490:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:1.0:1783444590.615017:0:6490:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444590.615037:0:6490:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9367ccd90a80 x1870073575468544/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.615083:0:6490:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00000100:00000040:1.0:1783444590.615087:0:6490:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd90000 x1870073575468544/t0(0) o103->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 328/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.615099:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575468544:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444590.615099:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00000040:0.0:1783444590.615105:0:26213:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 2 00000100:00100000:1.0:1783444590.615110:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00000040:1.0:1783444590.615114:0:6490:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 1 00000020:00000040:0.0:1783444590.615117:0:26213:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00000020:00000040:1.0:1783444590.615123:0:6490:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00010000:00000040:1.0:1783444590.615162:0:94361:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575467904 00000100:00000040:0.0:1783444590.615166:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367ccd90a80 x1870073575468544/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.615172:0:94361:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:0.0:1783444590.615181:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd90a80 x1870073575468544/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.615187:0:94361:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783444590.615195:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575468544:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1783444590.615209:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367ccd93100 x1870073575468416/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.615216:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd93100 x1870073575468416/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.615222:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575468416:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1783444590.615227:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367ccd90a80 x1870073575468544/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.615237:0:3635:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:0.0:1783444590.615244:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367ccd93100 x1870073575468416/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.615249:0:3635:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000100:00000040:1.0:1783444590.616363:0:94361:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9367c3afe300 x1870073575467904/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444590.616409:0:94361:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00000100:00000040:1.0:1783444590.616417:0:94361:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed8ac50 x1870073575467904/t0(0) o253->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:211/0 lens 4848/4768 e 0 to 0 dl 1783444601 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444590.616427:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+22:96931:x1870073575467904:12345-0@lo:253:mount.lustre.0 Request processed in 11811us (11937us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444590.616437:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:1.0:1783444590.616440:0:94361:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:1.0:1783444590.616449:0:94361:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 21 00000100:00000040:0.0:1783444590.616528:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afe300 x1870073575467904/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444590.616543:0:96931:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afe300 x1870073575467904/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444590.616550:0:96931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c89ab73b-dbb2-4305-b221-37cc64d61227:96931:1870073575467904:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1783444590.616570:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afe300 x1870073575467904/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783444590.616594:0:96931:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783444590.616597:0:96931:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783444590.616598:0:96931:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783444590.616599:0:96931:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783444590.616600:0:96931:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783444590.616602:0:96931:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783444590.616603:0:96931:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783444590.616604:0:96931:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783444590.616606:0:96931:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783444590.616608:0:96931:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:0.0:1783444590.616611:0:96931:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afe300 x1870073575467904/t0(0) o253->MGC192.168.204.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444590.616621:0:96931:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000020:02000000:0.0:1783444590.616631:0:96931:0:(tgt_mount.c:2690:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:0.0:1783444590.616861:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:0.0:1783444590.616877:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:0.0:1783444590.617237:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:0.0:1783444590.617290:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:0.0:1783444590.617327:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:0.0:1783444590.617364:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:0.0:1783444590.617391:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:0.0:1783444590.617416:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:0.0:1783444590.617453:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:0.0:1783444590.617498:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00002000:00000040:1.0:1783444590.618665:0:96931:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:1.0:1783444590.618837:0:96931:0:(ldlm_lib.c:3040:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294969475 00000100:00000040:3.0:1783444590.618956:0:3626:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9368e3ef9500 x1870073575468032/t0(0) o104->MGS@192.168.204.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783444590.619001:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368c4d56450 x1870073557908096 msgsize 328 00000100:00100000:3.0:1783444590.619007:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:3.0:1783444590.619010:0:3626:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1783444590.619080:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557908096 00000100:00100000:2.0:1783444590.619096:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557908096 00000020:00000040:2.0:1783444590.619098:0:26215:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833679 00000020:00000040:2.0:1783444590.619114:0:26215:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c6ab4800 refcount=10 00000100:00000040:2.0:1783444590.619135:0:26215:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:2.0:1783444590.619144:0:26215:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368c513aa00 refcount=5 00010000:00010000:2.0:1783444590.619150:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 10 pid: 94359 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783444590.619189:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2606 00000100:00000040:2.0:1783444590.619193:0:26215:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c6ab4800 : new rpc_count 1 00000100:00000040:2.0:1783444590.619198:0:26215:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368c4d56450 x1870073557908096/t0(0) o103->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:211/0 lens 328/0 e 0 to 0 dl 1783444601 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.619209:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c4d56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557908096:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783444590.619222:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1783444590.619233:0:26215:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368c513aa00 refcount=5 00010000:00000040:2.0:1783444590.619237:0:26215:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368e7860200 count: 3 00010000:00010000:2.0:1783444590.619241:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 10 pid: 94359 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.619254:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 10 pid: 94359 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783444590.619268:0:26215:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9368c513aa00 with handle 0x42cb6883e3833744 from hash 00010000:00000040:2.0:1783444590.619273:0:26215:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9368f5756600 00010000:00010000:2.0:1783444590.619278:0:26215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1783444590.619286:0:26215:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9368e7860200) refcount = 3 00010000:00010000:2.0:1783444590.619290:0:26215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783444590.619425:0:26215:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006536834s 00000020:00000040:2.0:1783444590.619428:0:26215:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368f5756600 refcount=5 00010000:00010000:2.0:1783444590.619432:0:26215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.619440:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.619446:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.619454:0:26215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.619460:0:26215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9368f5756600 already unused, calling callback (ffffffffc0c36f90) 00010000:00010000:2.0:1783444590.619464:0:26215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783444590.619470:0:26215:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368f5756600 refcount=6 00010000:00010000:2.0:1783444590.619475:0:26215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1783444590.619483:0:26215:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9368f5756600 with handle 0x42cb6883e38345d7 from hash 00010000:00010000:2.0:1783444590.619488:0:26215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444590.619498:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:2.0:1783444590.619508:0:26215:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444590.619513:0:26215:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444590.619556:0:26215:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444590.619568:0:26215:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368c4d56450 x1870073557908096/t0(0) o103->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:211/0 lens 328/224 e 0 to 0 dl 1783444601 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444590.619579:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c4d56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2404:x1870073557908096:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 370us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444590.619586:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2606 00000100:00000040:2.0:1783444590.619589:0:26215:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c6ab4800 : new rpc_count 0 00000020:00000040:2.0:1783444590.619599:0:26215:0:(genops.c:900:class_export_put()) PUTting export ffff9367c6ab4800 : new refcount 9 00000100:00000040:1.0:1783444590.620064:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368e3ef9500 x1870073575468032/t0(0) o104->MGS@192.168.204.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1783444590.620549:0:94363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368c513aa00/0x42cb6883e3833744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xc0db330fc9939df2 expref: 9 pid: 94359 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.620559:0:94363:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9367c6ab4800 : new locks_count 3 00000020:00000040:1.0:1783444590.620561:0:94363:0:(genops.c:900:class_export_put()) PUTting export ffff9367c6ab4800 : new refcount 8 00000100:00000040:1.0:1783444590.620571:0:94363:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368e3ef9500 x1870073575468032/t0(0) o104->MGS@192.168.204.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783444590.620579:0:94363:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e3ef9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94363:1870073575468032:192.168.204.20@tcp:104: 00000100:00000040:1.0:1783444590.620590:0:94363:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368f9bc7100 x1870073575468160/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1783444590.620602:0:94363:0:(genops.c:1244:class_import_put()) import ffff9367c229d800 refcount=2 obd=MGS 00000100:00000040:1.0:1783444590.620616:0:94363:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367ccd92a00 x1870073575468288/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1783444590.620625:0:94363:0:(genops.c:1244:class_import_put()) import ffff9367c229d800 refcount=1 obd=MGS 00000100:00000040:1.0:1783444590.620633:0:94363:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368e3ef9500 x1870073575468032/t0(0) o104->MGS@192.168.204.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1783444606 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1783444590.620640:0:94363:0:(genops.c:1244:class_import_put()) import ffff9367c17b6000 refcount=1 obd=MGS 00010000:00010000:1.0:1783444590.620649:0:94363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.620659:0:94363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.620666:0:94363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783444590.620672:0:94363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9368f5756600/0x42cb6883e38345d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1783444590.620688:0:94363:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9368e7860200 count: 0 00010000:00080000:0.0:1783444590.621147:0:96948:0:(ldlm_lib.c:2840:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96948 00010000:02000000:0.0:1783444590.621162:0:96948:0:(ldlm_lib.c:2322:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1783444590.621166:0:96948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1783444590.621169:0:96948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:1.0:1783444590.621288:0:96931:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:1.0:1783444590.621296:0:96931:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9367c403d780 : new refcount 2 00000040:00000040:1.0:1783444590.621300:0:96931:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9367c403d780 : new refcount 1 00000020:00000040:1.0:1783444590.621331:0:96931:0:(genops.c:900:class_export_put()) PUTting export ffff9368f9916000 : new refcount 1 00000020:00000040:1.0:1783444590.621342:0:96931:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.120@tcp (ffff9368c507b380) now 6 - mgc_fs 10000000:01000000:1.0:1783444590.621345:0:96931:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783444590.621361:0:96931:0:(tgt_mount.c:2459:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783444590.621388:0:96931:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1783444590.622315:0:96931:0:(tgt_mount.c:2345:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783444590.622570:0:96931:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783444590.687827:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783444591.351409:0:96997:0:(tgt_mount.c:2345:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783444591.351739:0:96997:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783444591.713910:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00000040:2.0:1783444591.773100:0:6503:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9367c39f7400) refs 2 10000000:01000000:2.0:1783444591.773112:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783444591.773115:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368dd221800 from 128 10000000:01000000:2.0:1783444591.773119:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1783444591.773129:0:6503:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:2.0:1783444591.773161:0:6503:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9368f5756800 with handle 0x42cb6883e38345de to hash 00010000:00010000:2.0:1783444591.773171:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38345de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444591.773182:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38345de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783444591.773193:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38345de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444591.773233:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367ccd90e00 x1870073575468672/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444591.773247:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575468672:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1783444591.773273:0:6503:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367ccd90e00 x1870073575468672/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.773281:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444591.773329:0:6503:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed8b050 x1870073575468672 msgsize 328 00000100:00100000:2.0:1783444591.773335:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444591.773337:0:6503:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1783444591.773359:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367ccd90e00 x1870073575468672/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444591.773387:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9367c74910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783444591.776165:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575468672 00000100:00100000:0.0:1783444591.776188:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575468672 00000020:00000040:0.0:1783444591.776191:0:94359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444591.776197:0:94359:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=22 00000100:00000040:0.0:1783444591.776235:0:94359:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444591.776273:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00000040:0.0:1783444591.776278:0:94359:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444591.776286:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed8b050 x1870073575468672/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:212/0 lens 328/0 e 0 to 0 dl 1783444602 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444591.776300:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+22:6503:x1870073575468672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444591.776317:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:0.0:1783444591.776336:0:94359:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367ccfb8a00 with handle 0x42cb6883e38345e5 to hash 00010000:00010000:0.0:1783444591.776342:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367ccfb8a00/0x42cb6883e38345e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38345de expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444591.776351:0:94359:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9367c229a800 : new locks_count 17 00000020:00000040:0.0:1783444591.776354:0:94359:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=23 00010000:00000040:0.0:1783444591.776375:0:94359:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9368ddc46900) refcount = 1 00010000:00010000:0.0:1783444591.776380:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367ccfb8a00/0x42cb6883e38345e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38345de expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444591.776392:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367ccfb8a00/0x42cb6883e38345e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38345de expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444591.776402:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367ccfb8a00, rc 0) 00010000:00000040:0.0:1783444591.776405:0:94359:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575468672 00000100:00000040:0.0:1783444591.776414:0:94359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:0.0:1783444591.776419:0:94359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444591.776466:0:94359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9367ccd90e00 x1870073575468672/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444591.776504:0:94359:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00000100:00000040:0.0:1783444591.776509:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed8b050 x1870073575468672/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:212/0 lens 328/344 e 0 to 0 dl 1783444602 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444591.776518:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575468672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444591.776524:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00000040:0.0:1783444591.776527:0:94359:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:0.0:1783444591.776537:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00000100:00000040:3.0:1783444591.777982:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367ccd90e00 x1870073575468672/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.777996:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd90e00 x1870073575468672/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.778004:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367ccd90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575468672:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1783444591.778013:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367ccd90e00 x1870073575468672/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783444591.778026:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368f5756800 refcount=4 00010000:00000040:3.0:1783444591.778033:0:6503:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9368f5756800, remote cookie: 0x42cb6883e38345e5, flags: 0x0 00010000:00000040:3.0:1783444591.778039:0:6503:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9368d4d23100) refcount = 1 00010000:00010000:3.0:1783444591.778044:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38345de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444591.778054:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38345de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38345e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783444591.778064:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367ccd90e00 x1870073575468672/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783444591.778076:0:6503:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 10000000:00000040:3.0:1783444591.778086:0:6503:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9367c39f7400) refs 3 00000020:00000040:3.0:1783444591.778088:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368f5756800 refcount=3 00000020:00000040:3.0:1783444591.778107:0:6503:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:3.0:1783444591.778124:0:6503:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:3.0:1783444591.778139:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.778150:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575468800:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1783444591.778185:0:6503:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.778193:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444591.778276:0:6503:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed88c50 x1870073575468800 msgsize 304 00000100:00100000:3.0:1783444591.778281:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783444591.778283:0:6503:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783444591.778304:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.778337:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef0ae180 going to sleep for 11 seconds 00000100:00100000:0.0:1783444591.778337:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575468800 00000100:00100000:0.0:1783444591.778346:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575468800 00000020:00000040:0.0:1783444591.778350:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444591.778353:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=23 00000100:00000040:0.0:1783444591.778375:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444591.778404:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00000040:0.0:1783444591.778408:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444591.778414:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed88c50 x1870073575468800/t0(0) o256->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:212/0 lens 304/0 e 0 to 0 dl 1783444602 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444591.778426:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575468800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783444591.778445:0:94365:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:0.0:1783444591.778458:0:94365:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:0.0:1783444591.778465:0:94365:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783444591.778467:0:94365:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:0.0:1783444591.778473:0:94365:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=24 00000020:00000040:0.0:1783444591.778514:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00010000:00000040:0.0:1783444591.778530:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575468800 00000100:00000040:0.0:1783444591.778538:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:0.0:1783444591.778542:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444591.778562:0:94365:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444591.778576:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00000100:00000040:0.0:1783444591.778580:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed88c50 x1870073575468800/t0(0) o256->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:212/0 lens 304/240 e 0 to 0 dl 1783444602 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444591.778661:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575468800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 236us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444591.778668:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00000040:0.0:1783444591.778671:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:0.0:1783444591.778680:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 22 00000100:00000040:3.0:1783444591.780929:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.780942:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.780950:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.780957:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575468800:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1783444591.780965:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1783444591.782074:0:6503:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:3.0:1783444591.782089:0:6503:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1783444591.782110:0:6503:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.120@tcp has 192.168.204.120@tcp. 10000000:00000040:3.0:1783444591.782125:0:6503:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1783444591.782130:0:6503:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9368cb786800 already not connected (conn 6, was 0): DISCONN 00000100:00000040:3.0:1783444591.782141:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:3.0:1783444591.782144:0:6503:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:3.0:1783444591.782146:0:6503:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.120@tcp -> ffff9368f59e0380 00010000:00080000:3.0:1783444591.782150:0:6503:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9368cb786800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.204.120@tcp, moved to head 00010000:00000040:3.0:1783444591.782159:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 61 to 0@lo 00000100:00080000:3.0:1783444591.782164:0:6503:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1783444591.782169:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 60 to 0@lo 00000100:00000040:3.0:1783444591.782171:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 61 to 0@lo 00000020:00000040:3.0:1783444591.782174:0:6503:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833610 00000020:00000040:3.0:1783444591.782178:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368eb6ff000 refcount=4 00000100:00000040:3.0:1783444591.782181:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 60 to 0@lo 00000100:00000040:3.0:1783444591.782183:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 61 to 0@lo 00000020:00000040:3.0:1783444591.782185:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff9368eb6ff000 : new refcount 3 00000100:00080000:3.0:1783444591.782189:0:6503:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9368cb786800 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:3.0:1783444591.782318:0:6503:0:(genops.c:1231:class_import_get()) import ffff9368cb786800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1783444591.782340:0:6503:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1783444591.782353:0:6503:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000636ba505] to pc [ptlrpcd_rcv+-1] req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.782416:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444591.782440:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575468928:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1783444591.782470:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444616 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.782478:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444591.782510:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9367ccd90000 x1870073575468928 msgsize 520 00000100:00100000:2.0:1783444591.782516:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444591.782538:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444616 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.782551:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7961 usecs (8 jiffies) 10000000:00000040:3.0:1783444591.782575:0:6503:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1783444591.782584:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c33f7b80 x1870073575468800/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783444591.782594:0:6503:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:3.0:1783444591.782597:0:6503:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 10000000:01000000:3.0:1783444591.782618:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1783444591.782624:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9368f5756800 refcount=3 00010000:00010000:3.0:1783444591.782630:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38345de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444591.782641:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38345de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1783444591.782659:0:6503:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9368f9b54400) refs 2 10000000:00000040:3.0:1783444591.782662:0:6503:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9367c39f7400) refs 3 10000000:01000000:3.0:1783444591.782665:0:6503:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783444591.782668:0:6503:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9368ef0cd800 from 128 10000000:01000000:3.0:1783444591.782671:0:6503:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1783444591.782675:0:6503:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00010000:00000040:3.0:1783444591.782688:0:6503:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368d4d23100 count: 2 00000020:00000040:3.0:1783444591.782695:0:6503:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367c4750c00 with handle 0x42cb6883e38345ec to hash 00010000:00010000:3.0:1783444591.782703:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e38345ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444591.782718:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575468928 00010000:00010000:3.0:1783444591.782727:0:6503:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e38345ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783444591.782729:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575468928 00000020:00000040:0.0:1783444591.782734:0:26207:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833617 00010000:00010000:3.0:1783444591.782743:0:6503:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e38345ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783444591.782759:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c33f7b80 x1870073575469056/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.782768:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575469056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783444591.782782:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6002 00000100:00000040:3.0:1783444591.782784:0:6503:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c33f7b80 x1870073575469056/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444591.782808:0:26207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367ccd90000 x1870073575468928/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.782817:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1783444591.782826:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3632:x1870073575468928:12345-0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1783444591.782839:0:6503:0:(events.c:337:request_in_callback()) incoming req@ffff9368eed8a050 x1870073575469056 msgsize 328 00000020:00000040:0.0:1783444591.782843:0:26207:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 7 - find 00000100:00100000:3.0:1783444591.782845:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783444591.782849:0:6503:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00010000:00000040:0.0:1783444591.782856:0:26207:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1783444591.782865:0:26207:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9368c9a17800, cookie 0x42cb6883e3834583 00000100:00000040:3.0:1783444591.782867:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c33f7b80 x1870073575469056/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783444591.782873:0:26207:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294969471 exp ffff9368c9a17800 cur 3582 last 1783444590 00010000:02000400:0.0:1783444591.782886:0:26207:0:(ldlm_lib.c:2023:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:0.0:1783444591.782894:0:26207:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:0.0:1783444591.782906:0:26207:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.120@tcp 00000001:00000040:0.0:1783444591.782910:0:26207:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 19 00000100:00100000:3.0:1783444591.782913:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef0ae180 going to sleep for 11 seconds 00000020:00000040:0.0:1783444591.782915:0:26207:0:(genops.c:889:class_export_get()) GET export ffff9368c9a17800 refcount=4 00000001:00000040:0.0:1783444591.782919:0:26207:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 20 00000001:00000040:0.0:1783444591.782930:0:26207:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9367ceb06800) : new refcount 19 00002000:00100000:0.0:1783444591.782934:0:26207:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9368c9a17800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783444591.782938:0:26207:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783444591.782941:0:26207:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:0.0:1783444591.782951:0:26207:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9368c46567e0 for nid 0@lo - ref 2 00000020:00000040:0.0:1783444591.783043:0:26207:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 8 - import 00000020:00000040:0.0:1783444591.783048:0:26207:0:(genops.c:1244:class_import_put()) import ffff9368dd20e000 refcount=1 obd=lustre-OST0000 00000020:00000040:0.0:1783444591.783054:0:26207:0:(genops.c:889:class_export_get()) GET export ffff9368c9a17800 refcount=5 00000100:00000040:0.0:1783444591.783056:0:26207:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9368c9a17800 : new rpc_count 1 00000100:00000040:0.0:1783444591.783060:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:0.0:1783444591.783062:0:26207:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 62 to 0@lo 00000020:00000040:0.0:1783444591.783065:0:26207:0:(genops.c:889:class_export_get()) GET export ffff9368c9a17800 refcount=6 00000100:00000040:0.0:1783444591.783069:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 63 to 0@lo 00000100:00080000:0.0:1783444591.783076:0:26207:0:(import.c:65:import_set_state_nolock()) ffff9368dd20e000 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1783444591.783081:0:26207:0:(genops.c:900:class_export_put()) PUTting export ffff9368c9a17800 : new refcount 5 00000020:00000040:0.0:1783444591.783084:0:26207:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9367c7250000) now 8 - find 00010000:00000040:0.0:1783444591.783094:0:26207:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969471, transno 0, xid 1870073575468928 00000100:00000040:0.0:1783444591.783102:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 64 to 0@lo 00000100:00000040:0.0:1783444591.783107:0:26207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444591.783128:0:26207:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444616 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444591.788732:0:26207:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 63 to 0@lo 00000100:00000040:0.0:1783444591.788750:0:26207:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd90000 x1870073575468928/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783444611 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444591.788764:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575468928:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 5938us (6251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444591.788774:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6002 00000100:00000040:0.0:1783444591.788778:0:26207:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c9a17800 : new rpc_count 0 00000020:00000040:0.0:1783444591.788822:0:26207:0:(genops.c:900:class_export_put()) PUTting export ffff9368c9a17800 : new refcount 4 00000100:00100000:0.0:1783444591.788856:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575469056 00000100:00100000:0.0:1783444591.788864:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575469056 00000020:00000040:0.0:1783444591.788867:0:94359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:0.0:1783444591.788871:0:94359:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=23 00000100:00000040:0.0:1783444591.789016:0:94359:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1783444591.789047:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00000040:0.0:1783444591.789051:0:94359:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:0.0:1783444591.789056:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eed8a050 x1870073575469056/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:212/0 lens 328/0 e 0 to 0 dl 1783444602 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444591.789070:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+23:6503:x1870073575469056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783444591.789086:0:94359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1783444591.789098:0:94359:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368ddc46900 count: 2 00000020:00000040:0.0:1783444591.789106:0:94359:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367ccfb9c00 with handle 0x42cb6883e38345f3 to hash 00010000:00010000:0.0:1783444591.789111:0:94359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367ccfb9c00/0x42cb6883e38345f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42cb6883e38345ec expref: -99 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1783444591.789120:0:94359:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9367c229a800 : new locks_count 18 00000020:00000040:0.0:1783444591.789123:0:94359:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=24 00010000:00000040:0.0:1783444591.789141:0:94359:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9368ddc46900) refcount = 2 00010000:00000040:0.0:1783444591.789144:0:94359:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1783444591.789148:0:94359:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367ccfb8a00/0x42cb6883e38345e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38345de expref: 24 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444591.789155:0:94359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367ccfb9c00/0x42cb6883e38345f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42cb6883e38345ec expref: 24 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444591.789165:0:94359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367ccfb9c00/0x42cb6883e38345f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38345ec expref: 24 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783444591.789185:0:94359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367ccfb9c00, rc 0) 00010000:00000040:0.0:1783444591.789189:0:94359:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575469056 00000100:00000040:0.0:1783444591.789198:0:94359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 64 to 0@lo 00000100:00000040:0.0:1783444591.789204:0:94359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444591.789361:0:94359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9367c33f7b80 x1870073575469056/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444591.789425:0:94359:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 63 to 0@lo 00000100:00000040:0.0:1783444591.789430:0:94359:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eed8a050 x1870073575469056/t0(0) o101->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:212/0 lens 328/344 e 0 to 0 dl 1783444602 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444591.789439:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575469056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 373us (6599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444591.789445:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00000040:0.0:1783444591.789448:0:94359:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:0.0:1783444591.789456:0:94359:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00000100:00000040:3.0:1783444591.792926:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c33f7b80 x1870073575469056/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.792942:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f7b80 x1870073575469056/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.792951:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575469056:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1783444591.792965:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c33f7b80 x1870073575469056/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783444591.792979:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c4750c00 refcount=4 00010000:00000040:3.0:1783444591.792987:0:6503:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9367c4750c00, remote cookie: 0x42cb6883e38345f3, flags: 0x0 00010000:00000040:3.0:1783444591.792996:0:6503:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9368d4d23100) refcount = 2 00010000:00000040:3.0:1783444591.793000:0:6503:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783444591.793004:0:6503:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.204.120@tcp lock: ffff9368f5756800/0x42cb6883e38345de lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38345e5 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444591.793014:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e38345ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444591.793023:0:6503:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e38345ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42cb6883e38345f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1783444591.793034:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c33f7b80 x1870073575469056/t0(0) o101->MGC192.168.204.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1783444607 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783444591.793045:0:6503:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 10000000:00000040:3.0:1783444591.793057:0:6503:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9368f9b54400) refs 3 00000020:00000040:3.0:1783444591.793060:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c4750c00 refcount=3 00000020:00000040:3.0:1783444591.793088:0:6503:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:3.0:1783444591.793114:0:6503:0:(genops.c:1231:class_import_get()) import ffff9368eb774000 refcount=5 obd=MGC192.168.204.120@tcp 00000100:00000040:3.0:1783444591.793134:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.793146:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575469184:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1783444591.793173:0:6503:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.793181:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444591.793222:0:6503:0:(events.c:337:request_in_callback()) incoming req@ffff9368c9fcf850 x1870073575469184 msgsize 304 00000100:00100000:3.0:1783444591.793227:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783444591.793229:0:6503:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1783444591.793254:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.793681:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575469184 00000100:00100000:1.0:1783444591.793689:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575469184 00000020:00000040:1.0:1783444591.793692:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383355a 00000020:00000040:1.0:1783444591.793696:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c229a800 refcount=24 00000100:00000040:1.0:1783444591.793731:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783444591.793762:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00000040:1.0:1783444591.793766:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c229a800 : new rpc_count 1 00000100:00000040:1.0:1783444591.793772:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368c9fcf850 x1870073575469184/t0(0) o256->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:212/0 lens 304/0 e 0 to 0 dl 1783444602 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.793785:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575469184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783444591.793819:0:94365:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1783444591.793833:0:94365:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1783444591.793839:0:94365:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783444591.793841:0:94365:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1783444591.793847:0:94365:0:(genops.c:889:class_export_get()) GET export ffff9367c229a800 refcount=25 00000020:00000040:1.0:1783444591.793892:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 24 00010000:00000040:1.0:1783444591.793906:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575469184 00000100:00000040:1.0:1783444591.793916:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 64 to 0@lo 00000100:00000040:1.0:1783444591.793925:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444591.793938:0:94365:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444591.793964:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 63 to 0@lo 00000100:00000040:1.0:1783444591.793970:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368c9fcf850 x1870073575469184/t0(0) o256->c89ab73b-dbb2-4305-b221-37cc64d61227@0@lo:212/0 lens 304/240 e 0 to 0 dl 1783444602 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.793978:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c89ab73b-dbb2-4305-b221-37cc64d61227+24:6503:x1870073575469184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444591.793985:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00000040:1.0:1783444591.793988:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c229a800 : new rpc_count 0 00000020:00000040:1.0:1783444591.794012:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c229a800 : new refcount 23 00010000:00080000:2.0:1783444591.794153:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783444616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444591.794163:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969471 gen 2 00000100:00000040:2.0:1783444591.794288:0:3632:0:(client.c:3168:ptlrpc_free_committed()) @@@ commit (last_committed 4294969471) req@ffff9367c45e4a80 x1870073575449088/t4294969471(4294969471) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783444572 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.794298:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c45e4a80 x1870073575449088/t4294969471(4294969471) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783444572 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444591.794308:0:3632:0:(genops.c:1244:class_import_put()) import ffff9368cb786800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1783444591.794315:0:3632:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:2.0:1783444591.794321:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783444616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783444591.794339:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:2.0:1783444591.794342:0:3632:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833610 00000020:00000040:2.0:1783444591.794344:0:3632:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368eb6ff000 refcount=4 00000020:00000040:2.0:1783444591.794352:0:3632:0:(genops.c:900:class_export_put()) PUTting export ffff9368eb6ff000 : new refcount 3 00000100:00080000:2.0:1783444591.794357:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1783444591.794361:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1783444591.794364:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969471 gen 2 00000100:00000040:2.0:1783444591.794367:0:3632:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1783444591.794370:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9368cb786800 from lustre-OST0000_UUID committed 4294969471 last 0 00000100:00080000:2.0:1783444591.794373:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1783444591.794377:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9368ef0ae180 going to sleep for 11 seconds 00000020:00000040:2.0:1783444591.794377:0:3632:0:(genops.c:1231:class_import_get()) import ffff9368cb786800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1783444591.794395:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.794405:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.794413:0:6503:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.794422:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c89ab73b-dbb2-4305-b221-37cc64d61227:6503:1870073575469184:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1783444591.794432:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1783444591.794441:0:6503:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:3.0:1783444591.794453:0:6503:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1783444591.794464:0:6503:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.204.120@tcp has 192.168.204.120@tcp. 10000000:00000040:3.0:1783444591.794479:0:6503:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1783444591.794489:0:6503:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9367c17bb000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:3.0:1783444591.794500:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 64 to 0@lo 00000100:00000040:3.0:1783444591.794503:0:6503:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 64 to 0@lo 00000100:00000040:3.0:1783444591.794505:0:6503:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.204.120@tcp -> ffff9368f59e0380 00010000:00080000:3.0:1783444591.794509:0:6503:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9367c17bb000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.204.120@tcp, moved to head 00010000:00000040:3.0:1783444591.794513:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 63 to 0@lo 00000100:00080000:3.0:1783444591.794517:0:6503:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1783444591.794522:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:3.0:1783444591.794525:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 63 to 0@lo 00000020:00000040:3.0:1783444591.794527:0:6503:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf32 00000020:00000040:3.0:1783444591.794531:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a05000 refcount=4 00000100:00000040:3.0:1783444591.794534:0:6503:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 62 to 0@lo 00000100:00000040:3.0:1783444591.794537:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 63 to 0@lo 00000020:00000040:3.0:1783444591.794539:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a05000 : new refcount 3 00000100:00080000:3.0:1783444591.794542:0:6503:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9367c17bb000 using connection 192.168.204.120@tcp/0@lo 00000020:00000040:3.0:1783444591.794555:0:6503:0:(genops.c:1231:class_import_get()) import ffff9367c17bb000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1783444591.794558:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783444616 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444591.794567:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575468928:0@lo:8:ll_cfg_requeue.0 00000100:00100000:3.0:1783444591.794575:0:6503:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1783444591.794576:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c33f4a80 x1870073575468928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783444616 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444591.794594:0:3632:0:(genops.c:1244:class_import_put()) import ffff9368cb786800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:2.0:1783444591.794610:0:97020:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1783444591.794614:0:97020:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1783444591.794620:0:97020:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1783444591.794662:0:97020:0:(import.c:65:import_set_state_nolock()) ffff9368cb786800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1783444591.794667:0:97020:0:(genops.c:1231:class_import_get()) import ffff9368cb786800 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1783444591.794672:0:6503:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005be81694] to pc [ptlrpcd_rcv+-1] req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.794685:0:97020:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006eda2d19] to pc [ptlrpcd_rcv+-1] req@ffff9367ccd91f80 x1870073575469440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1783444591.794694:0:6503:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1783444591.794704:0:6503:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c33f7b80 x1870073575469184/t0(0) o256->MGC192.168.204.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1783444607 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444591.794725:0:97020:0:(genops.c:1244:class_import_put()) import ffff9368cb786800 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:3.0:1783444591.794729:0:6503:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=4 obd=MGC192.168.204.120@tcp 00000020:00000040:3.0:1783444591.794733:0:6503:0:(genops.c:1244:class_import_put()) import ffff9368eb774000 refcount=3 obd=MGC192.168.204.120@tcp 00000100:00000040:2.0:1783444591.794739:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444591.794752:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575469312:0@lo:8:ll_cfg_requeue.0 10000000:01000000:3.0:1783444591.794754:0:6503:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1783444591.794761:0:6503:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9367c4750c00 refcount=3 00010000:00010000:3.0:1783444591.794766:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e38345ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1783444591.794773:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444616 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783444591.794809:0:6503:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff9367c4750c00/0x42cb6883e38345ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42cb6883e38345f3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1783444591.794821:0:6503:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9368f9b54400) refs 3 00000100:00000040:2.0:1783444591.794822:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444591.794849:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9367ccd92680 x1870073575469312 msgsize 520 00000100:00100000:2.0:1783444591.794853:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444591.794881:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444616 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.794891:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 4190 usecs (5 jiffies) 00000100:00000040:2.0:1783444591.794897:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367ccd91f80 x1870073575469440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444591.794906:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3632:1870073575469440:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1783444591.794917:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9367ccd91f80 x1870073575469440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444607 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.794923:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444591.794935:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9367ccd90e00 x1870073575469440 msgsize 224 00000100:00100000:2.0:1783444591.794938:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444591.794951:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367ccd91f80 x1870073575469440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444607 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444591.794959:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8172 usecs (9 jiffies) 00000100:00100000:1.0:1783444591.795166:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575469312 00000100:00100000:1.0:1783444591.795171:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575469312 00000020:00000040:1.0:1783444591.795173:0:8421:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf47 00000100:00100000:1.0:1783444591.795211:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575469440 00000100:00100000:1.0:1783444591.795214:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575469440 00000020:00000040:1.0:1783444591.795215:0:8421:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3834583 00000020:00000040:1.0:1783444591.795218:0:8421:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c9a17800 refcount=5 00000100:00000040:1.0:1783444591.795233:0:8421:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1783444591.795248:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00000040:1.0:1783444591.795251:0:8421:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c9a17800 : new rpc_count 1 00000100:00000040:1.0:1783444591.795255:0:8421:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367ccd90e00 x1870073575469440/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:212/0 lens 224/0 e 0 to 0 dl 1783444602 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.795265:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575469440:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:1.0:1783444591.795275:0:8421:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367ccd90e00 x1870073575469440/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:212/0 lens 224/0 e 0 to 0 dl 1783444602 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444591.795284:0:8421:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9368c9a17800 : new rpc_count 2 00010000:00080000:1.0:1783444591.795288:0:8421:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9367ccd90e00 x1870073575469440/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:212/0 lens 224/0 e 0 to 0 dl 1783444602 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444591.795312:0:8421:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd90e00 x1870073575469440/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:212/0 lens 224/0 e 0 to 0 dl 1783444602 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.795321:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3632:x1870073575469440:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 57us (383us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444591.795327:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00000040:1.0:1783444591.795330:0:8421:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c9a17800 : new rpc_count 1 00000100:00100000:1.0:1783444591.795339:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6003 00000100:00000040:1.0:1783444591.795343:0:8421:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367ccd92680 x1870073575469312/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.795352:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3632:x1870073575469312:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1783444591.795366:0:8421:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 8 - find 00010000:00000040:1.0:1783444591.795376:0:8421:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1783444591.795383:0:8421:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9367cae88000, cookie 0x42cb6883e383457c 00010000:00080000:1.0:1783444591.795388:0:8421:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9367cae88000 cur 3582 last 1783444590 00000001:00000040:1.0:1783444591.795400:0:8421:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.204.120@tcp 00000001:00000040:1.0:1783444591.795404:0:8421:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 20 00000020:00000040:1.0:1783444591.795407:0:8421:0:(genops.c:889:class_export_get()) GET export ffff9367cae88000 refcount=4 00000001:00000040:1.0:1783444591.795409:0:8421:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 21 00000001:00000040:1.0:1783444591.795412:0:8421:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9367ceb06800) : new refcount 20 00002000:00100000:1.0:1783444591.795415:0:8421:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9367cae88000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1783444591.795419:0:8421:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1783444591.795422:0:8421:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:1.0:1783444591.795430:0:8421:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9368c46567e0 for nid 0@lo - ref 3 00000020:00000040:1.0:1783444591.795557:0:8421:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 9 - import 00000020:00000040:1.0:1783444591.795564:0:8421:0:(genops.c:1244:class_import_put()) import ffff936901f96000 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1783444591.795576:0:8421:0:(genops.c:889:class_export_get()) GET export ffff9367cae88000 refcount=5 00000100:00000040:1.0:1783444591.795577:0:8421:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9367cae88000 : new rpc_count 1 00000100:00000040:1.0:1783444591.795581:0:8421:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 64 to 0@lo 00000100:00000040:1.0:1783444591.795584:0:8421:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368f59e0380 refcount 64 to 0@lo 00000020:00000040:1.0:1783444591.795586:0:8421:0:(genops.c:889:class_export_get()) GET export ffff9367cae88000 refcount=6 00000100:00000040:1.0:1783444591.795591:0:8421:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 65 to 0@lo 00000100:00080000:1.0:1783444591.795597:0:8421:0:(import.c:65:import_set_state_nolock()) ffff936901f96000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1783444591.795602:0:8421:0:(genops.c:900:class_export_put()) PUTting export ffff9367cae88000 : new refcount 5 00000020:00000040:1.0:1783444591.795604:0:8421:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9367c7250000) now 9 - find 00010000:00000040:1.0:1783444591.795614:0:8421:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1870073575469312 00000100:00000040:1.0:1783444591.795622:0:8421:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 66 to 0@lo 00000100:00000040:1.0:1783444591.795626:0:8421:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444591.795645:0:8421:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1783444616 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444591.795673:0:8421:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 65 to 0@lo 00000100:00000040:1.0:1783444591.795678:0:8421:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd92680 x1870073575469312/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1783444611 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.795687:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3632:x1870073575469312:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 334us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444591.795693:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6003 00000100:00000040:1.0:1783444591.795696:0:8421:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367cae88000 : new rpc_count 0 00010000:00080000:3.0:1783444591.795719:0:3632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783444616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1783444591.795727:0:8421:0:(genops.c:900:class_export_put()) PUTting export ffff9367cae88000 : new refcount 4 00000100:00000040:3.0:1783444591.795730:0:3632:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:3.0:1783444591.795737:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783444616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444591.795746:0:3632:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:3.0:1783444591.795749:0:3632:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf32 00000020:00000040:3.0:1783444591.795752:0:3632:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a05000 refcount=4 00000020:00000040:3.0:1783444591.795758:0:3632:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a05000 : new refcount 3 00000100:00080000:3.0:1783444591.795762:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1783444591.795765:0:3632:0:(import.c:1699:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1783444591.795768:0:3632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969442 gen 2 00000100:00000040:3.0:1783444591.795770:0:3632:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1783444591.795773:0:3632:0:(recover.c:53:ptlrpc_replay_next()) import ffff9367c17bb000 from lustre-OST0000_UUID committed 4294969442 last 0 00000100:00080000:3.0:1783444591.795776:0:3632:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1783444591.795779:0:3632:0:(genops.c:1231:class_import_get()) import ffff9367c17bb000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:0.0:1783444591.796346:0:96948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:3.0:1783444591.796520:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783444616 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.796529:0:3632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575469312:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1783444591.796536:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c33f5880 x1870073575469312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783444616 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1783444591.796558:0:3632:0:(genops.c:1244:class_import_put()) import ffff9367c17bb000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:2.0:1783444591.796738:0:97021:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1783444591.796742:0:97021:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1783444591.796752:0:97021:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1783444591.796818:0:97021:0:(import.c:65:import_set_state_nolock()) ffff9367c17bb000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1783444591.796825:0:97021:0:(genops.c:1231:class_import_get()) import ffff9367c17bb000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1783444591.796843:0:97021:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008001f438] to pc [ptlrpcd_rcv+-1] req@ffff9367ccd92a00 x1870073575469568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444591.796857:0:97021:0:(genops.c:1244:class_import_put()) import ffff9367c17bb000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1783444591.796886:0:3632:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367ccd92a00 x1870073575469568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.796899:0:3632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367ccd92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3632:1870073575469568:0@lo:400:ldlm_lock_repla.0 00000100:00000040:3.0:1783444591.796920:0:3632:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9367ccd92a00 x1870073575469568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444607 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444591.796928:0:3632:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444591.796951:0:3632:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f5880 x1870073575469568 msgsize 224 00000100:00100000:3.0:1783444591.796956:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1783444591.796975:0:3632:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367ccd92a00 x1870073575469568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783444607 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.796978:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575469568 00000100:00100000:1.0:1783444591.796985:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575469568 00000100:00000040:3.0:1783444591.796990:0:3632:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 4180 usecs (5 jiffies) 00000020:00000040:1.0:1783444591.796990:0:8420:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383457c 00000020:00000040:1.0:1783444591.796995:0:8420:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367cae88000 refcount=5 00000100:00100000:1.0:1783444591.797038:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00000040:1.0:1783444591.797042:0:8420:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367cae88000 : new rpc_count 1 00000100:00000040:1.0:1783444591.797047:0:8420:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f5880 x1870073575469568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:212/0 lens 224/0 e 0 to 0 dl 1783444602 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.797069:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1870073575469568:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:1.0:1783444591.797079:0:8420:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f5880 x1870073575469568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:212/0 lens 224/0 e 0 to 0 dl 1783444602 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444591.797087:0:8420:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367cae88000 : new rpc_count 2 00010000:00080000:1.0:1783444591.797091:0:8420:0:(ldlm_lib.c:3124:target_queue_recovery_request()) @@@ queue final req req@ffff9367c33f5880 x1870073575469568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:212/0 lens 224/0 e 0 to 0 dl 1783444602 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444591.797109:0:8420:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f5880 x1870073575469568/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:212/0 lens 224/0 e 0 to 0 dl 1783444602 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.797117:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3632:x1870073575469568:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 50us (164us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444591.797123:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00000040:1.0:1783444591.797125:0:8420:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367cae88000 : new rpc_count 1 00010000:00080000:3.0:1783444591.797160:0:96948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:1.0:1783444591.954285:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9368c9fcfc50 x1870073557908224 msgsize 328 00000100:00100000:1.0:1783444591.954304:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444591.954306:0:3628:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1783444591.954393:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557908224 00000100:00100000:3.0:1783444591.954405:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557908224 00000020:00000040:3.0:1783444591.954408:0:94360:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833679 00000020:00000040:3.0:1783444591.954414:0:94360:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c6ab4800 refcount=9 00000100:00000040:3.0:1783444591.954439:0:94360:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1783444591.954489:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00000040:3.0:1783444591.954493:0:94360:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c6ab4800 : new rpc_count 1 00000100:00000040:3.0:1783444591.954501:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368c9fcfc50 x1870073557908224/t0(0) o101->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:212/0 lens 328/0 e 0 to 0 dl 1783444602 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.954523:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+9:70972:x1870073557908224:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783444591.954539:0:94360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1783444591.954548:0:94360:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9368ddc46900 count: 3 00000020:00000040:3.0:1783444591.954555:0:94360:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9367c4751e00 with handle 0x42cb6883e38345fa to hash 00010000:00010000:3.0:1783444591.954570:0:94360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9367c4751e00/0x42cb6883e38345fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc0db330fc993a187 expref: -99 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783444591.954579:0:94360:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9367c6ab4800 : new locks_count 4 00000020:00000040:3.0:1783444591.954581:0:94360:0:(genops.c:889:class_export_get()) GET export ffff9367c6ab4800 refcount=10 00010000:00000040:3.0:1783444591.954602:0:94360:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9368ddc46900) refcount = 3 00010000:00000040:3.0:1783444591.954605:0:94360:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1783444591.954610:0:94360:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367ccfb9c00/0x42cb6883e38345f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38345ec expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1783444591.954618:0:94360:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9367ccfb8a00/0x42cb6883e38345e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42cb6883e38345de expref: 23 pid: 94359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444591.954625:0:94360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9367c4751e00/0x42cb6883e38345fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a187 expref: 10 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444591.954635:0:94360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9367c4751e00/0x42cb6883e38345fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xc0db330fc993a187 expref: 10 pid: 94360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783444591.954644:0:94360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9367c4751e00, rc 0) 00010000:00000040:3.0:1783444591.954648:0:94360:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073557908224 00000100:00000040:3.0:1783444591.954656:0:94360:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444591.954662:0:94360:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:3.0:1783444591.954730:0:94360:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444591.954736:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368c9fcfc50 x1870073557908224/t0(0) o101->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:212/0 lens 328/344 e 0 to 0 dl 1783444602 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444591.954745:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557908224:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 224us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444591.954751:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00000040:3.0:1783444591.954754:0:94360:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c6ab4800 : new rpc_count 0 00000020:00000040:3.0:1783444591.954770:0:94360:0:(genops.c:900:class_export_put()) PUTting export ffff9367c6ab4800 : new refcount 9 00000100:00000040:0.0:1783444591.963012:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368c9fccc50 x1870073557908352 msgsize 304 00000100:00100000:0.0:1783444591.963033:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:0.0:1783444591.963035:0:3627:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1783444591.963112:0:94365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557908352 00000100:00100000:1.0:1783444591.963123:0:94365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557908352 00000020:00000040:1.0:1783444591.963127:0:94365:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833679 00000020:00000040:1.0:1783444591.963132:0:94365:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c6ab4800 refcount=10 00000100:00000040:1.0:1783444591.963158:0:94365:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1783444591.963187:0:94365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00000040:1.0:1783444591.963192:0:94365:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c6ab4800 : new rpc_count 1 00000100:00000040:1.0:1783444591.963210:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368c9fccc50 x1870073557908352/t0(0) o256->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:212/0 lens 304/0 e 0 to 0 dl 1783444602 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.963224:0:94365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557908352:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783444591.963265:0:94365:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:1.0:1783444591.963277:0:94365:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1783444591.963284:0:94365:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783444591.963286:0:94365:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1783444591.963292:0:94365:0:(genops.c:889:class_export_get()) GET export ffff9367c6ab4800 refcount=11 00000020:00000040:1.0:1783444591.970547:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c6ab4800 : new refcount 10 00010000:00000040:1.0:1783444591.970573:0:94365:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073557908352 00000100:00000040:1.0:1783444591.970591:0:94365:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444591.970600:0:94365:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444591.970655:0:94365:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 8 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444591.970665:0:94365:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368c9fccc50 x1870073557908352/t0(0) o256->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:212/0 lens 304/240 e 0 to 0 dl 1783444602 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.970677:0:94365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:28921b6e-3bc9-4a81-ae87-1992169ba754+10:70972:x1870073557908352:12345-192.168.204.20@tcp:256:ll_cfg_requeue.0 Request processed in 7455us (7667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444591.970697:0:94365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00000040:1.0:1783444591.970701:0:94365:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c6ab4800 : new rpc_count 0 00000020:00000040:1.0:1783444591.970737:0:94365:0:(genops.c:900:class_export_put()) PUTting export ffff9367c6ab4800 : new refcount 9 00000100:00000040:0.0:1783444591.978069:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afe300 x1870073557908480 msgsize 520 00000100:00100000:0.0:1783444591.978087:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444591.978921:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557908480 00000100:00100000:1.0:1783444591.978932:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557908480 00000020:00000040:1.0:1783444591.978936:0:26201:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833974 00000100:00100000:1.0:1783444591.978989:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6004 00000100:00000040:1.0:1783444591.978999:0:26201:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afe300 x1870073557908480/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1783444611 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.979012:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2400:x1870073557908480:12345-192.168.204.20@tcp:8:ll_cfg_requeue.0 00000020:00000040:1.0:1783444591.979033:0:26201:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 9 - find 00010000:00000040:1.0:1783444591.979045:0:26201:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1783444591.979053:0:26201:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '08efc25c-17e5-4d29-97d2-f1505f195a06' at ffff9367c17cd800, cookie 0x42cb6883e383458a 00010000:00080000:1.0:1783444591.979064:0:26201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp recovering/t4294969455 exp ffff9367c17cd800 cur 3583 last 1783444590 00000001:00000040:1.0:1783444591.979078:0:26201:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 21 00000020:00000040:1.0:1783444591.979083:0:26201:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=4 00000001:00000040:1.0:1783444591.979085:0:26201:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9367ceb06800) : new refcount 22 00000001:00000040:1.0:1783444591.979089:0:26201:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9367ceb06800) : new refcount 21 00002000:00100000:1.0:1783444591.979093:0:26201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 08efc25c-17e5-4d29-97d2-f1505f195a06/ffff9367c17cd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783444591.979109:0:26201:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:1.0:1783444591.979120:0:26201:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9367c75d2600 for nid 192.168.204.20@tcp - ref 2 00000020:00000040:1.0:1783444591.979227:0:26201:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 10 - import 00000020:00000040:1.0:1783444591.979234:0:26201:0:(genops.c:1244:class_import_put()) import ffff936901f92000 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1783444591.979241:0:26201:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=5 00000100:00000040:1.0:1783444591.979244:0:26201:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444591.979255:0:26201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444591.979258:0:26201:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9368c66ceac0 refcount 9 to 192.168.204.20@tcp 00000020:00000040:1.0:1783444591.979261:0:26201:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=6 00000100:00000040:1.0:1783444591.979268:0:26201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00000100:00080000:1.0:1783444591.979277:0:26201:0:(import.c:65:import_set_state_nolock()) ffff936901f92000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1783444591.979292:0:26201:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 5 00000020:00000040:1.0:1783444591.979296:0:26201:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9367c7250000) now 10 - find 00010000:00000040:1.0:1783444591.979307:0:26201:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 0, xid 1870073557908480 00000100:00000040:1.0:1783444591.979315:0:26201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444591.979322:0:26201:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444591.979366:0:26201:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444591.979372:0:26201:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afe300 x1870073557908480/t0(0) o8->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:0/0 lens 520/416 e 0 to 0 dl 1783444611 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444591.979382:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2400:x1870073557908480:12345-192.168.204.20@tcp:8:ll_cfg_requeue.0 Request processed in 370us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444591.979399:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6004 00000100:00000040:1.0:1783444591.979402:0:26201:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444591.979428:0:26201:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 4 00010000:00080000:1.0:1783444591.979445:0:96948:0:(ldlm_lib.c:2532:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:1.0:1783444591.979450:0:96948:0:(ldlm_lib.c:2861:target_recovery_thread()) 1: request replay stage - 1 clients from t4294969476 00010000:00080000:1.0:1783444591.979452:0:96948:0:(ldlm_lib.c:2670:replay_request_or_update()) Waiting for transno 4294969476 00010000:00080000:1.0:1783444591.979457:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969476 00010000:00080000:1.0:1783444591.979461:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969476 00000100:00000040:3.0:1783444591.988530:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f7b80 x1870073557879168 msgsize 440 00000100:00100000:3.0:1783444591.988544:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444591.988584:0:24870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557879168 00000100:00100000:3.0:1783444591.988595:0:24870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557879168 00000020:00000040:3.0:1783444591.988598:0:24870:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444591.988603:0:24870:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=5 00000100:00000040:3.0:1783444591.988631:0:24870:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444591.988881:0:24870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1048 00000100:00000040:3.0:1783444591.988887:0:24870:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444591.988895:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f7b80 x1870073557879168/t0(4294969476) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444591.988911:0:24870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2400:x1870073557879168:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:3.0:1783444591.988924:0:24870:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f7b80 x1870073557879168/t0(4294969476) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444591.988934:0:24870:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969476, current: 4294969476, replaying 00010000:00000040:3.0:1783444591.988938:0:24870:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444591.988950:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f7b80 x1870073557879168/t0(4294969476) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444591.988959:0:24870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+5:2400:x1870073557879168:12345-192.168.204.20@tcp:10:dd.0 Request processed in 52us (430us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444591.988966:0:24870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1048 00000100:00000040:3.0:1783444591.988969:0:24870:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:3.0:1783444591.988989:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969476, next_transno: 4294969476 00010000:00080000:3.0:1783444591.988993:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969476) 00010000:00080000:3.0:1783444591.989001:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557879168 t4294969476 from 192.168.204.20@tcp req@ffff9367c33f7b80 x1870073557879168/t0(4294969476) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444591.989032:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f7b80 x1870073557879168/t0(4294969476) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783444591.989060:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x382:0x0] 00000001:00000040:3.0:1783444591.991954:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 1 00000020:00000040:3.0:1783444591.991963:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=6 00010000:00000040:3.0:1783444591.992019:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969476, xid 1870073557879168 00000100:00000040:3.0:1783444591.992033:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444591.992041:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:3.0:1783444591.992089:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:3.0:1783444591.992104:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783444591.992112:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:3.0:1783444591.992122:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 5 00010000:00080000:3.0:1783444591.992127:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969477 00010000:00080000:3.0:1783444591.992132:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969477 00000100:00000040:3.0:1783444591.994984:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f5c00 x1870073557880192 msgsize 440 00000100:00100000:3.0:1783444591.995000:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444591.995111:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557880192 00000100:00100000:0.0:1783444591.995121:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557880192 00000020:00000040:0.0:1783444591.995125:0:25160:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444591.995130:0:25160:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=6 00000100:00000040:0.0:1783444591.995157:0:25160:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783444591.995199:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1049 00000100:00000040:0.0:1783444591.995204:0:25160:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444591.995219:0:25160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f5c00 x1870073557880192/t0(4294969477) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444591.995234:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557880192:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:0.0:1783444591.995245:0:25160:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f5c00 x1870073557880192/t0(4294969477) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444591.995255:0:25160:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969477, current: 4294969477, replaying 00010000:00000040:0.0:1783444591.995258:0:25160:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:0.0:1783444591.995267:0:25160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f5c00 x1870073557880192/t0(4294969477) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444591.995276:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+6:2400:x1870073557880192:12345-192.168.204.20@tcp:10:dd.0 Request processed in 46us (293us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444591.995282:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1049 00000100:00000040:0.0:1783444591.995286:0:25160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:3.0:1783444591.995360:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969477, next_transno: 4294969477 00010000:00080000:3.0:1783444591.995365:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969477) 00010000:00080000:3.0:1783444591.995375:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557880192 t4294969477 from 192.168.204.20@tcp req@ffff9367c33f5c00 x1870073557880192/t0(4294969477) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444591.995391:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f5c00 x1870073557880192/t0(4294969477) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:212/0 lens 440/0 e 0 to 0 dl 1783444602 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783444591.995421:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x388:0x0] 00000001:00000040:3.0:1783444591.995963:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 2 00000020:00000040:3.0:1783444591.995967:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=7 00010000:00000040:3.0:1783444591.996000:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969477, xid 1870073557880192 00000100:00000040:3.0:1783444591.996017:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444591.996023:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:3.0:1783444591.996077:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:3.0:1783444591.996087:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783444591.996093:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:3.0:1783444591.996104:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 6 00010000:00080000:3.0:1783444591.996109:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969478 00010000:00080000:3.0:1783444591.996112:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969478 00000100:00000040:0.0:1783444592.002407:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afc000 x1870073557882752 msgsize 440 00000100:00100000:0.0:1783444592.002422:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444592.002464:0:25148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557882752 00000100:00100000:0.0:1783444592.002473:0:25148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557882752 00000020:00000040:0.0:1783444592.002476:0:25148:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444592.002480:0:25148:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=7 00000100:00000040:0.0:1783444592.002520:0:25148:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +7s 00000100:00100000:0.0:1783444592.002675:0:25148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1050 00000100:00000040:0.0:1783444592.002679:0:25148:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444592.002937:0:25148:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afc000 x1870073557882752/t0(4294969478) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.003144:0:25148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2400:x1870073557882752:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:0.0:1783444592.003169:0:25148:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afc000 x1870073557882752/t0(4294969478) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444592.003180:0:25148:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969478, current: 4294969478, replaying 00010000:00000040:0.0:1783444592.003183:0:25148:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:0.0:1783444592.003196:0:25148:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afc000 x1870073557882752/t0(4294969478) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.003207:0:25148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2400:x1870073557882752:12345-192.168.204.20@tcp:10:dd.0 Request processed in 70us (800us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444592.003215:0:25148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1050 00000100:00000040:0.0:1783444592.003219:0:25148:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.003261:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969478, next_transno: 4294969478 00010000:00080000:0.0:1783444592.003265:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969478) 00010000:00080000:0.0:1783444592.003273:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557882752 t4294969478 from 192.168.204.20@tcp req@ffff9367c3afc000 x1870073557882752/t0(4294969478) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.003292:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afc000 x1870073557882752/t0(4294969478) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783444592.003323:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x391:0x0] 00000001:00000040:0.0:1783444592.003507:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 3 00000020:00000040:0.0:1783444592.003511:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=8 00010000:00000040:0.0:1783444592.003550:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969478, xid 1870073557882752 00000100:00000040:0.0:1783444592.003559:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.003565:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.003611:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.003620:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.003626:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.003638:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 7 00010000:00080000:0.0:1783444592.003649:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969479 00010000:00080000:0.0:1783444592.003653:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969479 00000100:00000040:2.0:1783444592.010298:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367ccd93100 x1870073557883392 msgsize 440 00000100:00100000:2.0:1783444592.010316:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.010388:0:25139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557883392 00000100:00100000:1.0:1783444592.010398:0:25139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557883392 00000020:00000040:1.0:1783444592.010401:0:25139:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.010407:0:25139:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=8 00000100:00000040:1.0:1783444592.010433:0:25139:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.010589:0:25139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1051 00000100:00000040:1.0:1783444592.010594:0:25139:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.010602:0:25139:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367ccd93100 x1870073557883392/t0(4294969479) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.010616:0:25139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2400:x1870073557883392:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:1.0:1783444592.010629:0:25139:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367ccd93100 x1870073557883392/t0(4294969479) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.010640:0:25139:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969479, current: 4294969479, replaying 00010000:00000040:1.0:1783444592.010643:0:25139:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.010657:0:25139:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd93100 x1870073557883392/t0(4294969479) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.010667:0:25139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+8:2400:x1870073557883392:12345-192.168.204.20@tcp:10:dd.0 Request processed in 54us (369us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.010682:0:25139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1051 00000100:00000040:1.0:1783444592.010685:0:25139:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.010874:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969479, next_transno: 4294969479 00010000:00080000:0.0:1783444592.010879:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969479) 00010000:00080000:0.0:1783444592.010889:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557883392 t4294969479 from 192.168.204.20@tcp req@ffff9367ccd93100 x1870073557883392/t0(4294969479) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.010906:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367ccd93100 x1870073557883392/t0(4294969479) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783444592.010939:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x383:0x0] 00000001:00000040:0.0:1783444592.011113:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 4 00000020:00000040:0.0:1783444592.011117:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=9 00010000:00000040:0.0:1783444592.011152:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969479, xid 1870073557883392 00000100:00000040:0.0:1783444592.011162:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.011167:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.011215:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.011224:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.011229:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.011246:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 8 00010000:00080000:0.0:1783444592.011251:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969480 00010000:00080000:0.0:1783444592.011255:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969480 00000100:00000040:1.0:1783444592.017219:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7a9c00 x1870073557883520 msgsize 440 00000100:00100000:1.0:1783444592.017235:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.017605:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557883520 00000100:00100000:2.0:1783444592.017616:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557883520 00000020:00000040:2.0:1783444592.017619:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.017624:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=9 00000100:00000040:2.0:1783444592.017647:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.017701:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1052 00000100:00000040:2.0:1783444592.017716:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.017724:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7a9c00 x1870073557883520/t0(4294969480) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.017739:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2400:x1870073557883520:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:2.0:1783444592.017752:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a9c00 x1870073557883520/t0(4294969480) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.017761:0:24883:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969480, current: 4294969480, replaying 00010000:00000040:2.0:1783444592.017764:0:24883:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.017786:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9c00 x1870073557883520/t0(4294969480) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.017812:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+9:2400:x1870073557883520:12345-192.168.204.20@tcp:10:dd.0 Request processed in 76us (595us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.017829:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1052 00000100:00000040:2.0:1783444592.017833:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.017972:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969480, next_transno: 4294969480 00010000:00080000:1.0:1783444592.017977:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969480) 00010000:00080000:1.0:1783444592.017985:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557883520 t4294969480 from 192.168.204.20@tcp req@ffff9368eb7a9c00 x1870073557883520/t0(4294969480) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.018000:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a9c00 x1870073557883520/t0(4294969480) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783444592.018028:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x389:0x0] 00000001:00000040:1.0:1783444592.018199:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 5 00000020:00000040:1.0:1783444592.018202:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=10 00010000:00000040:1.0:1783444592.018240:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969480, xid 1870073557883520 00000100:00000040:1.0:1783444592.018249:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.018255:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.018341:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.018349:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.018356:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.018366:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 9 00010000:00080000:1.0:1783444592.018370:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00010000:00080000:1.0:1783444592.018374:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00000100:00000040:2.0:1783444592.023640:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367ccd90a80 x1870073557884416 msgsize 440 00000100:00100000:2.0:1783444592.023656:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.023738:0:24882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557884416 00000100:00100000:3.0:1783444592.023748:0:24882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557884416 00000020:00000040:3.0:1783444592.023753:0:24882:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.023758:0:24882:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=10 00000100:00000040:3.0:1783444592.023783:0:24882:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.023853:0:24882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1053 00000100:00000040:3.0:1783444592.023860:0:24882:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.023867:0:24882:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367ccd90a80 x1870073557884416/t0(4294969481) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.023880:0:24882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367ccd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2400:x1870073557884416:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:3.0:1783444592.023892:0:24882:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367ccd90a80 x1870073557884416/t0(4294969481) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.023902:0:24882:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969481, current: 4294969481, replaying 00010000:00000040:3.0:1783444592.023905:0:24882:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.023919:0:24882:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367ccd90a80 x1870073557884416/t0(4294969481) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.023927:0:24882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367ccd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+10:2400:x1870073557884416:12345-192.168.204.20@tcp:10:dd.0 Request processed in 49us (288us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.023933:0:24882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1053 00000100:00000040:3.0:1783444592.023944:0:24882:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.024694:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969481, next_transno: 4294969481 00010000:00080000:1.0:1783444592.024700:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969481) 00010000:00080000:1.0:1783444592.024722:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557884416 t4294969481 from 192.168.204.20@tcp req@ffff9367ccd90a80 x1870073557884416/t0(4294969481) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.024754:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367ccd90a80 x1870073557884416/t0(4294969481) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783444592.024781:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x384:0x0] 00000001:00000040:1.0:1783444592.025044:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 6 00000020:00000040:1.0:1783444592.025048:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=11 00010000:00000040:1.0:1783444592.025078:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969481, xid 1870073557884416 00000100:00000040:1.0:1783444592.025088:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.025094:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.025987:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.026003:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.026011:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.026022:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 10 00010000:00080000:1.0:1783444592.026028:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00010000:00080000:1.0:1783444592.026032:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00000100:00000040:0.0:1783444592.042360:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afce00 x1870073557886336 msgsize 440 00000100:00100000:0.0:1783444592.042377:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.043140:0:24870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557886336 00000100:00100000:1.0:1783444592.043151:0:24870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557886336 00000020:00000040:1.0:1783444592.043155:0:24870:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.043160:0:24870:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=11 00000100:00000040:1.0:1783444592.043188:0:24870:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.043234:0:24870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1054 00000100:00000040:1.0:1783444592.043239:0:24870:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.043247:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afce00 x1870073557886336/t0(4294969482) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.043267:0:24870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2400:x1870073557886336:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:1.0:1783444592.043279:0:24870:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afce00 x1870073557886336/t0(4294969482) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.043299:0:24870:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969482, current: 4294969482, replaying 00010000:00000040:1.0:1783444592.043302:0:24870:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.043315:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afce00 x1870073557886336/t0(4294969482) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.043324:0:24870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2400:x1870073557886336:12345-192.168.204.20@tcp:10:dd.0 Request processed in 59us (965us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.043331:0:24870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1054 00000100:00000040:1.0:1783444592.043334:0:24870:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.043354:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969482, next_transno: 4294969482 00010000:00080000:1.0:1783444592.043359:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969482) 00010000:00080000:1.0:1783444592.043366:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557886336 t4294969482 from 192.168.204.20@tcp req@ffff9367c3afce00 x1870073557886336/t0(4294969482) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.043379:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afce00 x1870073557886336/t0(4294969482) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783444592.043405:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38a:0x0] 00000001:00000040:1.0:1783444592.043603:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 7 00000020:00000040:1.0:1783444592.043607:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=12 00010000:00000040:1.0:1783444592.043640:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969482, xid 1870073557886336 00000100:00000040:1.0:1783444592.043649:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.043656:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.043715:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.043724:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.043729:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.043753:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 11 00010000:00080000:1.0:1783444592.043757:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00010000:00080000:1.0:1783444592.043760:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00000100:00000040:1.0:1783444592.048994:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7a8380 x1870073557886464 msgsize 440 00000100:00100000:1.0:1783444592.049008:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.049087:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557886464 00000100:00100000:2.0:1783444592.049096:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557886464 00000020:00000040:2.0:1783444592.049099:0:25160:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.049104:0:25160:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=12 00000100:00000040:2.0:1783444592.049128:0:25160:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.049170:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1055 00000100:00000040:2.0:1783444592.049174:0:25160:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.049181:0:25160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7a8380 x1870073557886464/t0(4294969483) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.049193:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+12:2400:x1870073557886464:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:2.0:1783444592.049204:0:25160:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a8380 x1870073557886464/t0(4294969483) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.049213:0:25160:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969483, current: 4294969483, replaying 00010000:00000040:2.0:1783444592.049216:0:25160:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.049233:0:25160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a8380 x1870073557886464/t0(4294969483) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.049242:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+12:2400:x1870073557886464:12345-192.168.204.20@tcp:10:dd.0 Request processed in 51us (249us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.049249:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1055 00000100:00000040:2.0:1783444592.049252:0:25160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.049293:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969483, next_transno: 4294969483 00010000:00080000:1.0:1783444592.049297:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969483) 00010000:00080000:1.0:1783444592.049305:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557886464 t4294969483 from 192.168.204.20@tcp req@ffff9368eb7a8380 x1870073557886464/t0(4294969483) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.049320:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a8380 x1870073557886464/t0(4294969483) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783444592.049347:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38b:0x0] 00000001:00000040:1.0:1783444592.049713:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 8 00000020:00000040:1.0:1783444592.049717:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=13 00010000:00000040:1.0:1783444592.049751:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969483, xid 1870073557886464 00000100:00000040:1.0:1783444592.049760:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.049766:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.049841:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.049851:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.049857:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.049866:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 12 00010000:00080000:1.0:1783444592.049870:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00010000:00080000:1.0:1783444592.049874:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00000100:00000040:3.0:1783444592.051973:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f4000 x1870073557888256 msgsize 440 00000100:00100000:3.0:1783444592.051988:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444592.052029:0:25148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557888256 00000100:00100000:0.0:1783444592.052039:0:25148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557888256 00000020:00000040:0.0:1783444592.052042:0:25148:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444592.052047:0:25148:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=13 00000100:00000040:0.0:1783444592.052074:0:25148:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783444592.052115:0:25148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1056 00000100:00000040:0.0:1783444592.052127:0:25148:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444592.052134:0:25148:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f4000 x1870073557888256/t0(4294969484) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.052146:0:25148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+13:2400:x1870073557888256:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:0.0:1783444592.052157:0:25148:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f4000 x1870073557888256/t0(4294969484) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444592.052165:0:25148:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969484, current: 4294969484, replaying 00010000:00000040:0.0:1783444592.052168:0:25148:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:0.0:1783444592.052179:0:25148:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f4000 x1870073557888256/t0(4294969484) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.052188:0:25148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+13:2400:x1870073557888256:12345-192.168.204.20@tcp:10:dd.0 Request processed in 44us (215us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444592.052194:0:25148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1056 00000100:00000040:0.0:1783444592.052196:0:25148:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.052217:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969484, next_transno: 4294969484 00010000:00080000:0.0:1783444592.052220:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969484) 00010000:00080000:0.0:1783444592.052227:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557888256 t4294969484 from 192.168.204.20@tcp req@ffff9367c33f4000 x1870073557888256/t0(4294969484) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.052241:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f4000 x1870073557888256/t0(4294969484) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783444592.052270:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x385:0x0] 00000001:00000040:0.0:1783444592.052430:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 9 00000020:00000040:0.0:1783444592.052434:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=14 00010000:00000040:0.0:1783444592.052465:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969484, xid 1870073557888256 00000100:00000040:0.0:1783444592.052475:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.052486:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.052571:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.052580:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.052585:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.052595:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 13 00010000:00080000:0.0:1783444592.052599:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00010000:00080000:0.0:1783444592.052602:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00000100:00000040:2.0:1783444592.058652:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367cadae300 x1870073557889664 msgsize 440 00000100:00100000:2.0:1783444592.058676:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444592.058752:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557889664 00000100:00100000:0.0:1783444592.058762:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557889664 00000020:00000040:0.0:1783444592.058765:0:8425:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444592.058770:0:8425:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=14 00000100:00000040:0.0:1783444592.058927:0:8425:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783444592.060354:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1057 00000100:00000040:0.0:1783444592.060361:0:8425:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444592.060370:0:8425:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367cadae300 x1870073557889664/t0(4294969485) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.060393:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+14:2400:x1870073557889664:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:0.0:1783444592.060408:0:8425:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367cadae300 x1870073557889664/t0(4294969485) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444592.060417:0:8425:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969485, current: 4294969485, replaying 00010000:00000040:0.0:1783444592.060421:0:8425:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00010000:00080000:2.0:1783444592.060546:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969485, next_transno: 4294969485 00010000:00080000:2.0:1783444592.060551:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969485) 00010000:00080000:2.0:1783444592.060559:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557889664 t4294969485 from 192.168.204.20@tcp req@ffff9367cadae300 x1870073557889664/t0(4294969485) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.060575:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367cadae300 x1870073557889664/t0(4294969485) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783444592.060607:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x386:0x0] 00000100:00000040:0.0:1783444592.060712:0:8425:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367cadae300 x1870073557889664/t0(4294969485) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/432 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.060722:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367cadae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+14:2400:x1870073557889664:12345-192.168.204.20@tcp:10:dd.0 Request processed in 340us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444592.060729:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1057 00000100:00000040:0.0:1783444592.060732:0:8425:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00000001:00000040:2.0:1783444592.060813:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 10 00000020:00000040:2.0:1783444592.060817:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=15 00010000:00000040:2.0:1783444592.060852:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969485, xid 1870073557889664 00000100:00000040:2.0:1783444592.060862:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444592.060868:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444592.060917:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:2.0:1783444592.060927:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783444592.060932:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:2.0:1783444592.060943:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 14 00010000:00080000:2.0:1783444592.060948:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00010000:00080000:2.0:1783444592.060951:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00000100:00000040:1.0:1783444592.075111:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7ab800 x1870073557890560 msgsize 440 00000100:00100000:1.0:1783444592.075127:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.075268:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557890560 00000100:00100000:2.0:1783444592.075278:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557890560 00000020:00000040:2.0:1783444592.075281:0:24881:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.075285:0:24881:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=15 00000100:00000040:2.0:1783444592.075310:0:24881:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.075358:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1058 00000100:00000040:2.0:1783444592.075362:0:24881:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.075370:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7ab800 x1870073557890560/t0(4294969486) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.075396:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+15:2400:x1870073557890560:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:2.0:1783444592.075409:0:24881:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7ab800 x1870073557890560/t0(4294969486) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.075418:0:24881:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969486, current: 4294969486, replaying 00010000:00000040:2.0:1783444592.075422:0:24881:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.075444:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7ab800 x1870073557890560/t0(4294969486) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.075452:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+15:2400:x1870073557890560:12345-192.168.204.20@tcp:10:dd.0 Request processed in 61us (343us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.075459:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1058 00000100:00000040:2.0:1783444592.075463:0:24881:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.075921:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969486, next_transno: 4294969486 00010000:00080000:0.0:1783444592.075927:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969486) 00010000:00080000:0.0:1783444592.075936:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557890560 t4294969486 from 192.168.204.20@tcp req@ffff9368eb7ab800 x1870073557890560/t0(4294969486) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.075952:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7ab800 x1870073557890560/t0(4294969486) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783444592.075982:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38c:0x0] 00000001:00000040:0.0:1783444592.076403:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 11 00000020:00000040:0.0:1783444592.076408:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=16 00010000:00000040:0.0:1783444592.076449:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969486, xid 1870073557890560 00000100:00000040:0.0:1783444592.076460:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.076467:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.077306:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.077319:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.077326:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.077337:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 15 00010000:00080000:0.0:1783444592.077342:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00010000:00080000:0.0:1783444592.077347:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00000100:00000040:1.0:1783444592.081326:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7aa680 x1870073557891712 msgsize 440 00000100:00100000:1.0:1783444592.081341:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.082060:0:24882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557891712 00000100:00100000:3.0:1783444592.082070:0:24882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557891712 00000020:00000040:3.0:1783444592.082072:0:24882:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.082076:0:24882:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=16 00000100:00000040:3.0:1783444592.082228:0:24882:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.082369:0:24882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1059 00000100:00000040:3.0:1783444592.082373:0:24882:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.082380:0:24882:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7aa680 x1870073557891712/t0(4294969487) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.082392:0:24882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+16:2400:x1870073557891712:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:3.0:1783444592.082400:0:24882:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7aa680 x1870073557891712/t0(4294969487) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.082408:0:24882:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969487, current: 4294969487, replaying 00010000:00000040:3.0:1783444592.082411:0:24882:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.082422:0:24882:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7aa680 x1870073557891712/t0(4294969487) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.082428:0:24882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+16:2400:x1870073557891712:12345-192.168.204.20@tcp:10:dd.0 Request processed in 39us (1104us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.082433:0:24882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1059 00000100:00000040:3.0:1783444592.082435:0:24882:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:3.0:1783444592.082448:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969487, next_transno: 4294969487 00010000:00080000:3.0:1783444592.082451:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969487) 00010000:00080000:3.0:1783444592.082456:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557891712 t4294969487 from 192.168.204.20@tcp req@ffff9368eb7aa680 x1870073557891712/t0(4294969487) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444592.082478:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7aa680 x1870073557891712/t0(4294969487) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783444592.082501:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x387:0x0] 00000001:00000040:3.0:1783444592.082716:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 12 00000020:00000040:3.0:1783444592.082720:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=17 00010000:00000040:3.0:1783444592.082753:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969487, xid 1870073557891712 00000100:00000040:3.0:1783444592.082762:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444592.082769:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:3.0:1783444592.082852:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:3.0:1783444592.082861:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783444592.082867:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:3.0:1783444592.082878:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 16 00010000:00080000:3.0:1783444592.082883:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00010000:00080000:3.0:1783444592.082887:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00000100:00000040:2.0:1783444592.086859:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368dd19ad80 x1870073557893760 msgsize 440 00000100:00100000:2.0:1783444592.086873:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.086954:0:24870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557893760 00000100:00100000:1.0:1783444592.086964:0:24870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557893760 00000020:00000040:1.0:1783444592.086968:0:24870:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.086973:0:24870:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=17 00000100:00000040:1.0:1783444592.087005:0:24870:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.087054:0:24870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1060 00000100:00000040:1.0:1783444592.087058:0:24870:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.087067:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368dd19ad80 x1870073557893760/t0(4294969488) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.087081:0:24870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+17:2400:x1870073557893760:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:1.0:1783444592.087094:0:24870:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368dd19ad80 x1870073557893760/t0(4294969488) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.087104:0:24870:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969488, current: 4294969488, replaying 00010000:00000040:1.0:1783444592.087107:0:24870:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.087124:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368dd19ad80 x1870073557893760/t0(4294969488) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.087133:0:24870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368dd19ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+17:2400:x1870073557893760:12345-192.168.204.20@tcp:10:dd.0 Request processed in 55us (275us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.087140:0:24870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1060 00000100:00000040:1.0:1783444592.087143:0:24870:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.087160:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969488, next_transno: 4294969488 00010000:00080000:1.0:1783444592.087164:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969488) 00010000:00080000:1.0:1783444592.087171:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557893760 t4294969488 from 192.168.204.20@tcp req@ffff9368dd19ad80 x1870073557893760/t0(4294969488) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.087185:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368dd19ad80 x1870073557893760/t0(4294969488) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783444592.087213:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38d:0x0] 00000001:00000040:1.0:1783444592.087656:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 13 00000020:00000040:1.0:1783444592.087781:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=18 00010000:00000040:1.0:1783444592.088005:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969488, xid 1870073557893760 00000100:00000040:1.0:1783444592.088015:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.088021:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.088075:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.088085:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.088092:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.088105:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 17 00010000:00080000:1.0:1783444592.088110:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00010000:00080000:1.0:1783444592.088114:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00000100:00000040:1.0:1783444592.092643:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7a8a80 x1870073557894272 msgsize 440 00000100:00100000:1.0:1783444592.092660:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.092772:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557894272 00000100:00100000:2.0:1783444592.092782:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557894272 00000020:00000040:2.0:1783444592.092786:0:25160:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.093457:0:25160:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=18 00000100:00000040:2.0:1783444592.093485:0:25160:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.093534:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1061 00000100:00000040:2.0:1783444592.093539:0:25160:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.093548:0:25160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7a8a80 x1870073557894272/t0(4294969489) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.093562:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+18:2400:x1870073557894272:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:2.0:1783444592.093575:0:25160:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a8a80 x1870073557894272/t0(4294969489) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.093592:0:25160:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969489, current: 4294969489, replaying 00010000:00000040:2.0:1783444592.093595:0:25160:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.093659:0:25160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a8a80 x1870073557894272/t0(4294969489) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.093669:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+18:2400:x1870073557894272:12345-192.168.204.20@tcp:10:dd.0 Request processed in 111us (1029us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.093677:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1061 00000100:00000040:2.0:1783444592.093680:0:25160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.094508:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969489, next_transno: 4294969489 00010000:00080000:1.0:1783444592.094515:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969489) 00010000:00080000:1.0:1783444592.094524:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557894272 t4294969489 from 192.168.204.20@tcp req@ffff9368eb7a8a80 x1870073557894272/t0(4294969489) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.094544:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a8a80 x1870073557894272/t0(4294969489) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783444592.094574:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38e:0x0] 00000001:00000040:1.0:1783444592.094874:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 14 00000020:00000040:1.0:1783444592.094879:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=19 00010000:00000040:1.0:1783444592.094925:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969489, xid 1870073557894272 00000100:00000040:1.0:1783444592.094936:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.094943:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.095000:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.095010:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.095017:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.095159:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 18 00010000:00080000:1.0:1783444592.095166:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00010000:00080000:1.0:1783444592.095177:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00000100:00000040:0.0:1783444592.097025:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3aff480 x1870073557896320 msgsize 440 00000100:00100000:0.0:1783444592.097038:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.097133:0:25148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896320 00000100:00100000:1.0:1783444592.097142:0:25148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896320 00000020:00000040:1.0:1783444592.097145:0:25148:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.097150:0:25148:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=19 00000100:00000040:1.0:1783444592.097172:0:25148:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.097254:0:25148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1062 00000100:00000040:1.0:1783444592.097259:0:25148:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.097267:0:25148:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3aff480 x1870073557896320/t0(4294969490) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.097282:0:25148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+19:2400:x1870073557896320:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:1.0:1783444592.097293:0:25148:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3aff480 x1870073557896320/t0(4294969490) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.097302:0:25148:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969490, current: 4294969490, replaying 00010000:00000040:1.0:1783444592.097305:0:25148:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.097329:0:25148:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3aff480 x1870073557896320/t0(4294969490) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.097338:0:25148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:08efc25c-17e5-4d29-97d2-f1505f195a06+19:2400:x1870073557896320:12345-192.168.204.20@tcp:10:dd.0 Request processed in 59us (313us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.097345:0:25148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1062 00000100:00000040:1.0:1783444592.097347:0:25148:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:2.0:1783444592.097398:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969490, next_transno: 4294969490 00010000:00080000:2.0:1783444592.097402:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969490) 00010000:00080000:2.0:1783444592.097410:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557896320 t4294969490 from 192.168.204.20@tcp req@ffff9367c3aff480 x1870073557896320/t0(4294969490) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.097425:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3aff480 x1870073557896320/t0(4294969490) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1783444592.097453:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38f:0x0] 00000001:00000040:2.0:1783444592.097625:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 15 00000020:00000040:2.0:1783444592.097629:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=20 00010000:00000040:2.0:1783444592.097662:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969490, xid 1870073557896320 00000100:00000040:2.0:1783444592.097672:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444592.097678:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444592.097751:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:2.0:1783444592.097760:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783444592.097765:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:2.0:1783444592.097778:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 19 00010000:00080000:2.0:1783444592.097782:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00010000:00080000:2.0:1783444592.097785:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 40000000:00000040:3.0:1783444592.098863:0:97047:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00000100:00000040:2.0:1783444592.101869:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bc7100 x1870073557896448 msgsize 440 00000100:00100000:2.0:1783444592.101885:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.102422:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896448 00000100:00100000:3.0:1783444592.102433:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896448 00000020:00000040:3.0:1783444592.102436:0:8425:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.102513:0:8425:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=20 00000100:00000040:3.0:1783444592.102539:0:8425:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.102592:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1063 00000100:00000040:3.0:1783444592.102598:0:8425:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.102607:0:8425:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bc7100 x1870073557896448/t0(4294969491) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.102621:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+20:2400:x1870073557896448:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:3.0:1783444592.102634:0:8425:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f9bc7100 x1870073557896448/t0(4294969491) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.102650:0:8425:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969491, current: 4294969491, replaying 00010000:00000040:3.0:1783444592.102653:0:8425:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.102678:0:8425:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc7100 x1870073557896448/t0(4294969491) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.102688:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+20:2400:x1870073557896448:12345-192.168.204.20@tcp:10:dd.0 Request processed in 70us (819us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.102695:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1063 00000100:00000040:3.0:1783444592.102698:0:8425:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.102764:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969491, next_transno: 4294969491 00010000:00080000:0.0:1783444592.102770:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969491) 00010000:00080000:0.0:1783444592.102778:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557896448 t4294969491 from 192.168.204.20@tcp req@ffff9368f9bc7100 x1870073557896448/t0(4294969491) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.102864:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f9bc7100 x1870073557896448/t0(4294969491) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783444592.102894:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x390:0x0] 00000001:00000040:0.0:1783444592.103068:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 16 00000020:00000040:0.0:1783444592.103072:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=21 00010000:00000040:0.0:1783444592.103109:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969491, xid 1870073557896448 00000100:00000040:0.0:1783444592.103119:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.103125:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.103250:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.103259:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.103266:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.103285:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 20 00010000:00080000:0.0:1783444592.103290:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00010000:00080000:0.0:1783444592.103294:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00000100:00000040:1.0:1783444592.111051:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7aa300 x1870073557896576 msgsize 440 00000100:00100000:1.0:1783444592.111069:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444592.111317:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557896576 00000100:00100000:0.0:1783444592.111329:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557896576 00000020:00000040:0.0:1783444592.111332:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444592.111337:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=21 00000100:00000040:0.0:1783444592.111363:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783444592.111412:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1064 00000100:00000040:0.0:1783444592.111417:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444592.111426:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7aa300 x1870073557896576/t0(4294969492) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.111441:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+21:2400:x1870073557896576:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:0.0:1783444592.111453:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7aa300 x1870073557896576/t0(4294969492) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444592.111464:0:24883:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969492, current: 4294969492, replaying 00010000:00000040:0.0:1783444592.111469:0:24883:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:0.0:1783444592.111483:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7aa300 x1870073557896576/t0(4294969492) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.111507:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+21:2400:x1870073557896576:12345-192.168.204.20@tcp:10:dd.0 Request processed in 67us (454us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444592.111515:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1064 00000100:00000040:0.0:1783444592.111518:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.112845:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969492, next_transno: 4294969492 00010000:00080000:1.0:1783444592.112851:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969492) 00010000:00080000:1.0:1783444592.112864:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557896576 t4294969492 from 192.168.204.20@tcp req@ffff9368eb7aa300 x1870073557896576/t0(4294969492) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.112891:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7aa300 x1870073557896576/t0(4294969492) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783444592.112920:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x392:0x0] 00000001:00000040:1.0:1783444592.113084:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 17 00000020:00000040:1.0:1783444592.113088:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=22 00010000:00000040:1.0:1783444592.113123:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969492, xid 1870073557896576 00000100:00000040:1.0:1783444592.113133:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.113139:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.113187:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.113272:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.113281:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.113295:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 21 00010000:00080000:1.0:1783444592.113299:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00010000:00080000:1.0:1783444592.113302:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00000100:00000040:1.0:1783444592.122219:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7aad80 x1870073557898368 msgsize 440 00000100:00100000:1.0:1783444592.122234:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.123966:0:24882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557898368 00000100:00100000:3.0:1783444592.123984:0:24882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557898368 00000020:00000040:3.0:1783444592.123987:0:24882:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.123994:0:24882:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=22 00000100:00000040:3.0:1783444592.124022:0:24882:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.124074:0:24882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1065 00000100:00000040:3.0:1783444592.124079:0:24882:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.124087:0:24882:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7aad80 x1870073557898368/t0(4294969493) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.124101:0:24882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+22:2400:x1870073557898368:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:3.0:1783444592.124114:0:24882:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7aad80 x1870073557898368/t0(4294969493) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.124123:0:24882:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969493, current: 4294969493, replaying 00010000:00000040:3.0:1783444592.124127:0:24882:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.124152:0:24882:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7aad80 x1870073557898368/t0(4294969493) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.124161:0:24882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+22:2400:x1870073557898368:12345-192.168.204.20@tcp:10:dd.0 Request processed in 62us (1942us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.124183:0:24882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1065 00000100:00000040:3.0:1783444592.124186:0:24882:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.124340:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969493, next_transno: 4294969493 00010000:00080000:0.0:1783444592.124345:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969493) 00010000:00080000:0.0:1783444592.124355:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557898368 t4294969493 from 192.168.204.20@tcp req@ffff9368eb7aad80 x1870073557898368/t0(4294969493) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.124372:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7aad80 x1870073557898368/t0(4294969493) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783444592.124407:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x393:0x0] 00000001:00000040:0.0:1783444592.124607:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 18 00000020:00000040:0.0:1783444592.124611:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=23 00010000:00000040:0.0:1783444592.124653:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969493, xid 1870073557898368 00000100:00000040:0.0:1783444592.124738:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.124746:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.124878:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.124887:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.124894:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.124906:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 22 00010000:00080000:0.0:1783444592.124910:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00010000:00080000:0.0:1783444592.124915:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00000100:00000040:2.0:1783444592.139626:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bc7480 x1870073557899392 msgsize 440 00000100:00100000:2.0:1783444592.139643:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.139818:0:24870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557899392 00000100:00100000:1.0:1783444592.139827:0:24870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557899392 00000020:00000040:1.0:1783444592.139829:0:24870:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.139834:0:24870:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=23 00000100:00000040:1.0:1783444592.139854:0:24870:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.139894:0:24870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1066 00000100:00000040:1.0:1783444592.139898:0:24870:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.139905:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bc7480 x1870073557899392/t0(4294969494) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.140076:0:24870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+23:2400:x1870073557899392:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:1.0:1783444592.140102:0:24870:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f9bc7480 x1870073557899392/t0(4294969494) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.140111:0:24870:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969494, current: 4294969494, replaying 00010000:00000040:1.0:1783444592.140114:0:24870:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.140133:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc7480 x1870073557899392/t0(4294969494) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.140142:0:24870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+23:2400:x1870073557899392:12345-192.168.204.20@tcp:10:dd.0 Request processed in 70us (517us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.140149:0:24870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1066 00000100:00000040:1.0:1783444592.140152:0:24870:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.140196:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969494, next_transno: 4294969494 00010000:00080000:0.0:1783444592.140200:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969494) 00010000:00080000:0.0:1783444592.140208:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557899392 t4294969494 from 192.168.204.20@tcp req@ffff9368f9bc7480 x1870073557899392/t0(4294969494) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.140228:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f9bc7480 x1870073557899392/t0(4294969494) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1783444592.140257:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x395:0x0] 00000001:00000040:0.0:1783444592.140569:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 19 00000020:00000040:0.0:1783444592.140573:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=24 00010000:00000040:0.0:1783444592.140610:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969494, xid 1870073557899392 00000100:00000040:0.0:1783444592.140620:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.140627:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.140678:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.140687:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.140693:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.140716:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 23 00010000:00080000:0.0:1783444592.140721:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00010000:00080000:0.0:1783444592.140724:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00000100:00000040:0.0:1783444592.158611:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afc700 x1870073557899904 msgsize 440 00000100:00100000:0.0:1783444592.158627:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.158942:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557899904 00000100:00100000:2.0:1783444592.158952:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557899904 00000020:00000040:2.0:1783444592.158955:0:25160:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.158961:0:25160:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=24 00000100:00000040:2.0:1783444592.158992:0:25160:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.159193:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1067 00000100:00000040:2.0:1783444592.159199:0:25160:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.159206:0:25160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afc700 x1870073557899904/t0(4294969495) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.159221:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+24:2400:x1870073557899904:12345-192.168.204.20@tcp:10:dd.0 00000020:00000040:2.0:1783444592.159233:0:25160:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afc700 x1870073557899904/t0(4294969495) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.159243:0:25160:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969495, current: 4294969495, replaying 00010000:00000040:2.0:1783444592.159247:0:25160:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.159263:0:25160:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afc700 x1870073557899904/t0(4294969495) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.159277:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+24:2400:x1870073557899904:12345-192.168.204.20@tcp:10:dd.0 Request processed in 55us (662us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.159285:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1067 00000100:00000040:2.0:1783444592.159297:0:25160:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.159297:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969495, next_transno: 4294969495 00010000:00080000:1.0:1783444592.159304:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969495) 00010000:00080000:1.0:1783444592.159315:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557899904 t4294969495 from 192.168.204.20@tcp req@ffff9367c3afc700 x1870073557899904/t0(4294969495) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.159332:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afc700 x1870073557899904/t0(4294969495) o10->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 440/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1783444592.159363:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x394:0x0] 00000001:00000040:1.0:1783444592.159617:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 20 00000020:00000040:1.0:1783444592.159621:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=25 00010000:00000040:1.0:1783444592.159658:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969495, xid 1870073557899904 00000100:00000040:1.0:1783444592.159668:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.159674:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.159909:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.159919:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.159927:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.159938:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 24 00010000:00080000:1.0:1783444592.160008:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00010000:00080000:1.0:1783444592.160012:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00000100:00000040:1.0:1783444592.166879:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7a8700 x1870073557900288 msgsize 1512 00000100:00100000:1.0:1783444592.166893:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.167162:0:24872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900288 00000100:00100000:2.0:1783444592.167173:0:24872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900288 00000020:00000040:2.0:1783444592.167176:0:24872:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.167189:0:24872:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=25 00000100:00000040:2.0:1783444592.167215:0:24872:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.167271:0:24872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1068 00000100:00000040:2.0:1783444592.167275:0:24872:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.167284:0:24872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7a8700 x1870073557900288/t0(4294969496) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.167308:0:24872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2400:x1870073557900288:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:2.0:1783444592.167319:0:24872:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a8700 x1870073557900288/t0(4294969496) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.167329:0:24872:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969496, current: 4294969496, replaying 00010000:00000040:2.0:1783444592.167333:0:24872:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.167355:0:24872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a8700 x1870073557900288/t0(4294969496) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.167364:0:24872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+25:2400:x1870073557900288:12345-192.168.204.20@tcp:4:dd.0 Request processed in 60us (486us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.167371:0:24872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1068 00000100:00000040:2.0:1783444592.167374:0:24872:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:3.0:1783444592.169001:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969496, next_transno: 4294969496 00010000:00080000:3.0:1783444592.169010:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969496) 00010000:00080000:3.0:1783444592.169023:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557900288 t4294969496 from 192.168.204.20@tcp req@ffff9368eb7a8700 x1870073557900288/t0(4294969496) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444592.169045:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a8700 x1870073557900288/t0(4294969496) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1783444592.169085:0:96948:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:3.0:1783444592.169179:0:96948:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:3.0:1783444592.169236:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783444592.170433:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:0.0:1783444592.170439:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783444592.170728:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 21 00000020:00000040:0.0:1783444592.170733:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=26 00010000:00000040:0.0:1783444592.171327:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969496, xid 1870073557900288 00000100:00000040:0.0:1783444592.171344:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.171352:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.171409:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.171423:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.171432:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.171444:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 25 00010000:00080000:0.0:1783444592.171457:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00010000:00080000:0.0:1783444592.171463:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00000100:00000040:2.0:1783444592.176004:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bc5f80 x1870073557900544 msgsize 1512 00000100:00100000:2.0:1783444592.176021:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.176071:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900544 00000100:00100000:3.0:1783444592.176081:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900544 00000020:00000040:3.0:1783444592.176084:0:8425:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.176089:0:8425:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=26 00000100:00000040:3.0:1783444592.176119:0:8425:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.176176:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1069 00000100:00000040:3.0:1783444592.176181:0:8425:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.176189:0:8425:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bc5f80 x1870073557900544/t0(4294969497) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.176211:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+26:2400:x1870073557900544:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:3.0:1783444592.176223:0:8425:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f9bc5f80 x1870073557900544/t0(4294969497) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.176232:0:8425:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969497, current: 4294969497, replaying 00010000:00000040:3.0:1783444592.176235:0:8425:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.176261:0:8425:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bc5f80 x1870073557900544/t0(4294969497) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.176277:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+26:2400:x1870073557900544:12345-192.168.204.20@tcp:4:dd.0 Request processed in 68us (273us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.176285:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1069 00010000:00080000:0.0:1783444592.176285:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969497, next_transno: 4294969497 00000100:00000040:3.0:1783444592.176290:0:8425:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.176292:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969497) 00010000:00080000:0.0:1783444592.176305:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557900544 t4294969497 from 192.168.204.20@tcp req@ffff9368f9bc5f80 x1870073557900544/t0(4294969497) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.176322:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f9bc5f80 x1870073557900544/t0(4294969497) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.176421:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783444592.176448:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:0.0:1783444592.176451:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783444592.176760:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 22 00000020:00000040:0.0:1783444592.176764:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=27 00010000:00000040:0.0:1783444592.177656:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969497, xid 1870073557900544 00000100:00000040:0.0:1783444592.177670:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.177678:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.177828:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.177839:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.177847:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.177860:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 26 00010000:00080000:0.0:1783444592.177865:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00010000:00080000:0.0:1783444592.177869:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00000100:00000040:2.0:1783444592.184229:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9367c436aa00 x1870073557900800 msgsize 1512 00000100:00100000:2.0:1783444592.184244:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444592.185912:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557900800 00000100:00100000:0.0:1783444592.185927:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557900800 00000020:00000040:0.0:1783444592.185930:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444592.185936:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=27 00000100:00000040:0.0:1783444592.185973:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783444592.186016:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1070 00000100:00000040:0.0:1783444592.186029:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444592.186036:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c436aa00 x1870073557900800/t0(4294969498) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.186049:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2400:x1870073557900800:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:0.0:1783444592.186072:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c436aa00 x1870073557900800/t0(4294969498) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444592.186081:0:24883:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969498, current: 4294969498, replaying 00010000:00000040:0.0:1783444592.186084:0:24883:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:0.0:1783444592.186101:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c436aa00 x1870073557900800/t0(4294969498) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.186110:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+27:2400:x1870073557900800:12345-192.168.204.20@tcp:4:dd.0 Request processed in 63us (1882us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444592.186116:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1070 00000100:00000040:0.0:1783444592.186119:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:3.0:1783444592.186771:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969498, next_transno: 4294969498 00010000:00080000:3.0:1783444592.186806:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969498) 00010000:00080000:3.0:1783444592.186817:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557900800 t4294969498 from 192.168.204.20@tcp req@ffff9367c436aa00 x1870073557900800/t0(4294969498) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444592.186835:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c436aa00 x1870073557900800/t0(4294969498) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444592.186927:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783444592.186957:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:3.0:1783444592.186960:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000020:00000040:3.0:1783444592.186974:0:96948:0:(tgt_handler.c:2952:tgt_brw_write()) Checksum 1024 from 12345-192.168.204.20@tcp OK: 1fc6943a 00000001:00000040:3.0:1783444592.187209:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 23 00000020:00000040:3.0:1783444592.187214:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=28 00010000:00000040:1.0:1783444592.189742:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969498, xid 1870073557900800 00000100:00000040:1.0:1783444592.189762:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.189771:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.189850:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.189862:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.189871:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.189885:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 27 00010000:00080000:1.0:1783444592.189891:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:1.0:1783444592.189896:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00000100:00000040:3.0:1783444592.192675:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f4380 x1870073557901056 msgsize 1512 00000100:00100000:3.0:1783444592.192692:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.193203:0:24882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901056 00000100:00100000:1.0:1783444592.193215:0:24882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901056 00000020:00000040:1.0:1783444592.193218:0:24882:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.193224:0:24882:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=28 00000100:00000040:1.0:1783444592.193247:0:24882:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.193302:0:24882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1071 00000100:00000040:1.0:1783444592.193307:0:24882:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.193315:0:24882:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f4380 x1870073557901056/t0(4294969499) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.193329:0:24882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+28:2400:x1870073557901056:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:1.0:1783444592.193340:0:24882:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f4380 x1870073557901056/t0(4294969499) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.193349:0:24882:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969499, current: 4294969499, replaying 00010000:00000040:1.0:1783444592.193352:0:24882:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.193379:0:24882:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f4380 x1870073557901056/t0(4294969499) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.193388:0:24882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+28:2400:x1870073557901056:12345-192.168.204.20@tcp:4:dd.0 Request processed in 63us (714us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.193396:0:24882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1071 00000100:00000040:1.0:1783444592.193399:0:24882:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:3.0:1783444592.193453:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969499, next_transno: 4294969499 00010000:00080000:3.0:1783444592.193457:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969499) 00010000:00080000:3.0:1783444592.193465:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557901056 t4294969499 from 192.168.204.20@tcp req@ffff9367c33f4380 x1870073557901056/t0(4294969499) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444592.193481:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f4380 x1870073557901056/t0(4294969499) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444592.193572:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783444592.193606:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:3.0:1783444592.193609:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783444592.193907:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 24 00000020:00000040:3.0:1783444592.193911:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=29 00010000:00000040:3.0:1783444592.194432:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969499, xid 1870073557901056 00000100:00000040:3.0:1783444592.194444:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444592.194451:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:3.0:1783444592.194502:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:3.0:1783444592.194511:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783444592.194518:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:3.0:1783444592.194530:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 28 00010000:00080000:3.0:1783444592.194536:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00010000:00080000:3.0:1783444592.194540:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00000100:00000040:2.0:1783444592.196806:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367c436b800 x1870073557901312 msgsize 1512 00000100:00100000:2.0:1783444592.196821:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.196917:0:25162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901312 00000100:00100000:3.0:1783444592.196928:0:25162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901312 00000020:00000040:3.0:1783444592.196932:0:25162:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.196936:0:25162:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=29 00000100:00000040:3.0:1783444592.196967:0:25162:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.197017:0:25162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1072 00000100:00000040:3.0:1783444592.197021:0:25162:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.197030:0:25162:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c436b800 x1870073557901312/t0(4294969500) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.197043:0:25162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2400:x1870073557901312:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:3.0:1783444592.197054:0:25162:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c436b800 x1870073557901312/t0(4294969500) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.197063:0:25162:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969500, current: 4294969500, replaying 00010000:00000040:3.0:1783444592.197078:0:25162:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.197096:0:25162:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c436b800 x1870073557901312/t0(4294969500) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.197113:0:25162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:08efc25c-17e5-4d29-97d2-f1505f195a06+29:2400:x1870073557901312:12345-192.168.204.20@tcp:4:dd.0 Request processed in 72us (325us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.197122:0:25162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1072 00000100:00000040:3.0:1783444592.197126:0:25162:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.197127:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969500, next_transno: 4294969500 00010000:00080000:1.0:1783444592.197133:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969500) 00010000:00080000:1.0:1783444592.197143:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557901312 t4294969500 from 192.168.204.20@tcp req@ffff9367c436b800 x1870073557901312/t0(4294969500) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.197161:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c436b800 x1870073557901312/t0(4294969500) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.197247:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783444592.197274:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:1.0:1783444592.197278:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783444592.197517:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 25 00000020:00000040:1.0:1783444592.197521:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=30 00010000:00000040:1.0:1783444592.198929:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969500, xid 1870073557901312 00000100:00000040:1.0:1783444592.198948:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.198956:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.199020:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.199032:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.199040:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.199051:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 29 00010000:00080000:1.0:1783444592.199057:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00010000:00080000:1.0:1783444592.199061:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00000100:00000040:2.0:1783444592.211435:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9367c4368e00 x1870073557901568 msgsize 1512 00000100:00100000:2.0:1783444592.211450:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.211483:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901568 00000100:00100000:2.0:1783444592.211497:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901568 00000020:00000040:2.0:1783444592.211501:0:8426:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.211506:0:8426:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=30 00000100:00000040:2.0:1783444592.211531:0:8426:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.211575:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1073 00000100:00000040:2.0:1783444592.211580:0:8426:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.211588:0:8426:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c4368e00 x1870073557901568/t0(4294969501) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.211602:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+30:2400:x1870073557901568:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:2.0:1783444592.211614:0:8426:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c4368e00 x1870073557901568/t0(4294969501) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.211624:0:8426:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969501, current: 4294969501, replaying 00010000:00000040:2.0:1783444592.211628:0:8426:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.211638:0:8426:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c4368e00 x1870073557901568/t0(4294969501) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.211647:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+30:2400:x1870073557901568:12345-192.168.204.20@tcp:4:dd.0 Request processed in 48us (213us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.211654:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1073 00000100:00000040:2.0:1783444592.211657:0:8426:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:2.0:1783444592.213321:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969501, next_transno: 4294969501 00010000:00080000:2.0:1783444592.213328:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969501) 00010000:00080000:2.0:1783444592.213339:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557901568 t4294969501 from 192.168.204.20@tcp req@ffff9367c4368e00 x1870073557901568/t0(4294969501) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.213362:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c4368e00 x1870073557901568/t0(4294969501) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.213454:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783444592.213485:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:2.0:1783444592.213488:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783444592.213857:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 26 00000020:00000040:2.0:1783444592.213861:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=31 00010000:00000040:2.0:1783444592.215709:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969501, xid 1870073557901568 00000100:00000040:2.0:1783444592.215727:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444592.215738:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444592.215786:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:2.0:1783444592.215812:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783444592.215821:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:2.0:1783444592.215832:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 30 00010000:00080000:2.0:1783444592.215838:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00010000:00080000:2.0:1783444592.215842:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00000100:00000040:2.0:1783444592.224617:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c4369500 x1870073557901824 msgsize 1512 00000100:00100000:2.0:1783444592.224632:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.224760:0:24872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557901824 00000100:00100000:3.0:1783444592.224770:0:24872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557901824 00000020:00000040:3.0:1783444592.224774:0:24872:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.224779:0:24872:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=31 00000100:00000040:3.0:1783444592.224836:0:24872:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.224884:0:24872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1074 00000100:00000040:3.0:1783444592.224889:0:24872:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.224896:0:24872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c4369500 x1870073557901824/t0(4294969502) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.224908:0:24872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2400:x1870073557901824:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:3.0:1783444592.224919:0:24872:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c4369500 x1870073557901824/t0(4294969502) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.224928:0:24872:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969502, current: 4294969502, replaying 00010000:00000040:3.0:1783444592.224931:0:24872:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.224940:0:24872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c4369500 x1870073557901824/t0(4294969502) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.224949:0:24872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+31:2400:x1870073557901824:12345-192.168.204.20@tcp:4:dd.0 Request processed in 42us (333us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.224956:0:24872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1074 00000100:00000040:3.0:1783444592.224959:0:24872:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:2.0:1783444592.225020:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969502, next_transno: 4294969502 00010000:00080000:2.0:1783444592.225025:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969502) 00010000:00080000:2.0:1783444592.225033:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557901824 t4294969502 from 192.168.204.20@tcp req@ffff9367c4369500 x1870073557901824/t0(4294969502) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.225049:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c4369500 x1870073557901824/t0(4294969502) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.225164:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783444592.225397:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:2.0:1783444592.225402:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783444592.225832:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 27 00000020:00000040:2.0:1783444592.225836:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=32 00010000:00000040:2.0:1783444592.227450:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969502, xid 1870073557901824 00000100:00000040:2.0:1783444592.227473:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444592.227490:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444592.227548:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:2.0:1783444592.227560:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783444592.227569:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:2.0:1783444592.227580:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 31 00010000:00080000:2.0:1783444592.227586:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00010000:00080000:2.0:1783444592.227590:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00000100:00000040:0.0:1783444592.239162:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afc380 x1870073557902080 msgsize 1512 00000100:00100000:0.0:1783444592.239180:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.239302:0:25139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902080 00000100:00100000:3.0:1783444592.239320:0:25139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902080 00000020:00000040:3.0:1783444592.239324:0:25139:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.239329:0:25139:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=32 00000100:00000040:3.0:1783444592.239355:0:25139:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.239408:0:25139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1075 00000100:00000040:3.0:1783444592.239412:0:25139:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.239422:0:25139:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afc380 x1870073557902080/t0(4294969503) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.239437:0:25139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+32:2400:x1870073557902080:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:3.0:1783444592.239450:0:25139:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afc380 x1870073557902080/t0(4294969503) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.239460:0:25139:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969503, current: 4294969503, replaying 00010000:00000040:3.0:1783444592.239463:0:25139:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.239477:0:25139:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afc380 x1870073557902080/t0(4294969503) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.239486:0:25139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+32:2400:x1870073557902080:12345-192.168.204.20@tcp:4:dd.0 Request processed in 52us (326us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.239493:0:25139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1075 00000100:00000040:3.0:1783444592.239495:0:25139:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:3.0:1783444592.239511:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969503, next_transno: 4294969503 00010000:00080000:3.0:1783444592.239516:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969503) 00010000:00080000:3.0:1783444592.239524:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557902080 t4294969503 from 192.168.204.20@tcp req@ffff9367c3afc380 x1870073557902080/t0(4294969503) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444592.239538:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afc380 x1870073557902080/t0(4294969503) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1783444592.239626:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1783444592.239659:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:3.0:1783444592.239663:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1783444592.239962:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 28 00000020:00000040:3.0:1783444592.239966:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=33 00010000:00000040:3.0:1783444592.240515:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969503, xid 1870073557902080 00000100:00000040:3.0:1783444592.240527:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444592.240532:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:3.0:1783444592.240589:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:3.0:1783444592.240599:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1783444592.240606:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:3.0:1783444592.240616:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 32 00010000:00080000:3.0:1783444592.240621:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00010000:00080000:3.0:1783444592.240625:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00000100:00000040:0.0:1783444592.250416:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afd880 x1870073557902336 msgsize 1512 00000100:00100000:0.0:1783444592.250430:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.250818:0:24883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902336 00000100:00100000:1.0:1783444592.250835:0:24883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902336 00000020:00000040:1.0:1783444592.250838:0:24883:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.250843:0:24883:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=33 00000100:00000040:1.0:1783444592.250864:0:24883:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.250917:0:24883:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1076 00000100:00000040:1.0:1783444592.250921:0:24883:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.250928:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afd880 x1870073557902336/t0(4294969504) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.250942:0:24883:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2400:x1870073557902336:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:1.0:1783444592.250953:0:24883:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afd880 x1870073557902336/t0(4294969504) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.250961:0:24883:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969504, current: 4294969504, replaying 00010000:00000040:1.0:1783444592.250965:0:24883:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.250982:0:24883:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afd880 x1870073557902336/t0(4294969504) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.250991:0:24883:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:08efc25c-17e5-4d29-97d2-f1505f195a06+33:2400:x1870073557902336:12345-192.168.204.20@tcp:4:dd.0 Request processed in 51us (577us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.250998:0:24883:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1076 00000100:00000040:1.0:1783444592.251001:0:24883:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.251150:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969504, next_transno: 4294969504 00010000:00080000:0.0:1783444592.251155:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969504) 00010000:00080000:0.0:1783444592.251163:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557902336 t4294969504 from 192.168.204.20@tcp req@ffff9367c3afd880 x1870073557902336/t0(4294969504) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.251180:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c3afd880 x1870073557902336/t0(4294969504) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.251286:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783444592.251318:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:0.0:1783444592.251321:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783444592.251546:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 29 00000020:00000040:0.0:1783444592.251550:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=34 00010000:00000040:0.0:1783444592.253405:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969504, xid 1870073557902336 00000100:00000040:0.0:1783444592.253424:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.253432:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.253542:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.253557:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.253565:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.253579:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 33 00010000:00080000:0.0:1783444592.253585:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00010000:00080000:0.0:1783444592.253589:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00000100:00000040:3.0:1783444592.258187:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f4a80 x1870073557902592 msgsize 1512 00000100:00100000:3.0:1783444592.258205:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.258240:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902592 00000100:00100000:3.0:1783444592.258251:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902592 00000020:00000040:3.0:1783444592.258254:0:8427:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.258259:0:8427:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=34 00000100:00000040:3.0:1783444592.258280:0:8427:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.258324:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1077 00000100:00000040:3.0:1783444592.258328:0:8427:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.258335:0:8427:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f4a80 x1870073557902592/t0(4294969505) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.258350:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+34:2400:x1870073557902592:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:3.0:1783444592.258364:0:8427:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f4a80 x1870073557902592/t0(4294969505) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.258378:0:8427:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969505, current: 4294969505, replaying 00010000:00000040:3.0:1783444592.258389:0:8427:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.258408:0:8427:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f4a80 x1870073557902592/t0(4294969505) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.258418:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+34:2400:x1870073557902592:12345-192.168.204.20@tcp:4:dd.0 Request processed in 70us (231us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.258427:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1077 00010000:00080000:0.0:1783444592.258428:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969505, next_transno: 4294969505 00010000:00080000:0.0:1783444592.258433:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969505) 00010000:00080000:0.0:1783444592.258444:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557902592 t4294969505 from 192.168.204.20@tcp req@ffff9367c33f4a80 x1870073557902592/t0(4294969505) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.258460:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f4a80 x1870073557902592/t0(4294969505) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:3.0:1783444592.258502:0:8427:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00000020:00000040:0.0:1783444592.258544:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783444592.258573:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:0.0:1783444592.258577:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783444592.258849:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 30 00000020:00000040:0.0:1783444592.258853:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=35 00010000:00000040:0.0:1783444592.260194:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969505, xid 1870073557902592 00000100:00000040:0.0:1783444592.260350:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.260358:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.260411:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.260428:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.260436:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.260447:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 34 00010000:00080000:0.0:1783444592.260453:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00010000:00080000:0.0:1783444592.260457:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00000100:00000040:2.0:1783444592.277236:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9367c4368000 x1870073557902848 msgsize 1512 00000100:00100000:2.0:1783444592.277252:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444592.277494:0:24870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557902848 00000100:00100000:0.0:1783444592.277503:0:24870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557902848 00000020:00000040:0.0:1783444592.277505:0:24870:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444592.277510:0:24870:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=35 00000100:00000040:0.0:1783444592.277531:0:24870:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783444592.277568:0:24870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1078 00000100:00000040:0.0:1783444592.277571:0:24870:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444592.277576:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c4368000 x1870073557902848/t0(4294969506) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.277585:0:24870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+35:2400:x1870073557902848:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:0.0:1783444592.277593:0:24870:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c4368000 x1870073557902848/t0(4294969506) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444592.277600:0:24870:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969506, current: 4294969506, replaying 00010000:00000040:0.0:1783444592.277603:0:24870:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:0.0:1783444592.277609:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c4368000 x1870073557902848/t0(4294969506) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.277616:0:24870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+35:2400:x1870073557902848:12345-192.168.204.20@tcp:4:dd.0 Request processed in 31us (382us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444592.277621:0:24870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1078 00000100:00000040:0.0:1783444592.277623:0:24870:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.281456:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969506, next_transno: 4294969506 00010000:00080000:0.0:1783444592.281472:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969506) 00010000:00080000:0.0:1783444592.281490:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557902848 t4294969506 from 192.168.204.20@tcp req@ffff9367c4368000 x1870073557902848/t0(4294969506) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.281521:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c4368000 x1870073557902848/t0(4294969506) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.281619:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783444592.281663:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:0.0:1783444592.281667:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783444592.281928:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 31 00000020:00000040:0.0:1783444592.281933:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=36 00010000:00000040:1.0:1783444592.285750:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969506, xid 1870073557902848 00000100:00000040:1.0:1783444592.285776:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.285785:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.285858:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.285870:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.285880:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.285893:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 35 00010000:00080000:1.0:1783444592.285899:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00010000:00080000:1.0:1783444592.285909:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00000100:00000040:1.0:1783444592.292628:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7a9500 x1870073557903104 msgsize 1512 00000100:00100000:1.0:1783444592.292645:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.292677:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903104 00000100:00100000:1.0:1783444592.292686:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903104 00000020:00000040:1.0:1783444592.292814:0:8426:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.292819:0:8426:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=36 00000100:00000040:1.0:1783444592.292841:0:8426:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.292890:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1079 00000100:00000040:1.0:1783444592.292895:0:8426:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.292903:0:8426:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7a9500 x1870073557903104/t0(4294969507) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.292918:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+36:2400:x1870073557903104:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:1.0:1783444592.292931:0:8426:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a9500 x1870073557903104/t0(4294969507) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.292941:0:8426:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969507, current: 4294969507, replaying 00010000:00000040:1.0:1783444592.292944:0:8426:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.292955:0:8426:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9500 x1870073557903104/t0(4294969507) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.292965:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+36:2400:x1870073557903104:12345-192.168.204.20@tcp:4:dd.0 Request processed in 49us (337us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.292972:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1079 00000100:00000040:1.0:1783444592.292974:0:8426:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.292995:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969507, next_transno: 4294969507 00010000:00080000:1.0:1783444592.292999:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969507) 00010000:00080000:1.0:1783444592.293006:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557903104 t4294969507 from 192.168.204.20@tcp req@ffff9368eb7a9500 x1870073557903104/t0(4294969507) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.293030:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a9500 x1870073557903104/t0(4294969507) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.293110:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783444592.293136:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:1.0:1783444592.293139:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783444592.295095:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 32 00000020:00000040:1.0:1783444592.295103:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=37 00010000:00000040:1.0:1783444592.295151:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969507, xid 1870073557903104 00000100:00000040:1.0:1783444592.295164:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.295172:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.295225:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.295236:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.295244:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.295256:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 36 00010000:00080000:1.0:1783444592.295262:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00010000:00080000:1.0:1783444592.295267:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00000100:00000040:1.0:1783444592.298296:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9368eb7a9180 x1870073557903360 msgsize 1512 00000100:00100000:1.0:1783444592.298310:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.298342:0:24872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903360 00000100:00100000:1.0:1783444592.298350:0:24872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903360 00000020:00000040:1.0:1783444592.298353:0:24872:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.298358:0:24872:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=37 00000100:00000040:1.0:1783444592.298378:0:24872:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.298426:0:24872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1080 00000100:00000040:1.0:1783444592.298430:0:24872:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.298437:0:24872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eb7a9180 x1870073557903360/t0(4294969508) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.298461:0:24872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eb7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+37:2400:x1870073557903360:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:1.0:1783444592.298473:0:24872:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a9180 x1870073557903360/t0(4294969508) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.298481:0:24872:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969508, current: 4294969508, replaying 00010000:00000040:1.0:1783444592.298484:0:24872:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.298495:0:24872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eb7a9180 x1870073557903360/t0(4294969508) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.298503:0:24872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eb7a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+37:2400:x1870073557903360:12345-192.168.204.20@tcp:4:dd.0 Request processed in 44us (207us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.298510:0:24872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1080 00000100:00000040:1.0:1783444592.298513:0:24872:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.298529:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969508, next_transno: 4294969508 00010000:00080000:1.0:1783444592.298532:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969508) 00010000:00080000:1.0:1783444592.298539:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557903360 t4294969508 from 192.168.204.20@tcp req@ffff9368eb7a9180 x1870073557903360/t0(4294969508) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.298552:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eb7a9180 x1870073557903360/t0(4294969508) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.298633:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783444592.298661:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:1.0:1783444592.298665:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783444592.298948:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 33 00000020:00000040:1.0:1783444592.298952:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=38 00010000:00000040:1.0:1783444592.299560:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969508, xid 1870073557903360 00000100:00000040:1.0:1783444592.299574:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.299588:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.299653:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.299671:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.299679:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.299691:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 37 00010000:00080000:1.0:1783444592.299696:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00010000:00080000:1.0:1783444592.299709:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00000100:00000040:1.0:1783444592.302896:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368e3ef9500 x1870073557903616 msgsize 1512 00000100:00100000:1.0:1783444592.302911:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444592.302984:0:25139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903616 00000100:00100000:3.0:1783444592.302995:0:25139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903616 00000020:00000040:3.0:1783444592.302998:0:25139:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:3.0:1783444592.303004:0:25139:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=38 00000100:00000040:3.0:1783444592.303027:0:25139:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1783444592.303084:0:25139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1081 00000100:00000040:3.0:1783444592.303088:0:25139:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:3.0:1783444592.303097:0:25139:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368e3ef9500 x1870073557903616/t0(4294969509) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.303112:0:25139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e3ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+38:2400:x1870073557903616:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:3.0:1783444592.303124:0:25139:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368e3ef9500 x1870073557903616/t0(4294969509) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1783444592.303134:0:25139:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969509, current: 4294969509, replaying 00010000:00000040:3.0:1783444592.303137:0:25139:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:3.0:1783444592.303269:0:25139:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368e3ef9500 x1870073557903616/t0(4294969509) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783444592.303279:0:25139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e3ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:08efc25c-17e5-4d29-97d2-f1505f195a06+38:2400:x1870073557903616:12345-192.168.204.20@tcp:4:dd.0 Request processed in 169us (383us total) trans 0 rc 0/-999 00000100:00100000:3.0:1783444592.303288:0:25139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1081 00000100:00000040:3.0:1783444592.303299:0:25139:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.303589:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969509, next_transno: 4294969509 00010000:00080000:1.0:1783444592.303594:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969509) 00010000:00080000:1.0:1783444592.303603:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557903616 t4294969509 from 192.168.204.20@tcp req@ffff9368e3ef9500 x1870073557903616/t0(4294969509) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.303625:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368e3ef9500 x1870073557903616/t0(4294969509) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.303731:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783444592.303759:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:1.0:1783444592.303763:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783444592.304252:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 34 00000020:00000040:1.0:1783444592.304257:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=39 00010000:00000040:1.0:1783444592.304360:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969509, xid 1870073557903616 00000100:00000040:1.0:1783444592.304371:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.304378:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.304430:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.304440:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.304446:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.304455:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 38 00010000:00080000:1.0:1783444592.304460:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00010000:00080000:1.0:1783444592.304470:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00000100:00000040:3.0:1783444592.310163:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9367c33f4e00 x1870073557903872 msgsize 1512 00000100:00100000:3.0:1783444592.310175:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.310327:0:24881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557903872 00000100:00100000:2.0:1783444592.310338:0:24881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557903872 00000020:00000040:2.0:1783444592.310347:0:24881:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.310352:0:24881:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=39 00000100:00000040:2.0:1783444592.310385:0:24881:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.310428:0:24881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1082 00000100:00000040:2.0:1783444592.310432:0:24881:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.310440:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c33f4e00 x1870073557903872/t0(4294969510) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.310454:0:24881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+39:2400:x1870073557903872:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:2.0:1783444592.310465:0:24881:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f4e00 x1870073557903872/t0(4294969510) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.310473:0:24881:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969510, current: 4294969510, replaying 00010000:00000040:2.0:1783444592.310477:0:24881:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.310487:0:24881:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c33f4e00 x1870073557903872/t0(4294969510) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.310495:0:24881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+39:2400:x1870073557903872:12345-192.168.204.20@tcp:4:dd.0 Request processed in 43us (333us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.310512:0:24881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1082 00000100:00000040:2.0:1783444592.310516:0:24881:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:2.0:1783444592.310534:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969510, next_transno: 4294969510 00010000:00080000:2.0:1783444592.310537:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969510) 00010000:00080000:2.0:1783444592.310544:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557903872 t4294969510 from 192.168.204.20@tcp req@ffff9367c33f4e00 x1870073557903872/t0(4294969510) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.310559:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9367c33f4e00 x1870073557903872/t0(4294969510) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.310652:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783444592.310680:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:2.0:1783444592.310683:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783444592.311073:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 35 00000020:00000040:2.0:1783444592.311079:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=40 00010000:00000040:2.0:1783444592.311503:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969510, xid 1870073557903872 00000100:00000040:2.0:1783444592.311515:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444592.311523:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444592.311571:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:2.0:1783444592.311581:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783444592.311590:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:2.0:1783444592.311602:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 39 00010000:00080000:2.0:1783444592.311607:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00010000:00080000:2.0:1783444592.311613:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00000100:00000040:3.0:1783444592.312929:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf5180 x1870073557904128 msgsize 1512 00000100:00100000:3.0:1783444592.312943:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.313261:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904128 00000100:00100000:2.0:1783444592.313282:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904128 00000020:00000040:2.0:1783444592.313286:0:8427:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.313292:0:8427:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=40 00000100:00000040:2.0:1783444592.313315:0:8427:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.313373:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1083 00000100:00000040:2.0:1783444592.313379:0:8427:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.313396:0:8427:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf5180 x1870073557904128/t0(4294969511) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.313413:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+40:2400:x1870073557904128:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:2.0:1783444592.313424:0:8427:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eaaf5180 x1870073557904128/t0(4294969511) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.313433:0:8427:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969511, current: 4294969511, replaying 00010000:00000040:2.0:1783444592.313437:0:8427:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.313454:0:8427:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5180 x1870073557904128/t0(4294969511) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.313463:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+40:2400:x1870073557904128:12345-192.168.204.20@tcp:4:dd.0 Request processed in 55us (534us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.313470:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1083 00000100:00000040:2.0:1783444592.313473:0:8427:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.314174:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969511, next_transno: 4294969511 00010000:00080000:1.0:1783444592.314180:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969511) 00010000:00080000:1.0:1783444592.314191:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557904128 t4294969511 from 192.168.204.20@tcp req@ffff9368eaaf5180 x1870073557904128/t0(4294969511) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.314212:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eaaf5180 x1870073557904128/t0(4294969511) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.314430:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1783444592.314459:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:1.0:1783444592.314462:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1783444592.314691:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 36 00000020:00000040:1.0:1783444592.314695:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=41 00010000:00000040:1.0:1783444592.315221:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969511, xid 1870073557904128 00000100:00000040:1.0:1783444592.315233:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444592.315241:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444592.315295:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:1.0:1783444592.315307:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1783444592.315314:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:1.0:1783444592.315326:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 40 00010000:00080000:1.0:1783444592.315332:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00010000:00080000:1.0:1783444592.315336:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00000100:00000040:1.0:1783444592.319532:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f564a300 x1870073557904384 msgsize 1512 00000100:00100000:1.0:1783444592.319547:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444592.320107:0:24870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904384 00000100:00100000:0.0:1783444592.320117:0:24870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904384 00000020:00000040:0.0:1783444592.320125:0:24870:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444592.320204:0:24870:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=41 00000100:00000040:0.0:1783444592.320233:0:24870:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783444592.320288:0:24870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1084 00000100:00000040:0.0:1783444592.320293:0:24870:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444592.320301:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f564a300 x1870073557904384/t0(4294969512) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.320316:0:24870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f564a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+41:2400:x1870073557904384:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:0.0:1783444592.320328:0:24870:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f564a300 x1870073557904384/t0(4294969512) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444592.320337:0:24870:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969512, current: 4294969512, replaying 00010000:00000040:0.0:1783444592.320341:0:24870:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:0.0:1783444592.320357:0:24870:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f564a300 x1870073557904384/t0(4294969512) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.320366:0:24870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f564a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:08efc25c-17e5-4d29-97d2-f1505f195a06+41:2400:x1870073557904384:12345-192.168.204.20@tcp:4:dd.0 Request processed in 52us (835us total) trans 0 rc 0/-999 00000100:00100000:0.0:1783444592.320380:0:24870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1084 00000100:00000040:0.0:1783444592.320383:0:24870:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:1.0:1783444592.320595:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969512, next_transno: 4294969512 00010000:00080000:1.0:1783444592.320600:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969512) 00010000:00080000:1.0:1783444592.320609:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557904384 t4294969512 from 192.168.204.20@tcp req@ffff9368f564a300 x1870073557904384/t0(4294969512) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1783444592.320640:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f564a300 x1870073557904384/t0(4294969512) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.321315:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783444592.321344:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:0.0:1783444592.321347:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783444592.321989:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 37 00000020:00000040:0.0:1783444592.321995:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=42 00010000:00000040:0.0:1783444592.322501:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969512, xid 1870073557904384 00000100:00000040:0.0:1783444592.322514:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.322722:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.322778:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.323255:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.323266:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.323279:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 41 00010000:00080000:0.0:1783444592.323285:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00010000:00080000:0.0:1783444592.323289:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00000100:00000040:3.0:1783444592.329656:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf6680 x1870073557904640 msgsize 1512 00000100:00100000:3.0:1783444592.329677:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.332814:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904640 00000100:00100000:1.0:1783444592.332829:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904640 00000020:00000040:1.0:1783444592.332833:0:8426:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.332839:0:8426:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=42 00000100:00000040:1.0:1783444592.332871:0:8426:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1783444592.332933:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1085 00000100:00000040:1.0:1783444592.332938:0:8426:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:1.0:1783444592.332946:0:8426:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf6680 x1870073557904640/t0(4294969513) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.332960:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+42:2400:x1870073557904640:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:1.0:1783444592.332972:0:8426:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eaaf6680 x1870073557904640/t0(4294969513) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1783444592.332981:0:8426:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969513, current: 4294969513, replaying 00010000:00000040:1.0:1783444592.332984:0:8426:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:1.0:1783444592.333005:0:8426:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf6680 x1870073557904640/t0(4294969513) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1783444592.333014:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:08efc25c-17e5-4d29-97d2-f1505f195a06+42:2400:x1870073557904640:12345-192.168.204.20@tcp:4:dd.0 Request processed in 57us (3359us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.333021:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1085 00000100:00000040:1.0:1783444592.333024:0:8426:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.336992:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969513, next_transno: 4294969513 00010000:00080000:0.0:1783444592.337002:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969513) 00010000:00080000:0.0:1783444592.337019:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557904640 t4294969513 from 192.168.204.20@tcp req@ffff9368eaaf6680 x1870073557904640/t0(4294969513) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.337048:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eaaf6680 x1870073557904640/t0(4294969513) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.337165:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783444592.337194:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:0.0:1783444592.337197:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783444592.337442:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 38 00000020:00000040:0.0:1783444592.337447:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=43 00010000:00000040:0.0:1783444592.337643:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969513, xid 1870073557904640 00000100:00000040:0.0:1783444592.337656:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.337663:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.337729:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.337740:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.337748:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.337762:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 42 00010000:00080000:0.0:1783444592.337766:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00010000:00080000:0.0:1783444592.337770:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00000100:00000040:1.0:1783444592.345746:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9368f564b480 x1870073557904896 msgsize 1512 00000100:00100000:1.0:1783444592.345762:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.346348:0:24872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557904896 00000100:00100000:2.0:1783444592.346358:0:24872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557904896 00000020:00000040:2.0:1783444592.346362:0:24872:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.346368:0:24872:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=43 00000100:00000040:2.0:1783444592.346394:0:24872:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1783444592.346487:0:24872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1086 00000100:00000040:2.0:1783444592.346492:0:24872:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.346500:0:24872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f564b480 x1870073557904896/t0(4294969514) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.346515:0:24872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f564b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+43:2400:x1870073557904896:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:2.0:1783444592.346528:0:24872:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f564b480 x1870073557904896/t0(4294969514) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1783444592.346547:0:24872:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969514, current: 4294969514, replaying 00010000:00000040:2.0:1783444592.346551:0:24872:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:2.0:1783444592.346570:0:24872:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f564b480 x1870073557904896/t0(4294969514) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1783444592.346580:0:24872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f564b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+43:2400:x1870073557904896:12345-192.168.204.20@tcp:4:dd.0 Request processed in 67us (835us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.346588:0:24872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1086 00000100:00000040:2.0:1783444592.346591:0:24872:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00010000:00080000:0.0:1783444592.346636:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969514, next_transno: 4294969514 00010000:00080000:0.0:1783444592.346642:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969514) 00010000:00080000:0.0:1783444592.346652:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557904896 t4294969514 from 192.168.204.20@tcp req@ffff9368f564b480 x1870073557904896/t0(4294969514) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.346670:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f564b480 x1870073557904896/t0(4294969514) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1783444592.346775:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1783444592.347454:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:0.0:1783444592.347459:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1783444592.347690:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 39 00000020:00000040:0.0:1783444592.347694:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=44 00010000:00000040:0.0:1783444592.348506:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969514, xid 1870073557904896 00000100:00000040:0.0:1783444592.348521:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444592.348528:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444592.348577:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:0.0:1783444592.348589:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1783444592.348600:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:0.0:1783444592.348612:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 43 00010000:00080000:0.0:1783444592.348618:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00010000:00080000:0.0:1783444592.348632:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00000100:00000040:1.0:1783444592.350822:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f5649c00 x1870073557905152 msgsize 1512 00000100:00100000:1.0:1783444592.350847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444592.350945:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557905152 00000100:00100000:0.0:1783444592.350954:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557905152 00000020:00000040:0.0:1783444592.350958:0:8425:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:0.0:1783444592.350962:0:8425:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=44 00000100:00000040:0.0:1783444592.350985:0:8425:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1783444592.351028:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1087 00000100:00000040:0.0:1783444592.351032:0:8425:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:0.0:1783444592.351039:0:8425:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f5649c00 x1870073557905152/t0(4294969515) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.351052:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+44:2400:x1870073557905152:12345-192.168.204.20@tcp:4:dd.0 00000020:00000040:0.0:1783444592.351063:0:8425:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f5649c00 x1870073557905152/t0(4294969515) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1783444592.351073:0:8425:0:(ldlm_lib.c:3215:target_queue_recovery_request()) Next recovery transno: 4294969515, current: 4294969515, replaying 00010000:00000040:0.0:1783444592.351077:0:8425:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00000040:0.0:1783444592.351095:0:8425:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f5649c00 x1870073557905152/t0(4294969515) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.351105:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:08efc25c-17e5-4d29-97d2-f1505f195a06+44:2400:x1870073557905152:12345-192.168.204.20@tcp:4:dd.0 Request processed in 54us (317us total) trans 0 rc 0/-999 00010000:00080000:2.0:1783444592.351116:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969515, next_transno: 4294969515 00010000:00080000:2.0:1783444592.351122:0:96948:0:(ldlm_lib.c:2233:check_for_next_transno()) waking for next (4294969515) 00010000:00080000:2.0:1783444592.351131:0:96948:0:(ldlm_lib.c:2734:replay_request_or_update()) @@@ processing x1870073557905152 t4294969515 from 192.168.204.20@tcp req@ffff9368f5649c00 x1870073557905152/t0(4294969515) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1783444592.351150:0:96948:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f5649c00 x1870073557905152/t0(4294969515) o4->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 1512/0 e 0 to 0 dl 1783444603 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1783444592.351204:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1087 00000100:00000040:0.0:1783444592.351209:0:8425:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00000020:00000040:2.0:1783444592.351242:0:96948:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1783444592.351272:0:96948:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 6403 MB/s 00000020:00000040:2.0:1783444592.351275:0:96948:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1783444592.351507:0:96948:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9367c17cd800 : new cb_count 40 00000020:00000040:2.0:1783444592.351511:0:96948:0:(genops.c:889:class_export_get()) GET export ffff9367c17cd800 refcount=45 00010000:00000040:2.0:1783444592.351854:0:96948:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969475, transno 4294969515, xid 1870073557905152 00000100:00000040:2.0:1783444592.351865:0:96948:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:2.0:1783444592.351873:0:96948:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:2.0:1783444592.351925:0:96948:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00010000:00080000:2.0:1783444592.351933:0:96948:0:(ldlm_lib.c:2087:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1783444592.351940:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:2.0:1783444592.351949:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 44 00010000:00080000:2.0:1783444592.351959:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00010000:00080000:2.0:1783444592.351963:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00000100:00000040:3.0:1783444592.360858:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf7800 x1870073557908608 msgsize 328 00000100:00100000:3.0:1783444592.360874:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:3.0:1783444592.360913:0:3626:0:(events.c:337:request_in_callback()) incoming req@ffff9368eaaf5f80 x1870073557908736 msgsize 328 00000100:00100000:3.0:1783444592.360918:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1783444592.360948:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557908608 00000100:00100000:2.0:1783444592.360960:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557908608 00000020:00000040:2.0:1783444592.360963:0:26204:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.360969:0:26204:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=45 00000100:00100000:2.0:1783444592.361029:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557908736 00000100:00100000:2.0:1783444592.361032:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557908736 00000020:00000040:2.0:1783444592.361034:0:26204:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:2.0:1783444592.361036:0:26204:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=46 00000100:00100000:2.0:1783444592.361064:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6005 00000100:00000040:2.0:1783444592.361068:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 1 00000100:00000040:2.0:1783444592.361077:0:26204:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf7800 x1870073557908608/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444592.361093:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6006 00000100:00000040:3.0:1783444592.361098:0:26210:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 2 00000100:00100000:2.0:1783444592.361103:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+46:2400:x1870073557908608:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00000100:00000040:3.0:1783444592.361105:0:26210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368eaaf5f80 x1870073557908736/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444592.361126:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+46:2400:x1870073557908736:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1783444592.361126:0:26204:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eaaf7800 x1870073557908608/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1783444592.361142:0:26204:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 3 00000020:00000040:3.0:1783444592.361155:0:26210:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368eaaf5f80 x1870073557908736/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1783444592.361158:0:26204:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9368eaaf7800 x1870073557908608/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1783444592.361173:0:26210:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 4 00010000:00080000:3.0:1783444592.361179:0:26210:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9368eaaf5f80 x1870073557908736/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444592.361182:0:26204:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf7800 x1870073557908608/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444592.361202:0:26210:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf5f80 x1870073557908736/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444592.361204:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:08efc25c-17e5-4d29-97d2-f1505f195a06+46:2400:x1870073557908608:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 113us (344us total) trans 0 rc 0/-999 00000100:00100000:2.0:1783444592.361221:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6005 00000100:00100000:3.0:1783444592.361226:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:08efc25c-17e5-4d29-97d2-f1505f195a06+46:2400:x1870073557908736:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 103us (307us total) trans 0 rc 0/-999 00000100:00000040:2.0:1783444592.361227:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 3 00000100:00100000:3.0:1783444592.361251:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6006 00000100:00000040:3.0:1783444592.361254:0:26210:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 2 00010000:00080000:2.0:1783444592.361262:0:96948:0:(ldlm_lib.c:2215:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969516 00010000:00080000:2.0:1783444592.361267:0:96948:0:(ldlm_lib.c:2249:check_for_next_transno()) waking for completed recovery 00010000:00000040:2.0:1783444592.361274:0:96948:0:(ldlm_lib.c:2868:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:2.0:1783444592.361277:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783444592.361279:0:96948:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783444592.361286:0:96948:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9368eaaf7800 x1870073557908608/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783444592.361294:0:96948:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00000040:1.0:1783444592.362469:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f564b800 x1870073557908864 msgsize 328 00000100:00100000:1.0:1783444592.362479:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444592.362507:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f5649f80 x1870073557908992 msgsize 328 00000100:00100000:1.0:1783444592.362512:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444592.362541:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f9bda850 x1870073557909120 msgsize 328 00000100:00100000:1.0:1783444592.362546:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444592.362547:0:3627:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1783444592.362570:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f5648000 x1870073557909248 msgsize 328 00000100:00100000:1.0:1783444592.362575:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444592.362591:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f564b100 x1870073557909376 msgsize 328 00000100:00100000:1.0:1783444592.362595:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444592.362611:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368f564aa00 x1870073557909504 msgsize 328 00000100:00100000:1.0:1783444592.362615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444592.362639:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557908864 00000100:00100000:1.0:1783444592.362647:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557908864 00000020:00000040:1.0:1783444592.362650:0:17653:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.362653:0:17653:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=47 00000100:00100000:1.0:1783444592.362689:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557908992 00000100:00100000:1.0:1783444592.362693:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557908992 00000020:00000040:1.0:1783444592.362695:0:17653:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.362713:0:17653:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=48 00000100:00100000:1.0:1783444592.362733:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557909120 00000100:00100000:1.0:1783444592.362736:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557909120 00000020:00000040:1.0:1783444592.362737:0:17653:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.362739:0:17653:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=49 00000100:00100000:1.0:1783444592.362754:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557909248 00000100:00100000:1.0:1783444592.362756:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557909248 00000020:00000040:1.0:1783444592.362757:0:17653:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.362759:0:17653:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=50 00000100:00100000:1.0:1783444592.362814:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557909376 00000100:00100000:1.0:1783444592.362825:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557909376 00000020:00000040:1.0:1783444592.362827:0:17653:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.362829:0:17653:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=51 00000100:00100000:1.0:1783444592.362849:0:17653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557909504 00000100:00100000:1.0:1783444592.362851:0:17653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557909504 00000020:00000040:1.0:1783444592.362853:0:17653:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383458a 00000020:00000040:1.0:1783444592.362855:0:17653:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c17cd800 refcount=52 00000100:00100000:1.0:1783444592.362874:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6007 00000100:00000040:1.0:1783444592.362877:0:17653:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 3 00000100:00000040:1.0:1783444592.362885:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f564b800 x1870073557908864/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.362897:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f564b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557908864:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783444592.362910:0:17653:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f564b800 x1870073557908864/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444592.362919:0:17653:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 4 00010000:00080000:1.0:1783444592.362923:0:17653:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9368f564b800 x1870073557908864/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444592.362932:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f564b800 x1870073557908864/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.362941:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f564b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557908864:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 45us (471us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.362948:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6007 00000100:00000040:1.0:1783444592.362951:0:17653:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 3 00000100:00100000:1.0:1783444592.362959:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6008 00000100:00000040:1.0:1783444592.362962:0:17653:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 4 00000100:00000040:1.0:1783444592.362965:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f5649f80 x1870073557908992/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.362981:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557908992:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783444592.362989:0:17653:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f5649f80 x1870073557908992/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444592.362996:0:17653:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 5 00010000:00080000:1.0:1783444592.362999:0:17653:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9368f5649f80 x1870073557908992/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444592.363007:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f5649f80 x1870073557908992/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363016:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557908992:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 36us (507us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.363022:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6008 00000100:00000040:1.0:1783444592.363024:0:17653:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 4 00000100:00100000:1.0:1783444592.363032:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6009 00000100:00000040:1.0:1783444592.363035:0:17653:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 5 00000100:00000040:1.0:1783444592.363039:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f9bda850 x1870073557909120/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363050:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557909120:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783444592.363056:0:17653:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f9bda850 x1870073557909120/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444592.363062:0:17653:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 6 00010000:00080000:1.0:1783444592.363066:0:17653:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9368f9bda850 x1870073557909120/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444592.363086:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f9bda850 x1870073557909120/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363094:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f9bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557909120:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 46us (550us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.363100:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6009 00000100:00000040:1.0:1783444592.363102:0:17653:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 5 00000100:00100000:1.0:1783444592.363111:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6010 00000100:00000040:1.0:1783444592.363113:0:17653:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 6 00000100:00000040:1.0:1783444592.363117:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f5648000 x1870073557909248/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363127:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557909248:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783444592.363134:0:17653:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f5648000 x1870073557909248/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444592.363140:0:17653:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 7 00010000:00080000:1.0:1783444592.363144:0:17653:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9368f5648000 x1870073557909248/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444592.363152:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f5648000 x1870073557909248/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363160:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557909248:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 36us (588us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.363166:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6010 00000100:00000040:1.0:1783444592.363168:0:17653:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 6 00000100:00100000:1.0:1783444592.363183:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6011 00000100:00000040:1.0:1783444592.363185:0:17653:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 7 00000100:00000040:1.0:1783444592.363189:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f564b100 x1870073557909376/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363199:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f564b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557909376:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783444592.363207:0:17653:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f564b100 x1870073557909376/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444592.363213:0:17653:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 8 00010000:00080000:1.0:1783444592.363217:0:17653:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9368f564b100 x1870073557909376/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444592.363225:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f564b100 x1870073557909376/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363234:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f564b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557909376:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 36us (641us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.363239:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6011 00000100:00000040:1.0:1783444592.363241:0:17653:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 7 00000100:00100000:1.0:1783444592.363247:0:17653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6012 00000100:00000040:1.0:1783444592.363249:0:17653:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 8 00000100:00000040:1.0:1783444592.363252:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f564aa00 x1870073557909504/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363262:0:17653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f564aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557909504:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1783444592.363585:0:17653:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9368f564aa00 x1870073557909504/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1783444592.363607:0:17653:0:(ldlm_lib.c:1761:target_request_copy_get()) RPC GETting export ffff9367c17cd800 : new rpc_count 9 00010000:00080000:1.0:1783444592.363612:0:17653:0:(ldlm_lib.c:3174:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9368f564aa00 x1870073557909504/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444592.363621:0:17653:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f564aa00 x1870073557909504/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444592.363630:0:17653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f564aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+52:2400:x1870073557909504:12345-192.168.204.20@tcp:101:ldlm_lock_repla.0 Request processed in 368us (1016us total) trans 0 rc 0/-999 00000100:00100000:1.0:1783444592.363636:0:17653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6012 00000100:00000040:1.0:1783444592.363639:0:17653:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c17cd800 : new rpc_count 8 00010000:00000040:2.0:1783444592.370000:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 7 00000020:00000040:2.0:1783444592.370026:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 51 00010000:00080000:2.0:1783444592.370031:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1783444592.370047:0:96948:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1783444592.370062:0:96948:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9368eaaf5f80 x1870073557908736/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1783444592.370074:0:96948:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1783444592.370086:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 6 00000020:00000040:2.0:1783444592.370093:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 50 00010000:00080000:2.0:1783444592.370095:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783444592.370151:0:96948:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783444592.370161:0:96948:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9368f564b800 x1870073557908864/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444592.370170:0:96948:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783444592.370171:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 5 00000020:00000040:3.0:1783444592.370184:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 49 00010000:00080000:3.0:1783444592.370186:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783444592.370188:0:96948:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783444592.370193:0:96948:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9368f5649f80 x1870073557908992/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444592.370200:0:96948:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783444592.370202:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 4 00000020:00000040:3.0:1783444592.370206:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 48 00010000:00080000:3.0:1783444592.370208:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783444592.370209:0:96948:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783444592.370213:0:96948:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9368f9bda850 x1870073557909120/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444592.370219:0:96948:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783444592.370221:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 3 00000020:00000040:3.0:1783444592.370225:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 47 00010000:00080000:3.0:1783444592.370227:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783444592.370228:0:96948:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783444592.370232:0:96948:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9368f5648000 x1870073557909248/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444592.370238:0:96948:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783444592.370240:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 2 00000020:00000040:3.0:1783444592.370262:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 46 00010000:00080000:3.0:1783444592.370264:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783444592.370266:0:96948:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783444592.370403:0:96948:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9368f564b100 x1870073557909376/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444592.370411:0:96948:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783444592.370413:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 1 00000020:00000040:3.0:1783444592.370420:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 45 00010000:00080000:3.0:1783444592.370422:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1783444592.370424:0:96948:0:(ldlm_lib.c:2269:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1783444592.370428:0:96948:0:(ldlm_lib.c:2875:target_recovery_thread()) @@@ processing lock from 192.168.204.20@tcp: req@ffff9368f564aa00 x1870073557909504/t0(0) o101->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:213/0 lens 328/0 e 0 to 0 dl 1783444603 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1783444592.370434:0:96948:0:(ldlm_lib.c:2876:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1783444592.370436:0:96948:0:(ldlm_lib.c:1777:target_request_copy_put()) RPC PUTting export ffff9367c17cd800 : new rpc_count 0 00000020:00000040:3.0:1783444592.370441:0:96948:0:(genops.c:900:class_export_put()) PUTting export ffff9367c17cd800 : new refcount 44 00010000:00080000:3.0:1783444592.370443:0:96948:0:(ldlm_lib.c:2439:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1783444592.739980:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1783444592.795294:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff936901f9cd40) now 10 - health_check_show 00000020:00000040:0.0:1783444592.795307:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff936901f9cd40) now 10 - health_check_show 00000020:00000040:0.0:1783444592.795310:0:97095:0:(obd_config.c:994:class_incref()) incref MDS (ffff9367c2c60000) now 4 - health_check_show 00000020:00000040:0.0:1783444592.795319:0:97095:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff9367c2c60000) now 4 - health_check_show 00000020:00000040:0.0:1783444592.795328:0:97095:0:(obd_config.c:994:class_incref()) incref MGC192.168.204.120@tcp (ffff9368c507b380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795331:0:97095:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.204.120@tcp (ffff9368c507b380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795333:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff9368dd0eb380) now 12 - health_check_show 00000020:00000040:0.0:1783444592.795336:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff9368dd0eb380) now 12 - health_check_show 00000020:00000040:0.0:1783444592.795339:0:97095:0:(obd_config.c:994:class_incref()) incref MGS (ffff9368dd0e99c0) now 8 - health_check_show 00000020:00000040:0.0:1783444592.795343:0:97095:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff9368dd0e99c0) now 8 - health_check_show 00000020:00000040:0.0:1783444592.795345:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff9368dcfdb380) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795348:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff9368dcfdb380) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795350:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 12 - health_check_show 00000020:00000040:0.0:1783444592.795353:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9368dcfd99c0) now 12 - health_check_show 00000020:00000040:0.0:1783444592.795355:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff9368dcfdcd40) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795358:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff9368dcfdcd40) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795360:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff9368c59e19c0) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795363:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff9368c59e19c0) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795365:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff936901f98000) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795366:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff936901f98000) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795369:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff9368eb66cd40) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795371:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff9368eb66cd40) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795373:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff9368eb668000) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795375:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff9368eb668000) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795377:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff9367c2c619c0) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795379:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff9367c2c619c0) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795382:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 16 - health_check_show 00000020:00000040:0.0:1783444592.795384:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9367c2c63380) now 16 - health_check_show 00000020:00000040:0.0:1783444592.795386:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff9367c72519c0) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795388:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff9367c72519c0) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795390:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff9367c7254d40) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795393:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff9367c7254d40) now 5 - health_check_show 00000020:00000040:0.0:1783444592.795401:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9367c1e819c0) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795404:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff9367c1e819c0) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795406:0:97095:0:(obd_config.c:994:class_incref()) incref OSS (ffff936901f999c0) now 4 - health_check_show 00000020:00000040:0.0:1783444592.795412:0:97095:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff936901f999c0) now 4 - health_check_show 00000020:00000040:0.0:1783444592.795414:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9367c7250000) now 10 - health_check_show 00000020:00000040:0.0:1783444592.795476:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9367c7250000) now 10 - health_check_show 00000020:00000040:0.0:1783444592.795479:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9367c2000000) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795481:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff9367c2000000) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795483:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9367c3330000) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795485:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff9367c3330000) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795487:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff9367c1e83380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795489:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff9367c1e83380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795491:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff9367c7253380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795493:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff9367c7253380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795495:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff936901f9b380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795498:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff936901f9b380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795500:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - health_check_show 00000020:00000040:0.0:1783444592.795519:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - health_check_show 00000020:00000040:0.0:1783444592.795523:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff936901dccd40) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795525:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff936901dccd40) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795527:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff936901dcb380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795529:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff936901dcb380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795531:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff9367c3333380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795533:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff9367c3333380) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795536:0:97095:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff9367c33319c0) now 6 - health_check_show 00000020:00000040:0.0:1783444592.795538:0:97095:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff9367c33319c0) now 6 - health_check_show 00000020:00000040:3.0:1783444593.438578:0:94371:0:(genops.c:1231:class_import_get()) import ffff9368cab9e800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1783444593.438683:0:94371:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000db6337ce] to pc [ptlrpcd_00_00+0] req@ffff9368eaaf6300 x1870073575469696/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.438754:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:0.0:1783444593.438773:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368eaaf6300 x1870073575469696/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.438786:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368eaaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575469696:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1783444593.438840:0:3634:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368eaaf6300 x1870073575469696/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444593.438848:0:3634:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444593.438939:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afca80 x1870073575469696 msgsize 224 00000100:00100000:0.0:1783444593.438944:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444593.438972:0:3634:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368eaaf6300 x1870073575469696/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444593.438985:0:3634:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5461 usecs (6 jiffies) 00000100:00100000:3.0:1783444593.439102:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575469696 00000100:00100000:3.0:1783444593.439110:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575469696 00000020:00000040:3.0:1783444593.439113:0:23687:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833609 00000020:00000040:3.0:1783444593.439118:0:23687:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368cb781800 refcount=5 00000100:00000040:3.0:1783444593.439143:0:23687:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1783444593.439178:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00000040:3.0:1783444593.439183:0:23687:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368cb781800 : new rpc_count 1 00000100:00000040:3.0:1783444593.439188:0:23687:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afca80 x1870073575469696/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:214/0 lens 224/0 e 0 to 0 dl 1783444604 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444593.439199:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575469696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783444593.439242:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00010000:00000040:3.0:1783444593.439324:0:23687:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073575469696 00000100:00000040:3.0:1783444593.439334:0:23687:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 66 to 0@lo 00000100:00000040:3.0:1783444593.439339:0:23687:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1783444593.439360:0:23687:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368eaaf6300 x1870073575469696/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444593.439377:0:23687:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 65 to 0@lo 00000100:00000040:3.0:1783444593.439382:0:23687:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afca80 x1870073575469696/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:214/0 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444593.439391:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575469696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444593.439398:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00000040:3.0:1783444593.439401:0:23687:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368cb781800 : new rpc_count 0 00000020:00000040:3.0:1783444593.439413:0:23687:0:(genops.c:900:class_export_put()) PUTting export ffff9368cb781800 : new refcount 4 00000100:00000040:0.0:1783444593.439586:0:3634:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1783444593.439593:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368eaaf6300 x1870073575469696/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1783444593.439604:0:3634:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352788 avail=317085 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023682 state=0: rc = 0 00000100:00000040:0.0:1783444593.439672:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368eaaf6300 x1870073575469696/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.439688:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368eaaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575469696:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1783444593.439697:0:3634:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368eaaf6300 x1870073575469696/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444593.439707:0:3634:0:(genops.c:1244:class_import_put()) import ffff9368cab9e800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:1.0:1783444593.439925:0:75662:0:(genops.c:1231:class_import_get()) import ffff9367c3a03800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783444593.439944:0:75662:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e3675437] to pc [ptlrpcd_00_01+1] req@ffff9368f5649500 x1870073575469824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444593.439981:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368f5649500 x1870073575469824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.439991:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f5649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575469824:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1783444593.440079:0:3634:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368f5649500 x1870073575469824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444609 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444593.440094:0:3634:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444593.440113:0:3634:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3afd500 x1870073575469824 msgsize 224 00000100:00100000:0.0:1783444593.440117:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1783444593.440139:0:3634:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368f5649500 x1870073575469824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444609 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444593.440148:0:3634:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4517 usecs (5 jiffies) 00000100:00100000:2.0:1783444593.440189:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575469824 00000100:00100000:2.0:1783444593.440195:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575469824 00000020:00000040:2.0:1783444593.440197:0:8424:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e382cf55 00000020:00000040:2.0:1783444593.440200:0:8424:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c3a07800 refcount=5 00000020:00000040:2.0:1783444593.440212:0:8424:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:2.0:1783444593.440240:0:8424:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1783444593.440336:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00000040:2.0:1783444593.440339:0:8424:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c3a07800 : new rpc_count 1 00000100:00000040:2.0:1783444593.440344:0:8424:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3afd500 x1870073575469824/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:214/0 lens 224/0 e 0 to 0 dl 1783444604 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444593.440358:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575469824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783444593.440381:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1783444593.440399:0:8424:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1870073575469824 00000100:00000040:2.0:1783444593.440406:0:8424:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 66 to 0@lo 00000100:00000040:2.0:1783444593.440410:0:8424:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444593.440428:0:8424:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368f5649500 x1870073575469824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783444593.440475:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1783444593.440479:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:2.0:1783444593.446156:0:8424:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 65 to 0@lo 00000100:00000040:2.0:1783444593.446171:0:8424:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afd500 x1870073575469824/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:214/0 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444593.446182:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575469824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5828us (6067us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444593.446193:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00000040:2.0:1783444593.446197:0:8424:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c3a07800 : new rpc_count 0 00000020:00000040:2.0:1783444593.446210:0:8424:0:(genops.c:900:class_export_put()) PUTting export ffff9367c3a07800 : new refcount 4 00000100:00000040:0.0:1783444593.446925:0:3634:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969457 00000100:00000040:0.0:1783444593.446935:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368f5649500 x1870073575469824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1783444593.446948:0:3634:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1783444593.446951:0:3634:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1783444593.446961:0:3634:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f5649500 x1870073575469824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.446968:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f5649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575469824:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1783444593.446979:0:3634:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368f5649500 x1870073575469824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1783444593.446989:0:3634:0:(genops.c:1244:class_import_put()) import ffff9367c3a03800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1783444593.738019:0:3627:0:(events.c:337:request_in_callback()) incoming req@ffff9368c9fcd850 x1870073557909632 msgsize 224 00000100:00100000:1.0:1783444593.738032:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:1.0:1783444593.738035:0:3627:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1783444593.738148:0:94360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557909632 00000100:00100000:3.0:1783444593.738158:0:94360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557909632 00000020:00000040:3.0:1783444593.738161:0:94360:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833679 00000020:00000040:3.0:1783444593.738166:0:94360:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c6ab4800 refcount=10 00000100:00000040:3.0:1783444593.738188:0:94360:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:0.0:1783444593.738298:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3aff800 x1870073557909888 msgsize 224 00000100:00100000:0.0:1783444593.738305:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:0.0:1783444593.738326:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3affb80 x1870073557909760 msgsize 224 00000100:00100000:0.0:1783444593.738330:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00000040:0.0:1783444593.738389:0:3628:0:(events.c:337:request_in_callback()) incoming req@ffff9367c3aff100 x1870073557910016 msgsize 224 00000100:00100000:0.0:1783444593.738394:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444593.738417:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557909888 00000100:00100000:0.0:1783444593.738422:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557909888 00000020:00000040:0.0:1783444593.738424:0:71469:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3832bdd 00000020:00000040:0.0:1783444593.738435:0:71469:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368dd20c800 refcount=11 00000020:00000040:0.0:1783444593.738446:0:71469:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9368dcfd99c0) now 12 - evictor 00000100:00000040:0.0:1783444593.738464:0:71469:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1783444593.738561:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557909760 00000100:00100000:0.0:1783444593.738565:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557909760 00000020:00000040:0.0:1783444593.738567:0:71469:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38335ca 00000020:00000040:0.0:1783444593.738570:0:71469:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c5621800 refcount=51 00000020:00000040:0.0:1783444593.738579:0:71469:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9367c2c63380) now 16 - evictor 00000100:00100000:3.0:1783444593.738585:0:94360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00000040:3.0:1783444593.738591:0:94360:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c6ab4800 : new rpc_count 1 00000100:00000040:3.0:1783444593.738599:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368c9fcd850 x1870073557909632/t0(0) o400->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:214/0 lens 224/0 e 0 to 0 dl 1783444604 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.738606:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1240 00000100:00000040:0.0:1783444593.738613:0:71469:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368dd20c800 : new rpc_count 1 00000100:00000040:0.0:1783444593.738620:0:71469:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3aff800 x1870073557909888/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:214/0 lens 224/0 e 0 to 0 dl 1783444604 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444593.738624:0:94360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557909632:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444593.738647:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557909888:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:3.0:1783444593.738650:0:94360:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073557909632 00010000:00000040:0.0:1783444593.738663:0:71469:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 77309411468, transno 0, xid 1870073557909888 00000100:00000040:3.0:1783444593.738677:0:94360:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444593.738682:0:71469:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 12 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444593.738687:0:94360:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444593.738691:0:71469:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:0.0:1783444593.738730:0:71469:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444593.738737:0:71469:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3aff800 x1870073557909888/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:214/0 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.738748:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557909888:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 109us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444593.738755:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1240 00000100:00000040:0.0:1783444593.738758:0:71469:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368dd20c800 : new rpc_count 0 00000020:00000040:0.0:1783444593.738769:0:71469:0:(genops.c:900:class_export_put()) PUTting export ffff9368dd20c800 : new refcount 10 00000100:00100000:0.0:1783444593.738779:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1241 00000100:00000040:0.0:1783444593.738782:0:71469:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c5621800 : new rpc_count 1 00000100:00000040:0.0:1783444593.738786:0:71469:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3affb80 x1870073557909760/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:214/0 lens 224/0 e 0 to 0 dl 1783444604 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.738833:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2403:x1870073557909760:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:0.0:1783444593.738845:0:71469:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1870073557909760 00000100:00000040:0.0:1783444593.738850:0:71469:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 12 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444593.738854:0:71469:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00080000:1.0:1783444593.741971:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1783444593.741982:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9367c2c63380) now 16 - evictor 00000100:00080000:1.0:1783444593.741988:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1783444593.741991:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9368dcfd99c0) now 12 - evictor 00000100:00100000:1.0:1783444593.742011:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557910016 00000100:00100000:1.0:1783444593.742020:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557910016 00000020:00000040:1.0:1783444593.742023:0:26200:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e383397b 00000020:00000040:1.0:1783444593.742027:0:26200:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c518e000 refcount=7 00000020:00000040:1.0:1783444593.742775:0:26200:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00100000:1.0:1783444593.743341:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2594 00000100:00000040:1.0:1783444593.743370:0:26200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c518e000 : new rpc_count 1 00000100:00000040:1.0:1783444593.743578:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c3aff100 x1870073557910016/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:214/0 lens 224/0 e 0 to 0 dl 1783444604 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1783444593.743729:0:94360:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:3.0:1783444593.743739:0:94360:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368c9fcd850 x1870073557909632/t0(0) o400->28921b6e-3bc9-4a81-ae87-1992169ba754@192.168.204.20@tcp:214/0 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783444593.743751:0:94360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557909632:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 5134us (5733us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444593.743761:0:94360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00000040:3.0:1783444593.743764:0:94360:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c6ab4800 : new rpc_count 0 00000020:00000040:3.0:1783444593.743777:0:94360:0:(genops.c:900:class_export_put()) PUTting export ffff9367c6ab4800 : new refcount 9 00000100:00000040:0.0:1783444593.743849:0:71469:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00000100:00000040:0.0:1783444593.743859:0:71469:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3affb80 x1870073557909760/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:214/0 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.743869:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2403:x1870073557909760:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 5040us (5541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444593.743878:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1241 00000100:00000040:0.0:1783444593.743881:0:71469:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c5621800 : new rpc_count 0 00000020:00000040:0.0:1783444593.743890:0:71469:0:(genops.c:900:class_export_put()) PUTting export ffff9367c5621800 : new refcount 50 00000100:00080000:0.0:1783444593.744064:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1783444593.744070:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00100000:1.0:1783444593.744581:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557910016:12345-192.168.204.20@tcp:400:kworker.0 00010000:00000040:1.0:1783444593.744607:0:26200:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 0, transno 0, xid 1870073557910016 00000100:00000040:1.0:1783444593.744616:0:26200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368c66ceac0 refcount 11 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444593.744621:0:26200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.204.20@tcp 00000100:00000040:1.0:1783444593.744657:0:26200:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368c66ceac0 refcount 10 to 192.168.204.20@tcp 00000100:00000040:1.0:1783444593.744663:0:26200:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3aff100 x1870073557910016/t0(0) o400->08efc25c-17e5-4d29-97d2-f1505f195a06@192.168.204.20@tcp:214/0 lens 224/224 e 0 to 0 dl 1783444604 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444593.744683:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557910016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 109us (6291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444593.744690:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2594 00000100:00000040:1.0:1783444593.744694:0:26200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c518e000 : new rpc_count 0 00000020:00000040:1.0:1783444593.744704:0:26200:0:(genops.c:900:class_export_put()) PUTting export ffff9368c518e000 : new refcount 6 00010000:00010000:2.0:1783444593.756932:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1783444593.951550:0:75658:0:(genops.c:1231:class_import_get()) import ffff9368f8ca7800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1783444593.951593:0:75658:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a2fd7778] to pc [ptlrpcd_00_02+2] req@ffff9367c3afe680 x1870073575469952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444593.951683:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9367c3afe680 x1870073575469952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444593.951699:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575469952:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1783444593.951735:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9367c3afe680 x1870073575469952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444593.951745:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1783444593.951806:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9367c436b480 x1870073575469952 msgsize 224 00000100:00100000:2.0:1783444593.951811:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1783444593.951845:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9367c3afe680 x1870073575469952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1783444593.951860:0:3635:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1772161 usecs (1773 jiffies) 00000100:00100000:0.0:1783444593.951942:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575469952 00000100:00100000:0.0:1783444593.951950:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575469952 00000020:00000040:0.0:1783444593.951953:0:8431:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e38335c3 00000020:00000040:0.0:1783444593.951958:0:8431:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9367c5624000 refcount=7 00000100:00000040:0.0:1783444593.951985:0:8431:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1783444593.952016:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00000040:0.0:1783444593.952020:0:8431:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9367c5624000 : new rpc_count 1 00000100:00000040:0.0:1783444593.952026:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9367c436b480 x1870073575469952/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:214/0 lens 224/0 e 0 to 0 dl 1783444604 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.952056:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575469952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783444593.952089:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00010000:00000040:0.0:1783444593.952101:0:8431:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1870073575469952 00000100:00000040:0.0:1783444593.952110:0:8431:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 66 to 0@lo 00000100:00000040:0.0:1783444593.952114:0:8431:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1783444593.952133:0:8431:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9367c3afe680 x1870073575469952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1783444593.952149:0:8431:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 65 to 0@lo 00000100:00000040:0.0:1783444593.952154:0:8431:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c436b480 x1870073575469952/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:214/0 lens 224/368 e 0 to 0 dl 1783444604 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783444593.952162:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575469952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444593.952168:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00000040:0.0:1783444593.952171:0:8431:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9367c5624000 : new rpc_count 0 00000020:00000040:0.0:1783444593.952180:0:8431:0:(genops.c:900:class_export_put()) PUTting export ffff9367c5624000 : new refcount 6 00000100:00000040:2.0:1783444593.952259:0:3635:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1783444593.952265:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9367c3afe680 x1870073575469952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1783444593.952282:0:3635:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352727 avail=317024 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023568 state=0: rc = 0 00000100:00000040:2.0:1783444593.952290:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9367c3afe680 x1870073575469952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783444593.952297:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3afe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575469952:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1783444593.952303:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9367c3afe680 x1870073575469952/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1783444609 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1783444593.952312:0:3635:0:(genops.c:1244:class_import_put()) import ffff9368f8ca7800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:1.0:1783444594.466610:0:94375:0:(genops.c:1231:class_import_get()) import ffff9367c5037000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1783444594.466652:0:94375:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000284a53fa] to pc [ptlrpcd_00_03+3] req@ffff9368f5649880 x1870073575470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444594.466705:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:1.0:1783444594.466722:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9368f5649880 x1870073575470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444594.466735:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f5649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575470080:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1783444594.466764:0:3635:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9368f5649880 x1870073575470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444610 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444594.466771:0:3635:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444594.466832:0:3635:0:(events.c:337:request_in_callback()) incoming req@ffff9368f5648700 x1870073575470080 msgsize 224 00000100:00100000:1.0:1783444594.466837:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1783444594.466872:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9368f5649880 x1870073575470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444610 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444594.466884:0:3635:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7308 usecs (8 jiffies) 00000100:00100000:1.0:1783444594.466912:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575470080 00000100:00100000:1.0:1783444594.466919:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575470080 00000020:00000040:1.0:1783444594.466922:0:8423:0:(genops.c:825:class_conn2export()) looking for export cookie 0x42cb6883e3833633 00000020:00000040:1.0:1783444594.466926:0:8423:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9368c5118000 refcount=5 00000020:00000040:1.0:1783444594.466940:0:8423:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000100:00000040:1.0:1783444594.466970:0:8423:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1783444594.466997:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00000040:1.0:1783444594.467001:0:8423:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9368c5118000 : new rpc_count 1 00000100:00000040:1.0:1783444594.467008:0:8423:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9368f5648700 x1870073575470080/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:215/0 lens 224/0 e 0 to 0 dl 1783444605 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444594.467022:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575470080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783444594.467047:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1783444594.467059:0:8423:0:(ldlm_lib.c:3292:target_committed_to_req()) last_committed 4294969460, transno 0, xid 1870073575470080 00000100:00000040:1.0:1783444594.467069:0:8423:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9368f59e0380 refcount 66 to 0@lo 00000100:00000040:1.0:1783444594.467074:0:8423:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1783444594.467095:0:8423:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9368f5649880 x1870073575470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444610 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1783444594.467116:0:8423:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9368f59e0380 refcount 65 to 0@lo 00000100:00000040:1.0:1783444594.467121:0:8423:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f5648700 x1870073575470080/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:215/0 lens 224/368 e 0 to 0 dl 1783444605 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444594.467129:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575470080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444594.467136:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00000040:1.0:1783444594.467138:0:8423:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9368c5118000 : new rpc_count 0 00000020:00000040:1.0:1783444594.467150:0:8423:0:(genops.c:900:class_export_put()) PUTting export ffff9368c5118000 : new refcount 4 00000100:00000040:1.0:1783444594.467196:0:3635:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969460 00000100:00000040:1.0:1783444594.467203:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9368f5649880 x1870073575470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1783444594.467214:0:3635:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:1.0:1783444594.467217:0:3635:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1783444594.467225:0:3635:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9368f5649880 x1870073575470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444610 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783444594.467233:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f5649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575470080:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1783444594.467240:0:3635:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9368f5649880 x1870073575470080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783444610 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783444594.467572:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1783444594.467577:0:6502:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9367c2c64d40) now 10 - evictor 00000020:00000040:1.0:1783444594.468074:0:3635:0:(genops.c:1244:class_import_put()) import ffff9367c5037000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:3.0:1783444594.780974:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783444595.805191:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783444595.939881:0:97289:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1783444595.997202:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444595.997210:0:93851:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1783444595.997231:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444595.997234:0:93851:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1783444595.997281:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575470592:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.997349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444595.997383:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575471104:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.997402:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444595.997426:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783444595.997431:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575470464:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.997450:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444595.997465:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575470976:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.997484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444595.997500:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575471488:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.997520:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444595.997565:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575470592 00000100:00100000:2.0:1783444595.997573:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575470592 00000100:00100000:2.0:1783444595.997618:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575470976 00000100:00100000:2.0:1783444595.997622:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575470976 00000100:00100000:2.0:1783444595.997654:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:2.0:1783444595.997664:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575470592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.997719:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3636:x1870073575470592:12345-0@lo:400:kworker.0 Request processed in 57us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444595.997727:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:2.0:1783444595.997743:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:2.0:1783444595.997749:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575470976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.997777:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575470976:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444595.997783:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:2.0:1783444595.997818:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575471104 00000100:00100000:2.0:1783444595.997822:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575471104 00000100:00100000:2.0:1783444595.997847:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1783444595.997853:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575471104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.997883:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575471104:12345-0@lo:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444595.997888:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1783444595.997907:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575470464 00000100:00100000:2.0:1783444595.997910:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575470464 00000100:00100000:2.0:1783444595.997944:0:66223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575471488 00000100:00100000:2.0:1783444595.997946:0:66223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575471488 00000100:00100000:2.0:1783444595.997967:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1783444595.997974:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575470464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.998005:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870073575470464:12345-0@lo:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444595.998018:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1783444595.998030:0:66223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1783444595.998036:0:66223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575471488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.998062:0:66223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870073575471488:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444595.998068:0:66223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00080000:2.0:1783444595.998093:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783444595.998130:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1870073575470464:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.998141:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575470976:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.998150:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1870073575471488:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.998160:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575470592:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.998167:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575471104:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998291:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575470336:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998321:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444595.998355:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575470848:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998374:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444595.998391:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575471360:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998413:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444595.998432:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783444595.998438:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c436ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575470208:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998464:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444595.998498:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575470720:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998519:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444595.998537:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575471232:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998566:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444595.998598:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575470336 00000100:00100000:1.0:1783444595.998603:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575470336 00000100:00100000:1.0:1783444595.998643:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575470848 00000100:00100000:1.0:1783444595.998646:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575470848 00000100:00100000:1.0:1783444595.998658:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575471360 00000100:00100000:1.0:1783444595.998661:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575471360 00000100:00100000:1.0:1783444595.998673:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575471232 00000100:00100000:1.0:1783444595.998675:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575471232 00000100:00100000:1.0:1783444595.998687:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1783444595.998692:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575470336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998728:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575470336:12345-0@lo:400:kworker.0 Request processed in 34us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444595.998734:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1783444595.998747:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1783444595.998753:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575470848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998778:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1870073575470848:12345-0@lo:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444595.998783:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1783444595.998821:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1783444595.998827:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f564bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575471360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998853:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f564bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1870073575471360:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444595.998859:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1783444595.998869:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1783444595.998875:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f564a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575471232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.998900:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f564a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1870073575471232:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444595.998912:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1783444595.998935:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575470720 00000100:00100000:1.0:1783444595.998939:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575470720 00000100:00100000:1.0:1783444595.998964:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1783444595.998970:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f564ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575470720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.999001:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f564ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575470720:12345-0@lo:400:kworker.0 Request processed in 32us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444595.999008:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00080000:1.0:1783444595.999029:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444595.999033:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444595.999054:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575470720:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.999065:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1870073575471232:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.999075:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575470336:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.999085:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1870073575470848:0@lo:400:kworker.0 00000100:00100000:1.0:1783444595.999095:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1870073575471360:0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.999313:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575470208 00000100:00100000:2.0:1783444595.999317:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575470208 00000100:00100000:2.0:1783444595.999350:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783444595.999357:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575470208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444595.999393:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3634:x1870073575470208:12345-0@lo:400:kworker.0 Request processed in 38us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444595.999400:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783444595.999476:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c436ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c89ab73b-dbb2-4305-b221-37cc64d61227:3634:1870073575470208:0@lo:400:kworker.0 00000001:00080000:1.0:1783444596.008991:0:96932:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969515 is committed 00000020:00000004:3.0:1783444596.738582:0:97341:0:(tgt_mount.c:2345:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783444596.739959:0:97341:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783444596.748552:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444596.748649:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444596.748746:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557910144 00000100:00100000:1.0:1783444596.748755:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557910144 00000100:00100000:1.0:1783444596.748835:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:1.0:1783444596.748846:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c9fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557910144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444596.748924:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c9fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557910144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 78us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444596.748946:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:3.0:1783444596.749372:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557910272 00000100:00100000:3.0:1783444596.749377:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557910272 00000100:00100000:3.0:1783444596.749439:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1248 00000100:00100000:3.0:1783444596.749448:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2403:x1870073557910272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444596.749492:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2403:x1870073557910272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 46us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444596.749498:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1248 00000100:00080000:1.0:1783444596.749775:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783444596.762964:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1783444596.763207:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557910400 00000100:00100000:1.0:1783444596.763654:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557910400 00000100:00100000:1.0:1783444596.763734:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1249 00000100:00100000:1.0:1783444596.763745:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557910400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1783444596.763844:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557910400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 100us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444596.763852:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1249 00000100:00100000:0.0:1783444596.764324:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444596.764410:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557910528 00000100:00100000:0.0:1783444596.764416:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557910528 00000100:00100000:0.0:1783444596.764451:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2597 00000100:00100000:0.0:1783444596.764460:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557910528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444596.764500:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557910528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 43us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444596.764507:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2597 00000100:00080000:3.0:1783444596.764750:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783444596.764756:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783444596.829000:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783444597.568570:0:97391:0:(tgt_mount.c:2345:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783444597.568901:0:97391:0:(tgt_mount.c:2360:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783444597.852966:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783444598.556953:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368ff660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575471616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783444598.557030:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444598.557092:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575471616 00000100:00100000:0.0:1783444598.557100:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575471616 00000100:00100000:0.0:1783444598.557154:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:0.0:1783444598.557163:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575471616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783444598.557196:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00000100:00100000:1.0:1783444598.557197:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783444598.557206:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368f5648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575471744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783444598.557234:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444598.557240:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575471616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444598.557248:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:0.0:1783444598.557288:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368ff660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575471616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783444598.563308:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575471744 00000100:00100000:2.0:1783444598.563325:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575471744 00000100:00100000:2.0:1783444598.565051:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1783444598.565069:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575471744:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1783444598.565180:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1783444598.565194:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444598.565288:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1870073575471744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 225us (8052us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444598.565296:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:1.0:1783444598.565505:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368f5648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575471744:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783444598.876940:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444599.069071:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575471872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444599.069146:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444599.070096:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575471872 00000100:00100000:3.0:1783444599.070106:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575471872 00000100:00100000:3.0:1783444599.070151:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:3.0:1783444599.070160:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575471872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783444599.070215:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00100000:3.0:1783444599.076976:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575471872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6806us (7820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444599.076992:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1783444599.077257:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575471872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444599.583600:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575472000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783444599.583671:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444599.583713:0:13537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575472000 00000100:00100000:3.0:1783444599.583721:0:13537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575472000 00000100:00100000:3.0:1783444599.583808:0:13537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:3.0:1783444599.583833:0:13537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575472000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783444599.583857:0:13537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783444599.583905:0:13537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575472000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444599.583912:0:13537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00080000:1.0:1783444599.584133:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783444599.584181:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575472000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783444599.902140:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783444600.928110:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444601.117015:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783444601.117185:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575472384:0@lo:400:kworker.0 00000100:00100000:3.0:1783444601.117266:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444601.117314:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783444601.117320:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575472256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444601.117344:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783444601.117398:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575472384 00000100:00100000:3.0:1783444601.117407:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575472384 00000100:00100000:3.0:1783444601.117460:0:66225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575472256 00000100:00100000:3.0:1783444601.117463:0:66225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575472256 00000100:00100000:3.0:1783444601.117488:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1783444601.117497:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575472384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444601.117567:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575472384:12345-0@lo:400:kworker.0 Request processed in 72us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444601.117575:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1783444601.117603:0:66225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:3.0:1783444601.117612:0:66225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575472256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444601.117652:0:66225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1870073575472256:12345-0@lo:400:kworker.0 Request processed in 42us (307us total) trans 0 rc 0/0 00000100:00080000:0.0:1783444601.117658:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783444601.117661:0:66225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00080000:0.0:1783444601.117665:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783444601.117705:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1870073575472256:0@lo:400:kworker.0 00000100:00100000:3.0:1783444601.117716:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575472384:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.122260:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575472512:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.122445:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444601.122490:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575472128:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.122522:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783444601.122685:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444601.122690:0:93851:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1783444601.122739:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444601.122743:0:93851:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1783444601.122783:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575472768:0@lo:400:kworker.0 00000100:00100000:2.0:1783444601.122838:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444601.122838:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575472512 00000100:00100000:0.0:1783444601.122848:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575472512 00000100:00100000:2.0:1783444601.122867:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575473280:0@lo:400:kworker.0 00000100:00100000:2.0:1783444601.122892:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444601.122902:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:0.0:1783444601.122913:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368f5649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575472512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444601.122916:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783444601.122925:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575472896:0@lo:400:kworker.0 00000100:00100000:2.0:1783444601.122950:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444601.122971:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575473408:0@lo:400:kworker.0 00000100:00100000:0.0:1783444601.122980:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368f5649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3635:x1870073575472512:12345-0@lo:400:kworker.0 Request processed in 68us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444601.122989:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:2.0:1783444601.122998:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783444601.123008:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575472896 00000100:00100000:0.0:1783444601.123013:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575472896 00000100:00100000:2.0:1783444601.123028:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575472768 00000100:00100000:2.0:1783444601.123034:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575472768 00000100:00100000:0.0:1783444601.123057:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:0.0:1783444601.123065:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575472896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444601.123074:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575473280 00000100:00100000:2.0:1783444601.123078:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575473280 00000100:00100000:0.0:1783444601.123110:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3633:x1870073575472896:12345-0@lo:400:kworker.0 Request processed in 45us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444601.123118:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:2.0:1783444601.123119:0:71469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575473408 00000100:00100000:2.0:1783444601.123124:0:71469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575473408 00000100:00100000:2.0:1783444601.123154:0:71469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1783444601.123161:0:71469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575472768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123337:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575473024:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123366:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444601.123410:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575472512:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123428:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783444601.123433:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575472640:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123456:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444601.123474:0:3635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c3911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575473152:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123494:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444601.123514:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575473024 00000100:00100000:1.0:1783444601.123517:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575473024 00000100:00100000:1.0:1783444601.123559:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575472640 00000100:00100000:1.0:1783444601.123562:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575472640 00000100:00100000:1.0:1783444601.123583:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1783444601.123590:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c436ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575473024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123623:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c436ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3635:x1870073575473024:12345-0@lo:400:kworker.0 Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444601.123629:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1783444601.123643:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1783444601.123649:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c3910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575472640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123676:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c3910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3635:x1870073575472640:12345-0@lo:400:kworker.0 Request processed in 28us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444601.123682:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1783444601.123722:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1870073575472640:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123733:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1870073575473024:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123809:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575473152 00000100:00100000:1.0:1783444601.123813:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575473152 00000100:00100000:1.0:1783444601.123834:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1783444601.123840:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575473280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123873:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1870073575473280:12345-0@lo:400:kworker.0 Request processed in 33us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444601.123879:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1783444601.123892:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1783444601.123898:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c33f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575473408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123924:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1870073575473408:12345-0@lo:400:kworker.0 Request processed in 26us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444601.123930:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1783444601.123941:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1783444601.123946:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575473152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.123978:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1870073575473152:12345-0@lo:400:kworker.0 Request processed in 32us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444601.123984:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1783444601.124014:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3635:1870073575473152:0@lo:400:kworker.0 00000100:00080000:1.0:1783444601.124043:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783444601.124048:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783444601.124050:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783444601.124066:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1870073575472896:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.124080:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1870073575473408:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.124099:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1870073575473280:0@lo:400:kworker.0 00000100:00100000:2.0:1783444601.124523:0:71469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c33f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1870073575472768:12345-0@lo:400:kworker.0 Request processed in 1362us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444601.124539:0:71469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1783444601.124622:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575472128 00000100:00100000:3.0:1783444601.124627:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575472128 00000100:00100000:3.0:1783444601.124671:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783444601.124678:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575472128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783444601.124728:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3635:x1870073575472128:12345-0@lo:400:kworker.0 Request processed in 50us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444601.124734:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783444601.124870:0:3635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c89ab73b-dbb2-4305-b221-37cc64d61227:3635:1870073575472128:0@lo:400:kworker.0 00000100:00100000:1.0:1783444601.124946:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c3911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1870073575472768:0@lo:400:kworker.0 00000100:00100000:3.0:1783444601.932896:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444601.932936:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444601.932977:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1783444601.933006:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1783444601.933130:0:94359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557910656 00000100:00100000:0.0:1783444601.933142:0:94359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557910656 00000100:00100000:0.0:1783444601.933205:0:94359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:0.0:1783444601.933215:0:94359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557910656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444601.933288:0:94359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8164850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28921b6e-3bc9-4a81-ae87-1992169ba754+10:2403:x1870073557910656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444601.933296:0:94359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:3.0:1783444601.934065:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557910912 00000100:00100000:3.0:1783444601.934072:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557910912 00000100:00100000:3.0:1783444601.934126:0:66226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557910784 00000100:00100000:3.0:1783444601.934129:0:66226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557910784 00000100:00100000:3.0:1783444601.934302:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1256 00000100:00100000:3.0:1783444601.934322:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557910912:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444601.934379:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+11:2403:x1870073557910912:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 68us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444601.934402:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1256 00000100:00100000:3.0:1783444601.934419:0:66226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1257 00000100:00100000:3.0:1783444601.934425:0:66226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2403:x1870073557910784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1783444601.934466:0:66226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:08efc25c-17e5-4d29-97d2-f1505f195a06+51:2403:x1870073557910784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1783444601.934473:0:66226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1257 00000100:00080000:3.0:1783444601.934508:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783444601.934512:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783444601.934703:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073557911040 00000100:00100000:0.0:1783444601.934708:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073557911040 00000100:00100000:0.0:1783444601.938982:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2600 00000100:00100000:0.0:1783444601.938998:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368eaaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557911040:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1783444601.939083:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368eaaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:08efc25c-17e5-4d29-97d2-f1505f195a06+7:2403:x1870073557911040:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 89us (6075us total) trans 0 rc 0/0 00000100:00100000:0.0:1783444601.939091:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2600 00000100:00080000:3.0:1783444601.940670:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783444601.953395:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783444602.280673:0:97583:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 00010000:00010000:3.0:1783444602.974453:0:6494:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444603.677754:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783444603.677778:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c4a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575473536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444603.677861:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783444603.677914:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575473664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444603.677938:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575473536 00000100:00100000:1.0:1783444603.677945:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444603.677949:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575473536 00000100:00100000:1.0:1783444603.677982:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575473664 00000100:00100000:1.0:1783444603.677987:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575473664 00000100:00100000:2.0:1783444603.678015:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:2.0:1783444603.678027:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575473536:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783444603.678033:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1783444603.678043:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575473664:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:2.0:1783444603.678070:0:23687:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1298780160 00002000:00000024:1.0:1783444603.678070:0:8423:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444603.678147:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3636:x1870073575473536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444603.678154:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00100000:1.0:1783444603.678348:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575473664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 306us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783444603.678356:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00080000:1.0:1783444603.678377:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783444603.680334:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575473664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783444603.680357:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c4a65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1870073575473536:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1783444603.781057:0:97632:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:0.0:1783444603.997094:0:6493:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783444604.189118:0:3633:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575473792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783444604.189201:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444604.189598:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575473792 00000100:00100000:2.0:1783444604.189608:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575473792 00000100:00100000:2.0:1783444604.189667:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1783444604.189678:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c4a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575473792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783444604.189717:0:8431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444769792 avail 1298530304 00000100:00100000:2.0:1783444604.189818:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c4a66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3633:x1870073575473792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444604.189826:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:0.0:1783444604.189984:0:3633:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1870073575473792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783444604.701330:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575473920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783444604.701438:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444604.701571:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575473920 00000100:00100000:2.0:1783444604.701583:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575473920 00000100:00100000:2.0:1783444604.701682:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:2.0:1783444604.701695:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368ff660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575473920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783444604.701725:0:8424:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783444604.701812:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368ff660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575473920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444604.701820:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:2.0:1783444604.701872:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575473920:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783444604.701967:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783444605.021034:0:10323:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783444605.089620:0:97680:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00010000:00010000:0.0:1783444606.047735:0:10324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783444606.242126:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444606.242134:0:93851:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1783444606.242157:0:93851:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783444606.242159:0:93851:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1783444606.242202:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575474176:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242271:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242306:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575474688:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242327:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242344:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575475200:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242388:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783444606.242394:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575474048:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242421:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242460:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575474560:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242502:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575475072:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242537:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242565:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9369005b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575474432:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242590:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242607:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575474944:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242625:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242658:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783444606.242663:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575474304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242684:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242700:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9367c68f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575474816:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242722:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242738:0:3634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9368e69ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575475328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.242757:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783444606.242785:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575474176 00000100:00100000:2.0:1783444606.242818:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575474176 00000100:00100000:2.0:1783444606.242866:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575474688 00000100:00100000:2.0:1783444606.242869:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575474688 00000100:00100000:2.0:1783444606.242883:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575475200 00000100:00100000:2.0:1783444606.242886:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575475200 00000100:00100000:2.0:1783444606.242898:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575475072 00000100:00100000:2.0:1783444606.242901:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575475072 00000100:00100000:2.0:1783444606.242911:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575474304 00000100:00100000:2.0:1783444606.242913:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575474304 00000100:00100000:2.0:1783444606.242925:0:80475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575475328 00000100:00100000:2.0:1783444606.242927:0:80475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575475328 00000100:00100000:2.0:1783444606.242943:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1783444606.242951:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575474176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243003:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870073575474176:12345-0@lo:400:kworker.0 Request processed in 52us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243020:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1783444606.243036:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1783444606.243042:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575474688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243071:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870073575474688:12345-0@lo:400:kworker.0 Request processed in 30us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243077:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1783444606.243088:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1783444606.243094:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575475200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243117:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870073575475200:12345-0@lo:400:kworker.0 Request processed in 24us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243123:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1783444606.243132:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1783444606.243137:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575475072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243158:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870073575475072:12345-0@lo:400:kworker.0 Request processed in 21us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243163:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1783444606.243173:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1783444606.243178:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575474304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243204:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1870073575474304:12345-0@lo:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243209:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1783444606.243220:0:80475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1783444606.243226:0:80475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575475328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243250:0:80475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1870073575475328:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243262:0:80475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1783444606.243286:0:94361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575474048 00000100:00100000:2.0:1783444606.243289:0:94361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575474048 00000100:00100000:2.0:1783444606.243312:0:94361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783444606.243318:0:94361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575474048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243345:0:94361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368c8165c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c89ab73b-dbb2-4305-b221-37cc64d61227+24:3636:x1870073575474048:12345-0@lo:400:kworker.0 Request processed in 27us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243351:0:94361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783444606.243375:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575474560 00000100:00100000:2.0:1783444606.243378:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575474560 00000100:00100000:2.0:1783444606.243400:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575474944 00000100:00100000:2.0:1783444606.243402:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575474944 00000100:00100000:2.0:1783444606.243416:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1783444606.243421:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575474560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243464:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1870073575474560:12345-0@lo:400:kworker.0 Request processed in 42us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243470:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1783444606.243479:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1783444606.243484:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575474944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243504:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575474944:12345-0@lo:400:kworker.0 Request processed in 21us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243509:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1783444606.243527:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575474432 00000100:00100000:2.0:1783444606.243529:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575474432 00000100:00100000:2.0:1783444606.243549:0:23687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870073575474816 00000100:00100000:2.0:1783444606.243551:0:23687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870073575474816 00000100:00100000:2.0:1783444606.243565:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:2.0:1783444606.243576:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9368e69ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575474432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243605:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9368e69ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3634:x1870073575474432:12345-0@lo:400:kworker.0 Request processed in 30us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243611:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:2.0:1783444606.243621:0:23687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1783444606.243626:0:23687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9367c32b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575474816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243648:0:23687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9367c32b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3634:x1870073575474816:12345-0@lo:400:kworker.0 Request processed in 22us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1783444606.243653:0:23687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00080000:2.0:1783444606.243678:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783444606.243682:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783444606.243684:0:6502:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783444606.243708:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c89ab73b-dbb2-4305-b221-37cc64d61227:3636:1870073575474048:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243721:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1870073575474560:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243729:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870073575475072:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243739:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1870073575474176:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243747:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870073575474688:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243755:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1870073575475200:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243824:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c33f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3634:1870073575474304:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243834:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9367c68f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575474816:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243842:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1870073575475328:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243850:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9369005b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1870073575474432:0@lo:400:kworker.0 00000100:00100000:2.0:1783444606.243868:0:3634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9368e69ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1870073575474944:0@lo:400:kworker.0 Debug log: 70463 lines, 70463 kept, 0 dropped, 0 bad.